Big Data Expert

Get to know this occupation

Description

Big Data expert is the professional who designs the application process of Big Data systems in companies, including: to analyze the needs of data exploitation (quantification of data volume to be processed, type of data analysis, and storage capacity); to dimension the system based on these needs; to design and plan a security system; to track, and support its implementation; to train company staff in Big Data system operation; or to participate in the strategic development of the company, providing information about Big Data system possibilities.

Big Data expert works, usually in technology consulting firms that design server applications in Java/J2EE environments, Oracle, Microsoft, Host / Cobol, among others, and integrate security solutions or business intelligence, as Hadoop, Hive and Pig.

Tasks

Analysis of needs about data exploitation:

¿ To quantify the volume of data to be processed and of the digital universe (internet, social networks ...) to be handled.
¿ To analyze the type of data to be managed (text, video, images, ...), its use (static or dynamic), and to size the bandwidth needed to treat them.
¿ To identify the storage capacity needed to manage the volume of data with security.

Big Data systems implementation:

¿ To propose the most appropriate Big Data solution considering the analysis, and manage its implementation.
¿ To set the security system to prevent risks (data encryption, malware scan or exhaust systems ...).
¿ To provide solutions to incidents that may arise from the final integration of Big Data systems.

System monitoring and support to its Implementation:

¿ To make the necessary checks to ensure that the system works properly: quality tests, pilot tests ...
¿ To train staff in Big Data system operation implemented.
¿ To participate in strategic development of the company providing information about Big Data possibilities and to propose new solutions.
¿ To prepare technical documentation related to Big Data project: design of the structure, rationale of its approach and description of the functionalities.

Copy the link | Favoritos

What do you need?

Training

Regulated training and graduates

There are various studies that prepare an individual for this occupation, including:

Grau: Matemàtiques
Grau: Física
Grau: Enginyeria física
Grau: Estadística
Grau: Estadística aplicada
Grau: Bioinformàtica
Grau: Enginyeria informàtica
Grau: Enginyeria telemàtica
Grau: Enginyeria informàtica de gestió i sistemes d'informació
Grau: Informàtica i serveis

Complementary training

Big Data expert must have additional training that can be acquired by doing the following courses:

¿ Course on server environments such as Java/J2EE, Oracle, SAP-BO, Microsoft, Microstrategy or Cognos.
¿ Course on Platforms created by open source to generate Big Data solutions, for example, Hadoop.
¿ Course on distributed data and high-volume, non-relational databases and optimization algorithms.

Other specific skills

This professional must have business skills, communication and capacity to dialogue with customers, and manage technology projects. It must be able to develop commercial and technical documentation in English. This means that it must have a high level of English, at least at technical level.
It must also know about Java/J2EE web environments, Oracle, SAP-BO, Microsoft, Microstrategy or Cognos, and about open source platforms to generate by Big Data solutions, for example, the Hadoop.

More occupations with this training | Look for more information on the degree of interest

Experience

It is required a minimum of 2 years of experience managing projects in the field of business intelligence (i.e., in the development of strategies and tools aimed at creating knowledge through the analysis of data in an organization or company).If there is no experience, also is valued having worked in programming high volume database in high volume or adaptation of web environments.

Soft skills

Learning and use of knowledge: Level 2

Orientation within reach: Level 2

Planning and organisation: Level 3

Initiative: Level 3

Communication: Level 2

Strategic orientation: Level 3

Gain insight into soft skills | Access the dictionary of soft skills

Interests

New technologies

People who show an interest in this field are motivated by the development and advanced use of new technologies in any of their applications (software, hardware, telecommunications) from an innovative perspective and in accordance with the continuous updates of technologies, programmes and equipment that appear on the market. The design, installation, management and maintenance of computer systems and new technologies are activities specific to this field.

Management

The organisation, administration and control of a company or entity are the main interests of people related to the management field. Activities included in this field of interest vary from effective resource management, feasibility analyses and solving business problems to the development of skills and fostering of motivation in relation to human resources. Knowledge regarding specific techniques of strategic administration and business management are required to carry out these activities.

More occupations with your interests | Get to know your professional interests | Glossary of interests

Related occupations

Electricity market analyst/operator.

e-Health consultant

Expert in evaluating virtual public offices

Engineer in artificial intelligence

Avionics software engineer

Copy the link | Favoritos

This occupation on the market

Wage earner

Work hours
The regular schedule is 40 hours spread over eight hours a day, morning and afternoon sessions. It is demanded flexibility to accommodate the workload to projects and customer needs.
Salary
The salary is calculated according to the experience, worked hours, responsibility and professional category, normally, it is situated between 30.371 and 47.611 gross per year. Median: 36.410 euros annum gross.

Source: Report "Observatory of Jobs and Salaries of the Labour Market. Barcelona Activa", elaborated by ICSA Grupo. April 2015.
Professional category
Technician

Highlights

One of the main tasks of Big Data expert is analyze the needs related to data exploiting, because Big Data systems allow the manipulation and analysis of large data repositories, so disproportionately large that it is impossible to treat them with the database tools and conventional analysis. The high volume of data from web pages, image and video applications, social networking, mobile devices, apps or sensors, require powerful systems that allow its management to many different purposes: business analysis, data on infectious diseases, product marketing, etc. Thus, the work done by the Big Data expert is used to help the decision-making of other professionals. According to Expansion magazine (Http://www.expansion.com/agencia/efe/2012/06/27/17393014.html), and to the results of the study "The emergence of Big Data market" developed by International Data Corporation (IDC), the 4.8% of Spanish companies is using Big Data, and it is estimated that the number will reach 7.6% in 2013, and to 19.4% in 2014. IDC considers that, in the current context of disproportionate growth of information, Big Data is one of the main technological trends that will change the market and will transform the way of doing business because will facilitate decision-making and will reduce business costs. However, identifies four factors that influence on the implementation of this technology in Spain: lack of experts, lack of investments to implement Big Data solutions, difficulties to integrate it into internal processes of companies and quality of the data (if the information has no value, it makes no sense to process it). In this context the Big Data expert professional career has positive perspectives, not only for the expected growth of this activity but also by the lack of specialized professionals.

Copy the link | Favoritos

Get to know the industry

ITC Organisations and business

ITC

The Information and Communication (ICT) sub-industry is a key industry in Barcelona and Catalonia, both in itself and on account of the impact it has on improving business competitiveness. Catalonia is home to a fourth of all ICT companies in Spain. The core of ICT activities in Catalonia and Barcelona is focussed mainly on a web of SMEs which seek to offer ICT services and develop high-quality software. Even so, the city is increasingly attracting major ICT firms offering highly specialised services. The ICT industry is structured around the intensive and extensive application of information technologies and telecommunications throughout all aspects of life and the economy. It employs a wide variety of professional profiles, all connected to the main areas of this sub-industry: infrastructure, digital solutions and technical support.

Telecommunications and ICT

01-2006 | | Catalan | Beginner

Documents (5 of 11)

Sector Overview: ICT

04-2024 | | English | Advanced

This document shows data to have more information about the sector that will help you in your decisions regarding your training-work itinerary. This data is grouped into the following

This document shows data to have more information about the sector that will help you in your decisions regarding your training-work itinerary. This data is grouped into the following sections: in short, digital transformation, strengths of the sector in Barcelona, the most sought-after (professional profiles and skills) and the future of the sector

Author: Barcelona Activa
Publishing date: 04-2024

Open

Sector Report: ICT

12-2023 | | English | Beginner

Sectoral report showing the keys to this economic area as well as the main trends, both consolidated and emerging, in activities and professional profiles and reveals future scenarios.

Author: Barcelona Activa
Publishing date: 12-2023

Open

Focus sectorial: Big data

08-2023 | | English | Advanced

Brief report about the applications and benefits of Big Data for companies. It also highlights the impact on professional profiles.

Author: Barcelona Activa
Publishing date: 08-2023

Open

Focus sectorial: Programming

08-2023 | | English | Advanced

This document tells how programming is an essential competence beyond the ICT sector and the importance it has within the labor market.

Author: Barcelona Activa
Publishing date: 08-2023

Open

Focus sectorial: Digital twins

08-2023 | | English | Advanced

A brief report explaining digital twins , their implications in the production process and their impact in the professional profiles.

Author: Barcelona Activa
Publishing date: 08-2023

Open

Sectorial testimony: Joaquín Garrido

Joaquín Garrido, computer engineer at Global SIO, talks about the importance of ICT in the future of the sector, how it will transform the work of the professionals involved and what are the new trends.

Copy the link | Favoritos

Sectorial testimony: Joaquim Minguella

Joaquim Minguella, professor of production technologies in the Department of Mechanical Engineering at the UPC, explains which profiles are most in demand in the manufacturing industry and 4.0 sector and what skills and knowledge professionals should have.

Copy the link | Favoritos

Sectorial testimony: Marta Vallés

Marta Vallès, co-founder of Vottun, explains the issue of the blockchain revolution within the ICT sector, which are the profiles most in demand within this field and what skills they should have.

Copy the link | Favoritos

Sectorial testimony: Josep Paradells

Josep Paradells, professor at the UPC and director of the i2CAT Foundation, talks about the importance of ICTs in the future of the sector, how they will transform the work of professionals in this area and what are the new skills required.

Copy the link | Favoritos

Jornada sectorial: Economia digital - Jordi Arrufí

Les tecnologies digitals ocupen cada vegada més un lloc clau al món professional. Jordi Arrufí, director del Programa Talent Digital del Mobile World Capital Barcelona, explica les noves tendències en l'àmbit de l'economia digital i els perfils més buscats al sector.

Copy the link | Favoritos

Useful links (5 of 10)

ITC: sector's ecosystem

14-02-2024 | | English | Beginner

Formative centres, reference clusters, guilds, colleges, city projects... All of this and much more in this infographic that will allow you to gain a thorough knowledge of the ecosystem

Formative centres, reference clusters, guilds, colleges, city projects... All of this and much more in this infographic that will allow you to gain a thorough knowledge of the ecosystem that forms the ITC sector in the city.

Author: Barcelona Activa
Date of issue: 22-01-2024

https://treball.barcelonactiva.cat/infografies/en/ecosistema/tic.html

Indicadors laborals del Sector TIC a Barcelona 2022

30-05-2023 | | Catalan | Beginner

Pràctica infografia amb les principals dades del Sector TIC a Barcelona 2022. El document està elaborat per el Departament d'Estudis de la Gerència de Política Econòmica i Desenvolupament Local

Pràctica infografia amb les principals dades del Sector TIC a Barcelona 2022. El document està elaborat per el Departament d'Estudis de la Gerència de Política Econòmica i Desenvolupament Local de l'Ajuntament de Barcelona a partir de dades del Departament d'Estadística de l'Ajuntament.

Author: Barcelona Activa
Date of issue: 30-05-2023

https://infogram.com/indicadors-laborals-del-sector-tic-2022-1hd12yx0x3knw6k?live

ITC Sector Infographic: Evolution and tech change

15-02-2023 | | English | Beginner

The ITC has gone through different transformational processes and milestones in recent decades, which have impacted professionals and asked them for new skills and knowledge. Let us explain to

The ITC has gone through different transformational processes and milestones in recent decades, which have impacted professionals and asked them for new skills and knowledge. Let us explain to you what these changes have been and look to the future of the sector.

Author: Barcelona Activa
Date of issue: 15-01-2023

https://treball.barcelonactiva.cat/infografies/en/timeline/itc.html

ITC Sector Infographic: From Training to occupation

18-01-2023 | | English | Beginner

In this infographic you will be able to consult which of the formations will allow you to access the ITC sector, some of the most outstanding jobs and what

In this infographic you will be able to consult which of the formations will allow you to access the ITC sector, some of the most outstanding jobs and what the sector particularly values and demands.

Author: Barcelona Activa
Date of issue: 05-12-2022

https://treball.barcelonactiva.cat/infografies/en/sector/itc.html

Barcelona Digital Centre Tecnològic

30-06-2020 | | Catalan | Advanced

Barcelona Digital Centre Tecnològic (BDigital) és un centre tecnològic avançat especialitzat en l'aplicació de les Tecnologies de la Informació i la Comunicació (TIC) en els camps de la Salut,

Barcelona Digital Centre Tecnològic (BDigital) és un centre tecnològic avançat especialitzat en l'aplicació de les Tecnologies de la Informació i la Comunicació (TIC) en els camps de la Salut, la Seguretat, la Mobilitat i l'energia i l'Alimentació i el Medi Ambient.

http://www.bdigital.org/

See more about this industry

Get to know the industry

ITC Organisations and business

Organisations and business

Organisations and business encompasses a wide variety of activities provided within the company itself or outsourced to other firms and organisations (whether private or public), which seek to facilitate the activities of the company or organisation concerned. This industry includes professionals who are experts in the internal management of organisations and companies, to those specialising in communicating the activities they perform with external customers. As part of both the finance system and the financial management of companies and organisations, the activities performed by this sub-industry enhance the strength of the local economy and the companies and organisations that form part of it. It employs different professional profiles who work in finance departments, at insurance companies, administrative agencies or for auditors, as well as investment and treasury management firms.

Business services

01-2006 | | Catalan | Beginner

Documents (5 of 6)

Sector Overview: Organitzacions and Business

04-2024 | | Catalan | Advanced

This document shows data to have more information about the sector that will help you in your decisions regarding your training-work itinerary. This data is grouped into the following

This document shows data to have more information about the sector that will help you in your decisions regarding your training-work itinerary. This data is grouped into the following sections: in short, digital transformation, strengths of the sector in Barcelona, the most sought-after (professional profiles and skills) and the future of the sector

Author: Barcelona Activa
Publishing date: 04-2024

Open

Sector Report: Organisations and business

12-2023 | | English | Beginner

Sectoral report showing the keys to this economic area as well as the main trends, both consolidated and emerging, in activities and professional profiles and reveals future scenarios.

Author: Barcelona Activa
Publishing date: 12-2023

Open

Focus sectorial: Digital comunication

08-2023 | | English | Advanced

This document focuses on corporate communication in the Internet age as an expanding job market and describes the professional profiles involved in this new type of communication.

Author: Barcelona Activa
Publishing date: 08-2023

Open

Focus sectorial: Talent management

08-2023 | | English | Advanced

Brief report about the new context of talent management for organizations and labor trends which is transforming business culture. It also describes the impact on professional profiles dedicated to

Brief report about the new context of talent management for organizations and labor trends which is transforming business culture. It also describes the impact on professional profiles dedicated to talent management.

Author: Barcelona Activa
Publishing date: 08-2023

Open

Compendium of resources for job search in the Organisations and Business

10-2022 | | English | Beginner

Do you know where to find the offers that may interest you according to the sector in which you are looking for work? We put at your disposal the

Do you know where to find the offers that may interest you according to the sector in which you are looking for work? We put at your disposal the different job search channels in the Organisations and Business sector with all the resources that may be useful to you: employment portals, recruitment companies, company directories, etc. As well as advice to guide your job search in this sector.

Author: Barcelona Activa
Publishing date: 10-2022

Open

Sectorial testimony: Eva Blanco

Eva Blanco, head of institutional relations and communication at HP, tells us which profiles are most in demand in business communication and what skills they should have. She also talks about new professional profiles in this sector and new trends.

Copy the link | Favoritos

Sectorial testimony: Jordi Oliver

Jordi Oliver, general director of Inèdit, talks about the importance of the green and circular economy in the future of this area, how it will transform the work of the professionals involved and what will be the new structures nedeed.

Copy the link | Favoritos

Sectorial testimony: Victor Casanovas

Victor Casanovas, expert in digital strategy and sports at the agency Sevenmila, explains how a sports event is organized and which are the professionals in demand, also highlights the importance of the hybrid model for face-to-face and online events.

Copy the link | Favoritos

Sectorial testimony: Xavier Marcet

Xavier Marcet, Managing Director of Lead to Chance, explains where the consulting sector will evolve due to the impact of AI and how it will transform the work of professionals inside.

Copy the link | Favoritos

Useful links (5 of 13)

Organisations and Business: sector's ecosystem

14-02-2024 | | English | Beginner

Formative centres, reference clusters, guilds, colleges, city projects... All of this and much more in this infographic that will allow you to gain a thorough knowledge of the ecosystem

Formative centres, reference clusters, guilds, colleges, city projects... All of this and much more in this infographic that will allow you to gain a thorough knowledge of the ecosystem that forms the Organisations and business sector in the city.

Author: Barcelona Activa
Date of issue: 22-01-2024

https://treball.barcelonactiva.cat/infografies/en/ecosistema/organisations-and-business.html

Organisations and business Sector Infographic: From Training to occupation

18-01-2023 | | English | Beginner

In this infographic you will be able to consult which of the formations will allow you to access the Organisations and business sector, some of the most outstanding jobs

In this infographic you will be able to consult which of the formations will allow you to access the Organisations and business sector, some of the most outstanding jobs and what the sector particularly values and demands.

Author: Barcelona Activa
Date of issue: 05-12-2022

https://treball.barcelonactiva.cat/infografies/en/sector/organisations-and-business.html

Indicadors laborals de la Indústria 4.0

27-04-2021 | | Catalan | Beginner

Pràctica Infografia amb les dades més rellevants de la Indústria 4.0 a l'àmbit Metropolità de Barcelona, 2019. Elaborat pel Departament d'Estudis de la Gerència de Política Econòmica i Desenvolupament

Pràctica Infografia amb les dades més rellevants de la Indústria 4.0 a l'àmbit Metropolità de Barcelona, 2019. Elaborat pel Departament d'Estudis de la Gerència de Política Econòmica i Desenvolupament Local de l'Ajuntament de Barcelona

Date of issue: 02-10-2019

https://infogram.com/industria-40-2019-1h9j6q11qx7v4gz?live

Asociación Española de Agencias de Comunicación Publicitaria - AEACP

31-12-2020 | | Spanish | Beginner

La Asociación Española de Agencias de Comunicación Publicitaria (AEACP) és una entitat de caràcter professional sense ànim de lucre formada per les principals agències de publicitat espanyoles. Els seus

La Asociación Española de Agencias de Comunicación Publicitaria (AEACP) és una entitat de caràcter professional sense ànim de lucre formada per les principals agències de publicitat espanyoles. Els seus dos objectius principals són: defensar la llibertat d'expressió comercial i els interessos professionals de les agències; i promoure i desenvolupar l'activitat publicitària.

https://creatividadtransformadora.es/

Col·legi de Publicitaris i Relacions Públiques de Catalunya

31-12-2020 | | Catalan | Beginner

El Col·legi de Publicitaris i Relacions Públiques de Catalunya és la institució que agrupa el col·lectiu de professionals que es dediquen a la publicitat, les relacions públiques i a

El Col·legi de Publicitaris i Relacions Públiques de Catalunya és la institució que agrupa el col·lectiu de professionals que es dediquen a la publicitat, les relacions públiques i a la comunicació en general. El Col·legi va ser creat pel Parlament de Catalunya mitjançant la Llei 12/1998 de 5 de novembre. Es regeix per la Llei 13/1982, de 17 de desembre de col·legis professionals de Catalunya i les disposicions que la despleguen, pel dret administratiu i pels seus Estatus inscrits al Re...

https://www.marquetingicomunicacio.cat/

See more about this industry