Big data engineering fundamentals
Data projects need a clear view of flows and responsibilities. Explore big data architectures, processing stages and the roles that make them work. Develop reference points for understanding technical constraints and contributing to better-coordinated projects.
- Duration
- 3 days 21 hours
- Code
- FC-BDE Code
Presentation
A big data engineer works alongside data scientists and is responsible for designing IT architectures and developing software used to store large volumes of data. Their main objective is to establish a data processing system and ensure data is used effectively. Data engineers also create databases suited to the business and carry out regular tests to ensure they remain usable. They are also responsible for correctly implementing complex data analysis algorithms.
This Level 1 programme provides data engineering fundamentals, introducing big data methodologies and challenges. You will learn to select the most suitable approach to structuring a data architecture and the technical solutions for implementing it in a given situation.
By the end of this 3-day course, you will have the skills and knowledge needed to understand big data engineering. Practical exercises teach you to use appropriate tools and methods to build an effective data model.
Objectives
By the end of the big data engineering course, you will be able to:
- understand what big data is and how it emerged;
- use appropriate data tools and infrastructure for a given situation;
- understand how to create a powerful data model for a critical use case.
Program
Big data overview
- The history of big data and its technologies.
- Key aspects of big data challenges.
- Introduction to a challenging practical case.
- Introduction to the Hadoop framework for big data processing.
- Introduction to MapReduce for optimising Hadoop processing.
Design a big data model
- Characteristics of different big data storage solutions.
- Create data infrastructure and design a data system.
- Create the data model.
Apply systems engineering to big data challenges
- Architectural challenges associated with large volumes of data.
- Big data solutions when implementing a systems architecture.
Audience
This course is intended for:
- data scientists wishing to specialise in big data;
- support teams responsible for data management and research and development teams;
- IT managers wishing to specialise in data;
- anyone considering a career change into big data and artificial intelligence technologies.
Prerequisites
The big data engineering course requires:
- knowledge of and practical ability in a programming language.
Teaching and assessment methods
- Initial skills assessment
- Training materials provided to participants
- Continuous assessment throughout the course
- End-of-course feedback questionnaire
- Combination of theory and practical application
- Attendance records
- Post-course follow-up evaluation
- Practical exercises
- Case study
Course highlights
Dates and sessions
Choose the date and delivery format that suit you.
No upcoming sessions are currently available.
fr
en