This course is a comprehensive, practical guide to using MongoDB and Spark in Python, learning how to store and make sense of huge data sets, and performing basic machine learning tasks to make predictions. MongoDB is one of the most powerful non-relational database systems available offering robust scalability and expressive operations that, when combined with Python data analysis libraries and distributed computing, represent a valuable set of tools for the modern data scientist. NoSQL databases require a new way of thinking about data and scalable queries. Once Mongo queries have been mastered, it is necessary to understand how we can leverage this API in Python's rich analysis and visualization ecosystem. This course will cover how to use MongoDB, particularly if you are used to SQL databases, with a focus on scalability to large datasets. pyMongo is introduced as the means to interact with a MongoDB database from within Python code and the data structures used to do so are explored. MongoDB uniquely allows for complex operations and aggregations to be run within the query itself and we will cover how to use these operators. While MongoDB itself is built for easy scalability across many nodes as datasets grow, Python is not. Therefore, we cover how we can use Spark with MongoDB to handle more complex machine learning techniques for extremely large datasets. This learning will be applied to several examples of real-world datasets and analyses that can form the basis of your own pipelines, allowing you to quickly get up-and-running with a powerful data science toolkit. Style and Approach: An exhaustive course that carefully covers the fundamental concepts of unstructured data and distributed programming before applying them to examples of typical data science workflows. This course is divided into clear chunks, so you can learn at your own pace and focus on your own area of interest.
Target Audience
A one-stop course for data engineers, data scientists, and developers who have a working knowledge of Python and need to know how to efficiently ingest, query, and analyze data using MongoDB and Spark. By the end of the course, you will be able to combine MongoDB and Spark into your own Python data workflows.
Business Outcomes
- A comprehensive introduction to the key concepts of MongoDB and Spark.
- Intuitive examples of key operations in MongoDB and Spark using Python APIs
- Two working examples of realistic end-to-end data analyses using real world datasets
