BIG DATA CONCEPTS AND APPLICATIONS
- Course
- DASC336 - BIG DATA CONCEPTS AND APPLICATIONS
- Department
- Data Science - English - Undergraduate
- Course Type
- Course
- Status
- Required
- Language
- English
- Credit
- 3
- ECTS
- 7
- T+P+L
- 3 + 0 + 0
- Course Coordinator(s)
- -
- Prerequisite
- -
- Keywords
Course Description
This course covers big data, which becomes increasingly available with digitalization of many aspects of human life and with increasingly growth of social media platforms. The course presents a broad understanding of big data and different approaches of big data manipulation. Students will explore how terabytes and petabytes of storage space can be occupied by big data. In this course, the Hadoop software, the Hadoop Distributed File System (HDFS) and the MapReduce technique as well as supervised and unsupervised machine-learning approaches are introduced and artificial neural networks are thoroughly investigated. By completion of the course, students are expected to be able to harvest big data sets from the internet and process by using different methods and tools.
BIG DATA CONCEPTS AND APPLICATIONS
Evaluation Tools (Active Term)
No evaluation items have been defined.
Course outcomes
No course outcomes have been defined yet.
Course Syllabus
| Week | Topic |
|---|---|
| Week 1 | Introduction |
| Week 2 | Hadoop and HDFS |
| Week 3 | HBase |
| Week 4 | MapReduce and YARN |
| Week 5 | Spark I |
| Week 6 | Spark II |
| Week 7 | Machine Learning and MLib |
| Week 8 | Classification and Regression Algorithms I |
| Week 9 | Classification and Regression Algorithms II |
| Week 10 | Midterm(s) |
| Week 11 | Unsupervised Learning Algorithms |
| Week 12 | Recommender Systems & Collaborative Filtering |
| Week 13 | Spark Streaming |
| Week 14 | Data Visualization |
| Week 15 | Final |
Reference Books & Course Materials
- 01 Kamal, R., & Saxena, P. (2019). Big Data Analytics: Introduction to Hadoop, Spark, and Machine Learning (1st ed.). McGraw-Hill Education.
Learning Outcomes
- L01 Explain the fundamental concepts, characteristics, and challenges of big data in real-world contexts. SOLO 4
- L02 Describe the architecture and functions of big data ecosystem components, including Hadoop, HDFS, HBase, MapReduce, and YARN. SOLO 3
- L03 Apply distributed computing methods to store, manage, and process large-scale structured and unstructured datasets. SOLO 3.5
- L04 Implement data processing and analytics tasks using Spark and related big data tools. SOLO 4
- L05 Analyze big data problems and select appropriate machine learning approaches, including classification, regression, and unsupervised learning techniques. SOLO 3.5
- L06 Evaluate the suitability and scalability of different big data technologies for business and real-life applications. SOLO 5
- L07 Visualize analytical results effectively for technical and non-technical audiences. SOLO 5
- L08 Develop a data-driven solution by harvesting, processing, and interpreting large datasets while considering ethical, privacy, security, and data ownership issues. SOLO 5
Program Outcomes
- P01 Apply data science principles and techniques to challenges in real life situations, and effectively communicate their solutions.
- P02 Identify and implement data analysis methodologies based on theoretical ideas, ethical code, and in-depth knowledge of the underlying data.
- P03 Analyze the guiding concepts and assessment procedures for information analysis in real-life applications.
- P04 Design and apply relevant data analysis models to find obscure solutions to business-related problems.
- P05 Utilize modern computing techniques to handle real-world problems characterized by massive amounts of data, such as parallel and distributed computing and machine learning.
- P06 Configure and administer the software tools required to efficiently produce usable information from any size of structured and unstructured datasets.
- P07 Administer or manage data science tools and techniques to organize and complete projects aimed at gaining useful insight from complex data.
- P08 Think critically and imaginatively, conceiving real-world issues from several angles, and work well in a variety of teams to solve issues cooperatively.
- P09 Be able to effectively integrate data‐based solutions into the user environment and help non-technical professionals in exploring, visualizing, and using these solutions
- P10 Understand their obligations under professional and ethical standards in relation to matters like data ownership and citation, data security and sensitivity and the privacy implications of data analysis.
Po-Lo Matrix
| LO | P01 | P02 | P03 | P04 | P05 | P06 | P07 | P08 | P09 | P10 | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|
| L01 | 2 | 2 | 3 | 1 | 3 | 1 | 1 | 2 | 0 | 0 | 1.5 |
| L02 | 2 | 2 | 3 | 1 | 4 | 3 | 2 | 1 | 1 | 0 | 1.9 |
| L03 | 3 | 4 | 2 | 2 | 5 | 4 | 3 | 1 | 2 | 0 | 2.6 |
| L04 | - | - | - | - | - | - | - | - | - | - | - |
| L05 | 3 | 4 | 4 | 4 | 4 | 3 | 3 | 3 | 2 | 1 | 3.1 |
| L06 | 3 | 3 | 4 | 3 | 4 | 3 | 3 | 3 | 2 | 0 | 2.8 |
| L07 | 4 | 2 | 2 | 1 | 1 | 2 | 2 | 2 | 5 | 0 | 2.1 |
| L08 | 4 | 4 | 3 | 4 | 4 | 3 | 3 | 3 | 3 | 5 | 3.6 |