Implementing Dataops: A Scalable Framework for Modern Data Warehousing
-д хадгалсан:
| -д хэвлэсэн: | ProQuest Dissertations and Theses (2025) |
|---|---|
| Үндсэн зохиолч: | |
| Хэвлэсэн: |
ProQuest Dissertations & Theses
|
| Нөхцлүүд: | |
| Онлайн хандалт: | Citation/Abstract Full Text - PDF |
| Шошгууд: |
Шошго байхгүй, Энэхүү баримтыг шошголох эхний хүн болох!
|
MARC
| LEADER | 00000nab a2200000uu 4500 | ||
|---|---|---|---|
| 001 | 3280514504 | ||
| 003 | UK-CbPIL | ||
| 020 | |a 9798265474971 | ||
| 035 | |a 3280514504 | ||
| 045 | 2 | |b d20250101 |b d20251231 | |
| 084 | |a 66569 |2 nlm | ||
| 100 | 1 | |a Valiaiev, Dmytro | |
| 245 | 1 | |a Implementing Dataops: A Scalable Framework for Modern Data Warehousing | |
| 260 | |b ProQuest Dissertations & Theses |c 2025 | ||
| 513 | |a Dissertation/Thesis | ||
| 520 | 3 | |a DataOps has been coined as a novel term that emerged as a synthesis of data management practices with software engineering concepts, such as DevOps and Agile, with the goal of improving data quality and governance in enterprises. The proliferation of scratch table use and transformation tools, such as dbt, has led to an exponential increase in the number of data models, which complicates standardization efforts and increases maintenance overhead. Although the market is saturated with various flavors of text-to-SQL engines that promote increased productivity and self-service use in organizations, there are limited tools available to optimize individual queries, enforce consistency, or enhance data observability within the existing ecosystem. The many flavors of SQL, the de facto lingua franca of data processing, add even more complexity, as the code cannot be handled as easily as in less ambiguous languages like Python or Java, which have out-of-the-box linting and refactoring tools available. This study examines the impact of DataOps on modern enterprises, providing a programmatic solution that streamlines data operations through automated code review. The proposed framework introduces centralized SQL governance, embedded validation workflows, and observability features that promote collaboration and reduce redundancy. It leverages Python-based modular checks and a CI/CD pipeline to enforce validation in accordance with organizational standards. This research aims to bridge existing gaps and provide a scalable framework for effective DataOps implementation in modern data warehouse environments. | |
| 653 | |a Information science | ||
| 653 | |a Computer engineering | ||
| 653 | |a Computer science | ||
| 773 | 0 | |t ProQuest Dissertations and Theses |g (2025) | |
| 786 | 0 | |d ProQuest |t ProQuest Dissertations & Theses Global | |
| 856 | 4 | 1 | |3 Citation/Abstract |u https://www.proquest.com/docview/3280514504/abstract/embedded/6A8EOT78XXH2IG52?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text - PDF |u https://www.proquest.com/docview/3280514504/fulltextPDF/embedded/6A8EOT78XXH2IG52?source=fedsrch |