Click any tag below to further narrow down your results
Links
This article discusses how Git-like workflows can improve data deployment and management. It highlights the challenges of handling data pipelines and the need for versioning and rollback capabilities in data engineering. The author also introduces tools like LakeFS and Tigris that aim to integrate Git principles into data workflows.
Altrina is a platform designed to automate standard operating procedures by connecting various data sources and workflows. Users can describe tasks in simple terms, enabling the platform to build and run workflows efficiently. It offers reliable performance and visibility for both small and large-scale tasks.
The WIN Partner Index provides data on how organizations use cloud security integrations, highlighting which tools are most effective in real-world applications. It shows trends in adoption and impact across various workflows, emphasizing the importance of collaborative, embedded security in modern cloud environments.
The article explores the integration of artificial intelligence and data in production environments, highlighting key insights and best practices for optimizing data workflows and leveraging AI technologies effectively. It discusses the challenges and opportunities that arise when implementing AI solutions within data engineering processes.
The article discusses the misconception that dbt (data build tool) is purely declarative, highlighting its operational characteristics and the need for understanding its underlying mechanics. It emphasizes dbt's functionality beyond simple data transformation, showcasing its interactive nature in data workflows. The piece encourages readers to rethink their approach to using dbt effectively.
GitHub Actions can significantly streamline data workflow automation by utilizing four distinct levels of capabilities. Each level offers varying degrees of complexity and functionality, catering to different automation needs from simple triggers to advanced custom workflows. Understanding these levels helps users effectively implement automation strategies tailored to their projects.