3 links
tagged with all of: data-engineering + data-modeling
Click any tag below to further narrow down your results
Links
Real-time analytics solutions enable querying vast datasets, such as weather records, with rapid response times. The article outlines how to effectively model data in ClickHouse for optimized real-time analytics, covering techniques from ingestion to advanced strategies like materialized views and denormalization, while emphasizing the importance of efficient data flow and trade-offs between data freshness and accuracy.
The author critiques the Medallion Architecture promoted by Databricks, arguing that it is merely marketing jargon that confuses data modeling concepts. They believe it misleads new data engineers and pushes unnecessary complexity, advocating instead for traditional data modeling practices that have proven effective over decades.
Data modeling is considered "dead" by the author due to the shift in focus towards modern data architectures like Data Lakes and Lake Houses, which prioritize flexibility over traditional modeling techniques. The article criticizes the lack of clarity and guidance in contemporary data modeling practices, contrasting it with the structured approaches of the past, particularly those advocated by Kimball. The author expresses a longing for a definitive framework or authority to restore the importance of data modeling in the industry.