Click any tag below to further narrow down your results
Links
Netflix engineers presented a centralized platform for managing data deletion across various storage systems while ensuring durability, availability, and correctness. The platform has successfully deleted 76.8 billion rows without data loss, addressing challenges like data resurrection and resource spikes during deletion. Key recommendations emphasize the importance of rigorous validation and centralized monitoring.
Data engineers play a crucial role in achieving GDPR compliance by implementing systems that manage personal data responsibly. This guide outlines key concepts such as encryption, hashing, and anonymization, as well as best practices for designing data architectures that ensure privacy and security. It also covers practical considerations for incident response and interview preparation related to GDPR.