Unstructured data is expected to grow 10x by 2030, and many organizations are already struggling to manage this elephant in their data center or clouds.
I recorded on 2024-07-15 20:30 UTC that over 90%+ of organizational data will remain unstructured as sensor integration continues to grow.
The exact statement: "90%+ of the data collected by organizations will continue to be unstructured as more and more sensors are getting integrated in our daily lives."
I recently tracked the Data Lake market and found it was valued at USD 15.2 billion in 2023, with a projected CAGR > 20.5 % through 2032. This growth is driven by the rising importance of advanced analytics and the need to manage both structured and unstructured data, the latter now comprising > 90 % of total data volume.
Market base: USD 15.2 billion (2023).
Projected CAGR: > 20.5 % (2024‑2032).
Unstructured data share: > 90 % of total data volume.
Based on this outlook I decided to invest in Data Lakes as a central repository, but I also prioritize GPU‑accelerated pipelines and human‑in‑the‑loop annotation workflows to meet the multimodal GenAI demands.
I observed that the barrier to processing unstructured visual data such as images and videos is dropping, accelerating adoption and creating a growing need for robust data‑engineering systems tailored to visual workloads.
Andrew Ng highlighted this trend at a recent #BUILD2024 keynote, emphasizing the importance of tools that empower teams to monetize and derive value from visual data efficiently.