FOSS4G NA 2024 - Searching the Spatial Data Lake: Bring GeoParquet to Apache Lucene - Wes Richardet

Wes Richardet’s talk at FOSS4G NA 2024 focuses on improving search capabilities within spatial data lakes using GeoParquet and Apache Lucene. He discusses the evolution of data storage, the need for efficient search solutions, and the integration of different technologies to enhance performance.

Highlights

🌍 Wes Richardet emphasizes the importance of searching in spatial data lakes.

🔍 Apache Lucene serves as the foundational technology for various search engines.

📈 The rise of big data led to challenges in efficient data retrieval and storage.

🛠️ New extensions for PostgreSQL and other databases enhance search capabilities.

⚙️ Lucene’s inverted index improves search performance by allowing efficient document retrieval.

📊 GeoParquet offers a hybrid storage solution that balances row and columnar access patterns.

💡 Richardet advocates for leaving data in its original storage to reduce redundancy.

For more content like this check out www.projectgeospatial.com

#SpatialData #GeoParquet #ApacheLucene #BigData #FOSS4G #DataStorage #SearchOptimization