Required / Desired Amount Experience Understanding the Big data technologies Required 5 Years Experience developing ETL and ELT pipelines Required 5 Years Experience with Spark, GraphDB, Azure Databricks Required 5 Years Experience training LLMs with structured and unstructured data sets Required 4 Years Experience in Data Partitioning and Data conflation Required 3 Years Experience with GIS spatial data Required 3 Years. Experience with Azure services including Blob Storage, Data Lakes, Databricks, Azure Machine Learning, Azure Computer Vision, Azure Video Indexer, Azure OpenAI, Azure Media Services, and Azure AI Search.