Data Engineer — Markets & AI Data Platform
Macro Hive (BGC Group) is a leading independent provider of global macro strategy. We combine best-in-class human and artificial intelligence to provide institutional investors with market-leading investment opportunities
Our experts leverage large language models, such as those that power chatbots like ChatGPT, to develop innovative, data-driven solutions to complex financial problems and to build state-of-the-art models in search of alpha signals across asset classes
Mission:
Build the data backbone for AI, quant models and client tools.
Owns:
* Market, economic, research, news, internal and Fenics/BGC data pipelines
* Bronze/silver/gold data architecture
* Data quality gates
* Instrument, ticker, country, client, source and theme metadata
* APIs/tables for agents, dashboards and quant models
* Data lineage, entitlements, permissions and monitoring
Must have:
* Strong Python and SQL
* Production ETL/ELT experience
* Cloud data stack: Azure, Databricks, Delta Lake, Snowflake or similar
* Time-series or complex-data experience
* Data quality, monitoring and audit awareness
* Ability to turn messy data into clean model-ready datasets
Nice to have
* Experience with ticker level data using for example kdb+