The Ab Initio Senior Data Engineer(SC clearance) is responsible for designing, developing, and implementing robust and scalable data integration solutions across cloud platforms, including GCP and AWS. The successful candidate will be a key member of a strategic program, a critical initiative focused on transforming upstream data into report-ready outputs.
This role is a core part of the Engineering team, with a focus on building and maintaining the organization's critical data pipelines using the Ab Initio platform, along with cloud-native services in GCP and AWS. The overall objective is to contribute to high-quality data systems analysis and programming activities that support strategic reporting and data objectives.
Must Have:
* 10+ years ETL Design & development of Ab Initio based Data Integration solutions across large scale enterprise environments
* Strong hands-on expertise in Ab Initio (GDE, Co>Operating System, EME, Metadata Hub, QE)
* Advanced SQL expertise with Oracle and SQL servers
* Knowledge of scheduling tools, CI/CD pipelines, and DevOps practices
* Unix/Linux + shell scripting experience (5+ years)
* Experience in data systems analysis & large-scale data transformation
* Strong understanding of data modeling & ETL best practices
* Excellent analytical and problem-solving skills
* Active SC clearance
* Experience with cloud platforms (AWS, GCP ana Azure)
Roles & Responsibilities
The role is responsible for Design and developing data and ETL solutions, implementing best practices for data movement, data quality, data cleansing, and other ETL-related activities.
* Design and develop scalable, high-performance ETL solutions using Ab Initio (GDE, Co>Operating System, EME) to support telecom reporting and downstream data platforms.
* Build and optimize complex Ab Initio graphs leveraging data, pipeline, and component parallelism to process large-scale telecom datasets (CDRs, billing, usage, and customer data).
* Perform data profiling, cleansing, and quality validation to ensure accuracy and consistency for regulatory and business reporting.
* Translate telecom business requirements into technical ETL specifications, supporting revenue assurance, customer analytics, and operational KPI reporting.
* Develop and optimize complex SQL queries and implement relational and dimensional data models to enhance reporting and analytics.
* Utilize Enterprise Meta Environment (EME) for version control, metadata management, and dependency analysis, ensuring compliance with enterprise standards.
* Create and maintain Unix/Linux shell scripts for automation, scheduling, and file handling within ETL workflows.
* Integrate ETL processes with scheduling tools to ensure timely and reliable data delivery to reporting systems.
* Provide production support by troubleshooting ETL failures, resolving data issues, and performing performance tuning to meet SLAs.
* Conduct code and design reviews to ensure adherence to best practices in ETL development, data governance, and system performance.
* Collaborate with data architects, business analysts, and reporting teams to deliver solutions aligned with enterprise data strategy and telecom requirements.
* Implement data governance, compliance, and risk controls to ensure secure handling of sensitive telecom and financial data.
* Mentor junior team members and contribute to knowledge sharing and continuous improvement initiatives.
* Respond to critical production issues promptly, ensuring minimal disruption to business reporting.