Title: Big Data/Machine Learning Engineer Sr
Duration: 12 months (15th May 2025) Can beextended
Location : McLean VA or Richmond VA (2 daysweek)
Interview : 2 Technical RoundInterview for sure .
LOB:EDML Data and Machine LearningData Space EDT
Project:
* Application isdoing large Volume Data transformation with in AWS.
* SDKs were developed in Scala / Spark
* Lambda were based on python.
* SQL isfor Data Transformation and Scripting
* BehavePython Automation
* 80% of work is of DataEngineering and 20% of work is Automation.
AWS
* Glue running the sparkapplications
* S3where the data movesthrough
* Lambda executed by the stepfunctions
* Step Functions fororchestrations
* Fargate/ECS elastic serverwhere the APIs are hosted.
MustHaves:
* Data Engineer
* Scala
* Python
* Data Processing using Spark framework
* AWS (Glue / Step functions / Lambda / fargate )**Must
* SQL
* AutomationTesting (Behave for Python and Scala for anything else)