Overview
As a Data Engineer at JPMorgan Chase within the Cybersecurity and Technology Controls, you'll leverage your skills to develop and implement robust data solutions using cutting-edge technologies. You'll play a critical role in analyzing complex data structures, ensuring data accuracy, and enhancing our security analytics capabilities. Collaborate with cross-functional teams to drive innovation, implement scalable solutions, and protect our digital assets. Your contributions will be pivotal in shaping the future of cybersecurity, fostering a culture of excellence, and ensuring the integrity and security of our data infrastructure.
Responsibilities
* Design and implement complex, scalable solutions to efficiently process large volumes of data, ensuring consistent and timely delivery and availability.
* Troubleshoot and resolve complex issues related to data architecture, including data ingestion, indexing, and search performance.
* Create reusable frameworks with a strong emphasis on quality and long-term sustainability.
* Collaborate with key partners to enhance understanding of data usage within the business.
* Serve as a subject matter expert on the content and application of data in the product and related business areas.
* Integrate data from multiple sources, including structured, semi-structured, and unstructured data.
* Implement data quality checks and validation processes to ensure the accuracy, completeness, and consistency of the data.
* Analyze complex data structures from various security data sources and scale data engineering pipelines.
* Perform all Data Engineering activities, including ELT project development, testing, and deployment.
* Document data engineering processes, workflows, and systems for reference and knowledge-sharing purposes.
* Contribute to a team culture of diversity, opportunity, inclusion, and respect.
* Demonstrate formal training or certification on SQL concepts and proficient applied experience.
* Be proficient in database management, with experience in both relational databases (SQL) and NoSQL databases.
* Remain proficient with Python and SQL.
* Possess expertise in Python and Java development.
* Have extensive experience with Big Data technologies, including Spark, Hive, Redshift, Kafka, and others.
* Apply strong understanding of ETL/ELT frameworks and tools, including DBT, Apache Airflow, Trino, Kestra, or similar technologies.
* Demonstrate hands-on experience in data pipelines and ETL/ELT processes using Python and SQL.
* Experience with Kafka data streaming or other streaming/messaging services like Kinesis, SNS, SQS.
* Develop, debug, and tune complex SQL statements.
* Work on real-time and streaming applications.
* Maintain an exceptional understanding of distributed systems and cloud platforms.
* Work with data streaming platforms such as Apache Flink and Apache Kafka.
* Transform data to enhance quality and usability.
* Understand the Software Development Life Cycle and apply agile methodologies, including CI/CD, application resiliency, and security best practices.
Preferred Qualifications, Capabilities, and Skills
* Relevant industry experience, preferably in a data engineering role focused on threat detection and security analytics.
* Experience with advanced data streaming and transformation tools.
* Experience with Kubernetes for container orchestration is a plus.
* Experience onboarding datasets to Splunk, ensuring CIM compliance.
* Be a team player and work collaboratively with team members.
About J.P. Morgan
J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy individuals and institutional investors. Our first-class business in a first-class way approach to serving clients drives everything we do. We strive to build trusted, long-term partnerships to help our clients achieve their business objectives. Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we're setting our businesses, clients, customers and employees up for success.
#J-18808-Ljbffr