Lead Site Reliability Engineer (Lead SRE) Ready to keep things running smoothly? Join our tombola team! ? ?At tombola, we pride ourselves on building our own exceptional games and platforms in-house. That means keeping everything running flawlessly is paramount! We're seeking a Lea d Site Reliability Engineer (SRE ) to join us and help ensure our critical systems and services are always reliable, available, and performing at their best. What will you be doing? As an SRE, you'll be instrumental in implementing automation, monitoring, and incident response strategies to minimize downtime and optimize our operations. You'll collaborate closely with our development, infrastructure, and security teams, balancing exciting new feature delivery with rock-solid system stability. Key Accountabilities and Responsibilities: Team Leadership and Developm ent Providing leadership, management, and development for direct reports through effective 1-to-1s, objective setting (OKRs), and performance management. Making team goals clear and ensuring they align with our broader business objectives. Collaborating with other teams and departments to achieve shared success. Partnering with our People Partner for tech to build robust team management practices. System Reliability and Availability Ensure system uptime: Monitor and maintain the availability and reliability of critical systems and services, meeting all uptime SLAs (Service Level Agreemen ts). Incident management: Quickly respond to incidents, investigate root causes, and ensure effective postmortems and continuous improvement processes are in place. Failure detection and response: Proactively identify potential failures or performance bottlenecks before they impact users, and respond to failures and outages effectively. Monitoring and Alerting Implement monitoring systems: Set up and maintain robust monitoring systems (e.g., Dynatrace) for application performance, infrastructure health, and system metrics. Alerting: Create and manage alerting systems to notify us about issues or potential risks in a timely manner, minimizing impact on our players. Metrics collecti on: Define and track key metrics (e.g., uptime, latency, request rates) to measure system health and performance. Incident Response Incident resoluti on: Work quickly to resolve incidents, minimize downtime, and restore service as fast as possible. Post-incident analys is: After resolving incidents, perform root cause analysis (RCS), including a post-incident review, and document findings to prevent similar issues in the future. Automation and Efficiency Automate manual tas ks: Automate repetitive operational tasks to boost efficiency, reduce human errors, and accelerate delivery. Infrastructure automati on: Utili se Terraform, Git, and TeamC ity to automate infrastructure provisioning and configuration management. Deployment pipelin es: Help develop and maintain automated deployment pipelines (e.g., CI/CD) to streamline releases and reduce manual intervention. Capacity Planning and Scaling Plan for scalabili ty: Ensure our systems can scale efficiently to meet demand, both horizontally (adding more servers) and vertically (increasing server resources). Optimize resource usa ge: Monitor and optimize resource usage (CPU, memory, storage) to ensure the infrastructure handles increasing loads without waste. Forecasting and capacity planni ng: Analyze usage trends and plan for future capacity needs to ensure systems remain reliable and perform under varying workload Performance Optimization:Performance tun ing: Continuously analyze system performance and make optimizations (e.g., tuning databases, improving response times, optimizing caching). Load testing and stress testi ng: Conduct load and stress tests to ensure systems can handle high traffic and performance demands without failure. Infrastructure Management:Cloud infrastructure managemen t: Manage AWS cloud resources and ensure proper scaling, cost optimization, resilience and environment consistency. Disaster recovery plannin g: Develop and maintain disaster recovery strategies to ensure quick recovery in case of catastrophic failure Collaboration with Development Teams:Work with development team s: Collaborate with development teams to ensure that new features and applications are designed with reliability, scalability, and operational needs in mind. Service ownersh ip: Promote a culture of service ownership where developers are involved in operational aspects, ensuring they are accountable for the operational success of their services. Performance and reliability feedbac k: Provide feedback to developers about performance and reliability issues encountered in production and recommend improvements. Security and Compliance:Security best practices: Implement security practices within the infrastructure and application lifecycle to minimize security vulnerabilities. Compliance and auditin g: Ensure systems are compliant with industry standards, regulations, and internal security policies. Access control and monitori ng: Ensure proper access control mechanisms are in place to protect production environments. Documentation:Documentation of processe s: Create and maintain detailed documentation for all infrastructure components, incident response procedures, and runbooks to ensure efficient operations. Continuous Improvement:Iterative improvements: Continuously evaluate and improve system reliability, performance, and efficiency, seeking new technologies or approaches to enhance operational effectiveness.