Comcast Principal Engineer, VIPER Operations in Philadelphia, Pennsylvania
Comcast's Technology & Product organization works at the intersection of media and technology. Our innovative teams are continually developing and delivering products that transform the customer experience. From creating apps like TVGo to new features such as the Talking Guide on the X1 platform, we work every day to make a positive impact through innovation in the pursuit of building amazing products that are enjoyable, easy to use and accessible across all platforms. The team also develops and supports our evolving network architecture, including next-generation consumer systems and technologies, infrastructure and engineering, network integration and management tools, and technical standards.
Are you passionate about digital media, entertainment, and software services? Do you like big challenges and working within a highly motivated team environment? Do you thrive on solving problems that lead to unblocking issues with a service and or technology?
The VIPER Ops team is a growing, fast-moving team of world-class experts who are innovating in end-to-end IP video delivery. We are a team that thrives on big challenges, results, quality, and agility. The team is driving the delivery of many cutting-edge changes to how Comcast delivers IP video to customers.
The DevOps Engineer is the operations engineer that works closely with the development teams on IP Video projects, and is accountable for the overall project technical solution and operation. The Principal role gets involved early in the project lifecycle and continues to support the technical solution beyond successful deployment, ensuring detailed software designs, infrastructure, and operational support meet the project objective.
Who does the DevOps engineer work with?
The Principal is the glue' that brings together operations into the project's technical solution. Throughout the life of the project, the DevOps Engineer will collaboratively work with many project stakeholders, including the project manager, architect, software development leads, infrastructure team, network engineers, system adiministrators and Comcast leadership.
The broader VIPER Ops team is a diverse collection of software engineers, systems administrators, and network administrators from all walks of life.
What are some interesting problems you'll be working on?
In this role, you will bridge many technical gaps during the life of a project. Examples include:
- Design and drive the implementation of an IP Video solution, both for Comcast and for companies external to Comcast.
- Lead troubleshooting efforts to find root causes and corrective actions thoughout the life of a project.
- Create and validate system capacity plans.
- Identify and create advanced application monitoring (Splunk, ELK) for improved reliability.
- Establish automated application deployments to various environments (Kubernetes, Helm).
- Develop scripts and utilities to automate data collection.
- Evaluate new code releases for basic reliability and systems integration support.
- Provide guidance to QA teams who will perform functional and load testing.
- Design technical systems solutions and provide hands-on project support to implement advanced IP video technologies and services.
- Manage the work of DevOps engineers, assign, prioritize and balance project tasks.
- Assist development teams by deploying and configuring components in various environments.
- Troubleshoot and triage services and solutions.
- Design and collaboratively drive delivery of scalable software solutions.
- Development of tools and processes for managing Unix servers.
- Development and execution of load, capacity, longevity and stress testing of systems.
- Development of execution harnesses, systems validation tools and code performance validation tools.
- Testing and certification of code and systems releases from core vendors.
- Foster cross-functional knowledge sharing and mentoring amongst the various engineering teams.
Here are some of the specific technologies we use :
- DevOps Tools: Splunk, Kubernetes, Docker, Sysdig, Prometheus, Git, Helm, Concourse, Jenkins
- Open Source Technologies: Nginx, PostgreSQL, Varnish, Apache Tomcat, HAProxy, Redis, Kafka
- General Knowledge: Linux, MPEG, HTTP Adaptive Streaming, IP Networking, VMWare, OpenStack
Familiarity with the following industry specifications and standards is helpful but not required :
- CableLabs Event Signaling and Management (ESAM)
- CableLabs Event Signaling and Notification Interface (ESNI)
- Society of Cable Telecommunications Engineers (SCTE-35)
- Digital Video Ad Serving Template (VAST)
- CableLabs Encoder Boundary Point (EBP)
Skills & Requirements
- 7 years of hands-on experience in software development and/or DevOps engineering.
- 2 years of experience as a team lead.
- Experience with a variety of Unix/Linux automation and scripting languages such as Python, Bash, Puppet.
- Experience writing core programming languages such as Go, Java or C/ C .
- Strong ability to prioritize, assign, track and shift team resources as needed for multiple projects.
- Strong experience gathering requirements and supporting advanced software development teams in an agile environment.
- Ability to plan, organize and document complex system designs.
- Understanding how to scale applications depending on load.
- Knowledge of networking concepts (VLAN, TCP/IP, Multicast, Unicast, OSI).
- Experience with developing advanced application performance monitoring.
- Ability to navigate Unix operating systems.
- Excellent presentation and communication skills to explain system designs and technologies to senior leadership.
- Strong ability to collaborate with peers and stakeholders around system designs
- High attention to detail and strong ability to problem solve systems issues.
- Experience with CI/CD methodologies.
- Willing to take ownership of problems and independently drive them to resolution.
- Must be able to work independently, be self-motivated and handle multiple priorities.
- Comfortable working in a fast paced agile environment. Requirements change quickly and our team needs to constantly adapt to moving targets.
Comcast is an EOE/Veterans/Disabled/LGBT employer