Job Information
Amazon Sr Data Engineer, Enterprise Engineering in Arlington, Virginia
Description
AppSense team is seeking an experienced Senior Data Engineer to elevate our data maturity and build the foundation for advanced analytics and machine learning capabilities. As a key member of our team, you will design and implement scalable data solutions that drive insights across our software management platform. This role is critical in transforming how we handle data, moving from basic data management to sophisticated, efficient data systems that can handle terabytes of information while delivering gigabyte-scale insights for specific use cases.
Key job responsibilities
• Lead data modeling efforts to mature our data architecture, ensuring it can support current needs and future analytics and ML/AI initiatives
• Design, build, and maintain efficient and reliable data pipelines to process large volumes of software usage and licensing data
• Develop strategies to scale our data infrastructure horizontally and vertically, optimizing for performance and cost-efficiency
• Collaborate with cross-functional teams to understand data requirements and implement solutions that meet both technical and business needs
• Implement data quality measures and monitoring systems to ensure the reliability and accuracy of our data assets
• Optimize data storage and retrieval systems to improve query performance, particularly for finance-related use cases
• Mentor team members on data engineering best practices and emerging technologies
• Evaluate and implement new data tools and technologies to continuously improve our data infrastructure
A day in the life
Your day might begin by reviewing the performance metrics of our existing data pipelines, identifying bottlenecks in processing the previous day's software usage data. You then spend time refining a data model that will allow for more efficient storage and retrieval of license allocation data across multiple software vendors.
In the afternoon, you could be collaborating with the finance team to understand their reporting requirements, designing a solution that reduces a complex TB-scale dataset to a GB-scale summary without losing critical insights. This involves leveraging your expertise in data partitioning and aggregation techniques.
Later, you might lead a technical discussion with the team about implementing a new columnar storage solution to improve query performance for our most frequently accessed data. You'll need to balance the technical benefits with the effort required for migration and maintenance.
You end your day by mentoring a junior engineer, walking them through the design of a new data pipeline that will ingest and process data from a recently integrated software application.
About the team
Our AppSense team is on a mission to revolutionize software management through data-driven insights. We're at an exciting juncture where we're transitioning from basic data handling to building a robust, scalable data infrastructure that will power the next generation of software management tools.
We value innovation and are not afraid to challenge the status quo. Our work has a direct impact on the company's bottom line, influencing decisions on software investments worth millions of dollars. We're looking for someone who can bring industry best practices to our team while also being adaptable to our unique challenges.
We're a collaborative group that believes in continuous learning. You'll have the opportunity to work with cutting-edge technologies and shape the data strategy for a product used across a large enterprise.
Basic Qualifications
5+ years of data engineering experience
Experience with data modeling, warehousing and building ETL pipelines
Experience with SQL
Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
Experience mentoring team members on best practices
Preferred Qualifications
Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
Experience operating large data warehouses
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $139,100/year in our lowest geographic market up to $240,500/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.