Principal Data Engineer

New Yesterday

Join to apply for the Principal Data Engineer role at SmartSense by Digi Join to apply for the Principal Data Engineer role at SmartSense by Digi As a Principal Data Engineer, you will architect and lead the development of scalable, secure, and high-performance data infrastructure that powers our IoT platform. You will be instrumental in shaping our containerized data services, driving automation through CI/CD pipelines, and ensuring data quality and reliability across real-time and batch processing systems. This is a hands-on leadership role with significant influence on our technical direction and data strategy.Data Services team members are passionate about data products, engineering data flows, storage, and enabling predictive analytics. We are inspired by data products and data services and in building and delivering tools, infrastructure, frameworks that enable insights of our business increasing the value of our data to our customers. As good stewards of our data we contribute to all aspects related to the handling of data, whether from monitoring data flows, our field sensors, PII (Personally Identifiable Information), or reflecting internal processes such as our supply chain. What We Offer In this Principal Data Engineer role, you will contribute to strategic data engineering solutions moving data from raw to cold storage, through ETL (Extract, Transform, Load) pipelines, to data sets used to train ML (Machine Learning) models. You will collaborate with our Data Science, Business Analysts and Machine Learning Engineers producing quality data flows, transformations, and cleansing towards improved data products for the customer. You will facilitate the democratization of data for data scientists to experiment and train machine learning models and business analysts supporting the enterprise. You will have an enthusiasm and drive to deliver data products that exceed expectations, a passion for data engineering and bring an eagerness to learn. This is an exciting opportunity for an engineer ready to bring this enterprise forward on our data maturity path towards predictive analytics. Join us on our data journey. What You Will Do Join a tightly knit team solving hard problems the right way Understand the various sensors and environments critical to our customers’ success Know the data flows and technology that are currently in use to transform raw data into analytic products Build relationships with the awesome team members across other functional groups Learn our code practice, work in our code base, write tests, and collaborate with us in our workflows Contribute to on-boarding processes and make recommendations to make on-boarding process better Demonstrate your capabilities defining solutions, implementing, and delivering data products for your user stories and tasks Contributing to systems and processes to implement and automate quality on data pipeline deliverables Implement data tests for quality and focuses on improving inefficient tooling and adopting new transformative technologies while maintaining operational continuity. Contribute to the quality of data and the pipeline after working closely with the product team and stakeholders to understand how our products are used Identify opportunities to improve our infrastructure, operational performance, and data pipeline deliverables Evaluate new technologies and build proof-of-concept systems to enhance Data Engineering capabilities and data products Contribute to improving the efficiency of our pipeline scripts, automation, and general data operations Demonstrate command and accountability for the design and implementation of new features Develop and support data operations and efficiencies in production Demonstrate competencies in data modeling new and existing capabilities while progressing the maturity of our data Influence your peers through your excellence in delivering high quality data products and code reviews Deliver operational data from the data platform to software and analytic teams producing aggregate metrics from real time data streams Establish a reputation for reliability in data contextualization and troubleshooting with the team Improve the velocity of development of data ingestion, orchestration, fusion, transformation, and data analysis. Deliver infrastructure required for optimal extraction, transformation, and data loading in predictive analytic contexts Transform ETL development with optimizations for efficient storage, retention policies, access, and computation while accounting for cost Contributing to the strategic maturity of all our operations and delivery of product requests Define orchestrations of data transformations that distill information to highly valuable signals for ML models Collaborate with your teammates to deliver a data analytics and AI platform for advanced analytic data product development Who You Are and What You Bring BA/BS degree in a technical/quantitative field, 10+ years of experience working in Data Engineering. Proven SQL and Python skills. Ability to work independently, solve problems, and learn quickly as part of a larger agile team Experience delivering and articulating data models to support enterprise and data product needs. Experience in the design and delivery of at least three Data Engineering areas (Data Pipelines/ETL, Relational and Non-Relational Databases, Data Warehousing, Data Lake, Business Intelligence Platforms) Able to demonstrate coding practice (comments, style, consistency, efficiency, reuse, etc.) and have experienced applying them in code reviews. Must have experience with managed services in AWS, Azure or GCP (Google Cloud Platform) Must have experience validating data quality, preferably with test automation (pytest, DBT, Flyway, etc.) End to End (E2E) testing experience Experienced with Automated Kubernetes Deployment Desired But Not Required Proven experience building data pipelines with orchestration tools such as Luigi or AirFlow. Experience with data governance, PII, and data access paradigms. Proven experience in handling time series telemetry data. Practical experience with slowly changing dimension implementations Experience with Snowflake or other Cloud Data Platform and or Lakehouse architecture. Experience operating and monitoring production data pipelines. Automated deployment with data pipelines and data models with Helm-Argo CD. E2E isolated environment testing using tools such as LocalStack. *Please note that we are unable to provide visa sponsorship for this position. This includes, but is not limited to, work visas, employment-based visas, or residency sponsorship. Candidates must have valid work authorization in the United States at the time of application. Visa applications of any kind will not be considered. Digi International offers a distinctive Total Rewards package including a short-term incentive program, new hire stock award, paid parental leave, open (uncapped) PTO, and hybrid work environment in addition to our competitive medical, health & wellbeing and compensation offerings. The anticipated base pay range for this position is $120,000 - $185,000. Pay ranges are determined by role, job level and primary job location. The range displayed reflects the reasonable range we anticipate paying for this position and reflects the cost of labor within several U.S. geographic markets. The specific salary offered within the range will depend on various factors including, but not limited to the candidate’s relevant and prior experience, education, skills, and primary work location. It is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each position. Pay ranges are typically reviewed and updated annually. At Digi, we embrace diversity and inclusion among our teammates. It is critical to our success as a global company, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. We are committed to providing an environment of respect where equal employment opportunities are available to all applicants and teammates. Equal Opportunity Employer This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor. Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Industries Software Development Referrals increase your chances of interviewing at SmartSense by Digi by 2x Inferred from the description for this job Medical insurance Vision insurance 401(k) Paid maternity leave Paid paternity leave Tuition assistance Disability insurance Get notified about new Data Engineer jobs in Boston, MA . Boston, MA $170,000.00-$240,000.00 6 months ago Boston, MA $145,000.00-$204,000.00 2 weeks ago Bedford, MA $80,000.00-$100,000.00 1 week ago Boston, MA $130,000.00-$180,000.00 6 months ago Boston, MA $84,000.00-$142,000.00 4 days ago Peabody, MA $90,000.00-$100,000.00 1 week ago Boston, MA $100,000.00-$200,000.00 3 months ago Cambridge, MA $119,700.00-$245,700.00 8 hours ago Lexington, MA $137,000.00-$215,270.00 1 week ago Boston, MA $120,000.00-$140,000.00 2 weeks ago Boston, MA $125,000.00-$178,000.00 3 weeks ago Boston, MA $150,000.00-$220,000.00 1 month ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Location:
Boston, MA, United States
Salary:
$200,000 - $250,000
Job Type:
FullTime
Category:
IT & Technology

We found some similar jobs based on your search