Position Summary
We are seeking a highly experienced Senior Data Engineer with strong database expertise to join our growing data team. This role combines the strategic data architecture and pipeline development responsibilities of a Senior Data Engineer with deep database management and optimization skills. You will be responsible for designing, building, and maintaining robust data infrastructure while ensuring optimal database performance and security.You are a seasoned data professional who combines deep technical expertise in both data engineering and database administration with proven leadership capabilities.
You thrive in cloud-first environments, particularly AWS, and have hands-on experience building scalable data solutions with API-driven architectures and managed database services. You're passionate about optimizing data systems for performance and security while mentoring others and driving strategic initiatives.
Essential Duties and Responsibilities
Data Engineering Focus:
- Design and create overall data architecture including databases, data lakes, and large-scale processing systems
- Build and maintain data pipelines that transform and transport data from various sources using AWS services
- Develop high-performance algorithms, prototypes, and predictive models
- Ensure data flows efficiently through pipelines for analysis and reporting
- Collaborate with data scientists and analysts to meet complex analytics requirements
- Implement and maintain data management tools and systems
Database Engineering Focus:
- Design, configure, and maintain cloud-based database environments including AWS RDS
- Monitor database performance and proactively identify and address performance issues
- Ensure database security including access control, data encryption, and compliance
- Develop and implement backup and recovery procedures
- Plan and execute database upgrades and migrations
- Optimize data retrieval and perform database maintenance tasks
- Create comprehensive documentation for database configurations
Leadership Responsibilities:
- Provide technical leadership and mentorship to junior team members
- Lead strategic planning for data infrastructure initiatives
- Manage resources and coordinate cross-functional projects
- Drive change management initiatives for data systems
- Resolve technical conflicts and facilitate team collaboration
Qualifications
- 7+ years of experience in data engineering with significant database focus
- Bachelor's degree in a STEM program (Computer Science, Engineering, Mathematics, etc.)
- Extensive experience with AWS services including:
- AWS Lake Formation (required)
- AWS Step Functions (required)
- AWS Lambda (required)
- Amazon S3 (required)
- AWS API Gateway (required)
- Amazon RDS (required)
- Strong experience with database technologies: MySQL, Oracle, SQL Server, PostgreSQL, MariaDB, DynamoDB, DocumentDB, Neptune, MongoDB, Redshift, Snowflake
Technical Skills:
- Proficient in programming languages: Python, Java, Scala
- Advanced SQL and database optimization expertise
- Experience with AWS RDS platforms including multi-AZ deployments, read replicas, and automated backups
- Experience with big data technologies: Hadoop, Spark, Kafka
- Knowledge of ETL/ELT processes and data warehousing solutions
- Experience with NoSQL databases and cloud-native data services
- Understanding of data APIs, RESTful services, and API management
- Familiarity with Infrastructure as Code (IaC) and CI/CD pipelines
- Experience with API integration patterns and microservices architecture
- Knowledge of database replication, high availability, and disaster recovery
Leadership & Soft Skills:
- Proven leadership and team management experience
- Risk management and strategic planning capabilities
- Strong conflict resolution and communication skills
- Change management experience
- Resource management and project coordination skills
Nice-to-Have Skills and Experience
Preferred AWS Certifications:
- AWS Machine Learning Engineer Associate
- AWS Security Specialist
- AWS Database Specialty (retired but valuable)
- AWS SysOps Associate
Programming & Analytics Certifications:
- Certified Professional Python Programmer Level 1
- Certified Associate Data Analyst with Python
Data Platform Certifications:
- Databricks ML Engineer Associate
- Databricks Generative AI Engineer Associate
- HashiCorp Terraform Associate
- Snowflake SnowPro
Database Vendor Certifications:
- RDBMS vendor-specific Professional level certifications (Oracle, Microsoft, etc.)
What We Offer
- Opportunity to work with cutting-edge cloud technologies and data platforms
- Leadership role in a growing data practice
- Collaborative environment with data scientists, analysts, and engineers
- Professional development and certification support
- Exposure to diverse client engagements and industry challenges
Company Offered Benefits
Full-time employees are eligible to participate in our employee benefit programs:
- Medical, dental, and vision health insurances,
- Short term disability, long term disability and life insurances,
- 401k with Company match
- Paid time off (PTO) (120 hours PTO that accrue over one year)
- Paid time off for major holidays (14 days per year)
- These and any other employee benefit offerings are subject to management’s discretion and may change at any time.
Physical Demands and Work Environment
The work is generally performed in an office environment. Physical demands include sitting, keyboarding, verbal communication, written communication. Employees are occasionally required to stand; walk; reach with hands and arms; climb or balance; and stoop, kneel, crouch, or crawl. The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this position. Reasonable accommodation may be made to enable individuals with disabilities to perform the functions.Salary Range for this position: $151,000-$185,000"Salary ranges provided are for informational purposes only and may vary depending on factors such as experience, qualifications, and geographic location.
The final salary offer will be determined based on the candidate's skills and alignment with the role requirements."This job description may not be inclusive of all assigned duties, responsibilities, or aspects of the job described, and may be amended anytime at the sole discretion of the Employer. Duties and responsibilities are subject to possible modification to reasonably accommodate individuals with disabilities. To perform this job successfully, the incumbents will possess the skills, aptitudes, and abilities to perform each duty proficiently.
This document does not create an employment contract, implied or otherwise, other than an “at will” relationship. Effectual Inc. is an EEO employer and does not discriminate on the basis of any protected classification in its hiring, promoting, or any other job-related opportunity.
