Cloud File Storage Engineer
About Egen:
Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.
Want to learn more about life at Egen? Check out these resources in addition to the job description.
-> Meet Egen
-> Life at Egen
About the opportunity:
We are seeking a highly skilled and motivated Cloud File Storage Engineer to join our team and develop
scalable file storage solutions for cloud-based High Performance Computing (HPC) platforms. The
ideal candidate will have a strong background in both traditional parallel filesystems such as GPFS and
Lustre, and also modern cloud-native storage solutions such as S3, EFS, FSx, and ElastiCache. You
should be comfortable with Amazon Web Services concepts and services, infrastructure as code, and
continuous integration/continuous deployment (CI/CD) pipelines.
As a Cloud File Storage engineer, you will play a crucial role in designing, building, and maintaining the
storage infrastructure that supports life sciences research initiatives. You will collaborate with
computational scientists and other engineers to ensure that our platform is robust, scalable, and
capable of handling complex computational workloads. You will also ensure our solutions are
implemented securely, with appropriate controls to allow safe storage of sensitive data. You will
collaborate with additional cloud platform technical and product leads to ensure your solutions align
with other emerging infrastructure capabilities being developed concurrently for the R&D organization.
Fully remote and offshore candidates are welcome however this role requires working during US west
coast standard working hours (9-5pm PST/PDT).
Key Responsibilities:
- Design, implement, and maintain scalable and high performance file storage environments onAWS.
- Develop and manage infrastructure as code using tools such as Terraform and Ansible.
- Automate deployment pipelines and improve CI/CD processes using GitLab CI/CD.
- Collaborate with cross-functional teams to understand the computational needs of scientists and translate them into effective platform solutions.
- Monitor and optimize platform performance, ensuring reliability and scalability.
- Troubleshoot and resolve issues related to infrastructure, deployment, and application performance.
- Support data transfer teams' ingress and egress activities.
- Identify and advance collaboration opportunities with other product teams, such as integration with existing data movement and data catalog solutions.
Required Skills:
- AWS: Deep understanding of AWS services and best practices for building scalable, secure, and cost-effective cloud environments.
- DevOps: Proven experience with DevOps practices, including infrastructure as code (Terraform, Ansible), continuous integration, and continuous deployment (GitLab CI/CD).
- IAM: Prior experience integrating storage with common identity and access management solutions such as Active Directory and IAM Identity Center.
- Version Control: Proficiency with Git and experience managing code repositories.
- Storage Concepts: Expert level proficiency with POSIX file system and Network File Sy(NFS) semantics.
- Proficiency with POSIX I/O profiling for high performance / high througworkloads.
- Storage Platforms: Expert level proficiency in at least one high performance / parallel file sytem technology such as Weka, Lustre, GPFS, Ceph, or JuiceFS.
- Storage Reliability: Have a robust understanding of storage redundancy, availability, and durability principles to effectively balance performance objectives with critical measures to prevent unintended data loss.
- Cloud Storage Services: High proficiency with Amazon S3 object storage.
- Some prior experienwith AWS managed services for file storage, such as EFS, FSx for Lustre, or FSx for OpenZFS.
- Security: Knowledge of security best practices in cloud environments and experience implementing them.
Preferred Qualifications:
- Experience: 7+ years working in engineering, solution architecture, or DevOps, with a track record of successfully delivering complex projects.
- Team Player: Ability to work effectively in a collaborative team environment, and comfortable independently designing solutions based on requirements.
- Excellent communicator, ability to clearly share architecture plans, designs, risks, and implementation with a variety of stakeholders.
Preferred Skills (Nice to have):
- Prior experience with at least one POSIX interface solution for S3 object storage, such as S3Mountpoint, CunoFS, or goofys.
- Prior experience with cloud data caching solutions such as Amazon ElastiCache or Amazon FileCache.
- Prior experience with data movement and migration tools such as Aspera, DataSync, rsync/rclone.
Compensation:
Compensation will be commensurate with experience and skills. We offer a competitive salary and benefits package, including health insurance, retirement plans, and professional development opportunities
EEO and Accommodations:
Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.
Similar Jobs
-
-
Senior Lead Engineer - R01546320
Brillio
-
-
ServiceNow Developer
Aprio
-
Senior Lead Engineer - R01546320
Brillio
ServiceNow Developer
Aprio
