Senior SRE Engineer

Responsibilities

Linux Systems & Automation (Core)

– Manage large-scale Linux environments: troubleshooting and root-cause analysis
– Write maintainable, hand-off-ready Bash / Ansible / Python automation
– On-call for infrastructure, CI/CD, and production service incidents

HPC Cluster & Storage

– Operate HPC clusters (Slurm) along with usage analytics, auditing, and monitoring tools
– Maintain and plan storage for compute environments (Lustre, NAS)

Cloud & Hybrid Infrastructure

– Manage multi-cloud environments (AWS, Alibaba Cloud, GCP) with Terraform / AWS CDK
– Build and operate Docker (ECS) / Kubernetes (EKS) environments and their deployment workflows

CI/CD & Developer Experience

– Operate self-hosted GitLab server and Runner fleet
– Operate CI/CD systems and design deployment pipelines for research and other projects

GenAI / Internal Platform

– Build internal AI platforms (LangChain / LangGraph / Bedrock, Elasticsearch RAG)
– Develop MCP servers, chatbots, AI agents, and similar services

Requirements

– **5+ years** of hands-on Linux systems administration and infrastructure operations experience
– Solid Linux internals knowledge (process / memory / filesystem / networking / systemd / cgroup); able to localize issues even without complete logs
– Strong Bash / Shell scripting skills — able to write maintainable scripts that others can pick up
– Programming ability for data processing, CLI tools, and API services; Python proficiency preferred
– Solid storage fundamentals with hands-on experience: RAID levels and rebuild trade-offs, filesystem selection, snapshot and backup planning; NAS / shared storage (NFS / SMB) operations experience
– Experience with at least one major public cloud (AWS / GCP / Alibaba Cloud) and IaC tooling (Terraform / CDK / Ansible)
– Familiar with containerization and orchestration (Docker, Kubernetes)
– CI/CD pipeline design and operations experience (GitLab CI / Jenkins / Airflow)
– Able to own a cross-service subsystem end-to-end: design, implementation, documentation, handoff
– **Strong autonomy**: can drive a problem from discovery, root-cause investigation, decision-making, to delivery with minimal supervision; able to make judgment calls under incomplete information and proactively communicate progress, risks, and rationale
– **Self-directed**: doesn’t wait for tickets — identifies problems worth solving and prioritizes them independently

Nice to Have

– HPC scheduler experience (Slurm / PBS / LSF)
– Parallel filesystem operations experience (Lustre / GPFS / BeeGFS)
– Advanced Linux performance analysis (perf, eBPF, ftrace) and kernel parameter tuning
– DB operations experience (MySQL, ClickHouse)
– Low-latency network tuning and cross-datacenter link optimization
– LLM application development (LangChain, RAG, Agent, MCP)
– Self-managed Kubernetes experience (Kubespray, kubeadm)
– GPU server operations (single-node): NVIDIA driver / CUDA toolkit version management, `nvidia-smi` / DCGM monitoring, nvidia-container-toolkit integration, troubleshooting XID / ECC errors and thermal throttling
– Experience or familiarity with integrating GPU resources into Slurm: GRES configuration, cgroup-based GPU isolation, user/job-level resource limits