Senior DataOps Engineer - MainApp infrastructure

We are a team to design, develop, maintain, and improve software for various ventures projects, i.e., projects that are adjacent to our core businesses and are bootstrapped fast with a lean team. You will be actively involved in the design of various components behind scalable applications, from frontend UI to backend infrastructure.

Responsibilities:

• Manage the daily operations of Hadoop, Spark, Flink, Clickhouse, and other big data platforms to ensure system stability and data security;
• Operate and administer Linux systems, proficient in common commands, with scripting skills in Shell, Python, or similar languages;
• Maintain and operate big data components on cloud platforms (AWS/GCP/Azure), with hands-on experience in container technologies such as Kubernetes and Docker;
• Build and maintain monitoring systems to track platform performance, optimize configurations and resource allocation, and troubleshoot performance issues (tools such as Datadog, Prometheus, Grafana, Zabbix, etc.);
• Deploy, upgrade, and scale core big data components including Flink, Kafka, Spark, Impala,Clickhouse and Kudu;
• Write and maintain technical documentation for operations, and support in platform solution design and upgrades;
• Explore and adopt new technologies to optimize operation processes and provide technical guidance to help client teams improve their capabilities.
• Preferred: Experience on the development of n8n workflow

Qualifications:

• Familiarity with CDH/CDP/HDP or similar Hadoop distributions, with proven experience in big data platform operations preferred;
• Proficiency in Linux administration and scripting (Shell, Python, or equivalent);
• Experience with major cloud platforms (AWS/GCP/Azure) and containerized environments (Kubernetes, Docker);
• Strong knowledge of big data components and performance tuning, able to resolve stability and scalability issues independently;
• Strong technical writing and communication skills to support documentation and solution delivery;
• Self-motivated with a passion for new technologies, able to apply innovative approaches to optimize operations and drive efficiency.

Life @ Crypto.comEmpowered to think big. Try new opportunities while working with a talented, ambitious and supportive team.Transformational and proactive working environment. Empower employees to find thoughtful and innovative solutions.Growth from within. We help to develop new skill-sets that would impact the shaping of your personal and professional growth.Work Culture. Our colleagues are some of the best in the industry; we are all here to help and support one another.One cohesive team. Engage stakeholders to achieve our ultimate goal - Cryptocurrency in every wallet.Work Flexibility Adoption. Flexi-work hour and hybrid or remote set-upAspire career alternatives through us - our internal mobility program offers employees a new scope.Work Perks: crypto.com visa card provided upon joiningAre you ready to kickstart your future with us?BenefitsCompetitive salaryAttractive annual leave entitlement including: birthday, work anniversaryWork Flexibility Adoption. Flexi-work hour and hybrid or remote set-upAspire career alternatives through us. Our internal mobility program can offer employees a diverse scope.Work Perks: crypto.com visa card provided upon joiningOur Crypto.com benefits packages vary depending on region requirements, you can learn more from our talent acquisition team.About Crypto.com:Founded in 2016, Crypto.com serves more than 150 million customers and is the world's fastest growing global cryptocurrency platform. Our vision is simple: Cryptocurrency in Every Wallet™. Built on a foundation of security, privacy, and compliance, Crypto.com is committed to accelerating the adoption of cryptocurrency through innovation and empowering the next generation of builders, creators, and entrepreneurs to develop a fairer and more equitable digital ecosystem.Learn more at https://crypto.com.Crypto.com is an equal opportunities employer and we are committed to creating an environment where opportunities are presented to everyone in a fair and transparent way. Crypto.com values diversity and inclusion, seeking candidates with a variety of backgrounds, perspectives, and skills that complement and strengthen our team.Personal data provided by applicants will be used for recruitment purposes only.Please note that only shortlisted candidates will be contacted.We may use artificial intelligence tools to analyze the content of your Resume/CV against the specific requirements for the position. The purpose is to support our recruitment team in reviewing applications more effectively. These tools assist our recruitment team in their evaluation of your application by providing recommendations, but they do not replace human judgment. Final hiring decisions are ultimately made by humans who consider the insights generated by the tools along with other relevant information. If you would like more details about how your personal information is processed, please contact us.