Sr. Data Engineer

Position Overview

We are seeking a highly skilled and experienced Database Architect / Senior DBA to join our team. The ideal candidate should be hands-on and have a background in running production systems for critical systems with high availability demands.

What you will do

• Critically review Egnyte’s data architecture. Proactively suggest and implement solutions that would address high availability and scale needs of tomorrow.
• Support system uptime by being a part of a 24/7 technical team that reacts to system incidents and supports the rest of the engineering group.
• Collaborate with development teams and stakeholders to analyze data requirements and design efficient, scalable, and reliable database architectures.
• Be a subject matter expert when it comes to DB design of new Egnyte features: both via RDBMS and NoSQL approaches, such as document stores, key-value stores, and graph databases.
• Understand the system bottlenecks and customer use cases to proactively optimize DB performance and manage costs.
• Understand multi-tenant cloud platforms (Egnyte runs on GCP), and use their capabilities as needed to achieve the goals above.
• Mentor and support career growth of other DBA specialists in the organization.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Proven experience (5+ years) as a Database Architect, Senior DBA, or similar role.
• Strong expertise in both relational database management systems (RDBMS) and NoSQL databases.
• Strong hands-on experience in designing and managing large scale MySQL clusters with high availability and 99.99 SLA
• Proficiency in database design, data modeling, and schema optimization.
• In-depth knowledge of query optimization techniques and performance tuning.
• Experience with cloud-based database solutions (e.g., GCP CloudSQL) is a plus.
• Familiarity with data security practices, compliance regulations, and encryption methods.
• Excellent problem-solving skills and the ability to diagnose and resolve complex database issues.
• Strong communication and collaboration skills to work effectively across teams.

• Leading the engineering team  and federated suites.
• Helping define Technical Roadmap and own the entire product delivery end to end.
• Working very closely with various business stakeholders to drive the execution of multiple business plans and technologies for the team.
• Improving, optimizing and identifying opportunities for efficient software development processes.
• Hiring, Developing and Retaining a strong team of engineers.

• 7-9 years of experience with Java development, Spring Boot. Minimum 5+ years of managing high performance development team(s).
• Strong knowledge of REST and micro services based design.
• Experience across the product development SDLC with solving customer problem approaches.
• Prior product engineering leadership in Identity and Access Management solutions is a big plus.

Who we are:

Acqueon's conversational engagement software lets customer-centric brands orchestrate campaigns and proactively engage with consumers using voice, messaging, and email channels. Acqueon leverages a rich data platform, statistical and predictive models, and intelligent workflows to let enterprises maximize the potential of every customer conversation. Acqueon is trusted by 200 clients across industries to increase sales, drive proactive service, improve collections, and develop loyalty.

At our core, Acqueon is a customer-centric company with a burning desire (backed by a suite of awesome, AI-powered technology) to help businesses provide friction-free, delightful, and referral-worthy customer experiences.

We are looking for

We are looking for an innovative and mission-driven Director, Engineering to play a pivotal role in building the most critical engineering solutions for our business growth. This new role will be supporting the enterprise and Technology organization of business line.

The Director, Engineering works with the Product Owner to understand the business strategy and work together to define the roadmap of product feature development over the next couple of years. Along with that the key aspect is to ensure that the team is aligned to deliver these strategic initiatives which would encompass building data streams, data analytics and feature development across multiple projects in close partnership with our Product teams.

As a Director Engineering in Acqueon you will….

Responsive team player who can proactively contribute for building technical strategies for applications and systems by promoting an understanding of the technology and business roadmap. He /she is someone who thrives in a fun, fast-paced, dynamic, startup-like environment.

• Lead a team of strong developers, working on large-scale, complex and cutting-edge systems and ensure that the team optimizes codes, while contributing to business goals and product strategies
• Chalk-out and implement the vision, technology roadmap and business goals
• Operate with scale and speed, amidst flux in the fast-paced environment and evaluate performances regularly and share and seek feedback
• Managing the development and delivery of complex features from design to production according to product requirements
• Work closely with Engineering Leaders, Managers; Product Management, Business Development and Operation teams, and enable them by providing scalable and high quality technology solutions at a rapid pace, estimate and plan projects in an agile environment
• Ensuring that risks and issues are identified and managed closely while driving all stakeholders to deliver on time and to the required quality standards
• Building a strong development team that can work independently and at the same time will collaborate with other international R&D teams
• Responsible to review Architecture and design technically robust, flexible and scalable solutions and deep understanding of technologies and architecture in a highly scalable and available set-up
• Expertise in highly transactional, large relational and complex systems
• Strong object oriented design skills, and an uncanny ability to design intuitive modules and class-level interfaces
• Superior management skills to manage multi-engineer projects and experience in delivering high quality projects on time
• Strong technical competence with a track record of individual technical accomplishments

As a Director in Acqueon you will need….

• An Engineering Degree - B.E/B.Tech/MS in any stream – Computer Science/IT preferred
• With 15+ years of experience in building and managing highly skilled development teams, and the ability to lead, coach and influence them
• Deep understanding in Java, Golang, SQL/NoSQL database, Elastic search, K8S and Docker
• Experience in developing scalable, concurrent, low-latency, fault tolerant systems
• Strong track record of leading and managing the delivery of software development projects, meeting key milestones and overcoming challenges
• Previous experience in working with other international R&D, product management and support teams
• Proven knowledge in both architecture and implementation-level software design of high-scale distributed systems
• Drive the success of the implementation by applying technical skills, to design and build enhanced processes and technical solutions in support of strategic initiatives.
• Work closely with the Architects and cross functional teams and follow established practices for the delivery of solutions meeting QCD (Quality, Cost & Delivery). Within the established architectural guidelines.
• Ability to manage, track and identify risks, bottlenecks and challenges ahead of time, and oversee technical coordination to resolve them
• Willingness to work in a fast paced, and driven team in a context-switching environment
• Should have experience with CDP platforms, NoSql platforms, java/python, AWS platform, ELT (connectors to fetch data, transform) additionally experience with Sagemaker, AI Modelling and Data Science would be a plus

Job Title: Engineering Manager

Job Location: Chennai, Bangalore
Job Summary
The Engineering Org is looking for a proficient Engineering Manager to join a team that is building exciting
and futuristic Data Products at Condé Nast to enable both internal and external marketers to target
audiences in real time. As an Engineering Manager, you will drive the day-to-day execution of technical
and architectural decisions. EM will own engineering deliverables inclusive of solving dependencies
such as architecture, solutions, sequencing, and working with other engineering delivery teams.This role
is also responsible for driving innovation, prototyping, and recommending solutions. Above all, you will
influence how users interact with Conde Nast’s industry-leading journalism.
● Primary Responsibilities
● Manage a high performing team of Software and Data Engineers within the Data & ML
Engineering team part of Engineering Data Organization.
● Provide leadership and guidance to the team in Data Discovery, Data Ingestion, Transformation
and Storage
● Utilizing product mindset to build, scale and deploy holistic data products after successful
prototyping and drive their engineering implementation
● Provide technical coaching and lead direct reports and other members of adjacent support teams
to the highest level of performance..
● Evaluate performance of direct reports and offer career development guidance.
● Meeting hiring and retention targets of the team & building a high-performance culture
● Handle escalations from internal stakeholders and manage critical issues to resolution.
● Collaborate with Architects, Product Manager, Project Manager and other teams to deliver high
quality products.
● Identify recurring system and application issues and enable engineers to work with release teams,
infra teams, product development, vendors and other stakeholders in investigating and resolving
the cause.
● Required Skills
● 4+ years of managing Software Development teams, preferably in ML and Data
Engineering teams.
● 4+ years of Agile Software development practices
● 12+ years of Software Development experience.
● Excellent Problem Solving and System Design skill
● Hands on: Writing and Reviewing code primarily in Spark, Python and/or Java
● Hand on: Architect & Design end to end Data Pipeline (noSQL databases, Job Schedulers, Big
Data Development preferably on Databricks / Cloud)
● Experience with SOA & Microservice architecture
● Knowledge of Software Engineering best practices with experience on implementing CI/CD,
Log aggregation/Monitoring/alerting for production system
● Working Knowledge of cloud and devops skills (AWS will be preferred)
● Strong verbal and written communication skills.
● Experience in evaluating team member performance and offering career development
guidance.
● Experience in providing technical coaching to direct reports.
● Experience in architecting highly scalable products.
● Experience in collaborating with global stakeholder teams.
● Experience in working on highly available production systems.
● Strong knowledge of software release process and release pipeline.
About Condé Nast
CONDÉ NAST INDIA (DATA)
Over the years, Condé Nast successfully expanded and diversified into digital, TV, and social
platforms - in other words, a staggering amount of user data. Condé Nast made the right move to
invest heavily in understanding this data and formed a whole new Data team entirely dedicated to
data processing, engineering, analytics, and visualization. This team helps drive engagement, fuel
process innovation, further content enrichment, and increase market revenue. The Data team
aimed to create a company culture where data was the common language and facilitate an
environment where insights shared in real-time could improve performance.
The Global Data team operates out of Los Angeles, New York, Chennai, and London. The team at
Condé Nast Chennai works extensively with data to amplify its brands' digital capabilities and boost
online revenue. We are broadly divided into four groups, Data Intelligence, Data Engineering, Data
Science, and Operations (including Product and Marketing Ops, Client Services) along with Data
Strategy and monetization. The teams built capabilities and products to create data-driven solutions
for better audience engagement.
What we look forward to:
We want to welcome bright, new minds into our midst and work together to create diverse forms of
self-expression. At Condé Nast, we encourage the imaginative and celebrate the extraordinary. We
are a media company for the future, with a remarkable past. We are Condé Nast, and It Starts Here.

Role / Purpose - Lead Developer - API and Microservices

Must have a strong hands-on development track record building integration utilizing a variety of integration products, tools, protocols, technologies, and patterns.

• Must have an in-depth understanding of SOA/EAI/ESB concepts, SOA Governance, Event-Driven Architecture, message-based architectures, file sharing, and exchange platforms, data virtualization and caching strategies, J2EE design patterns, frameworks
• Should possess experience with at least one of middleware technologies (Application Servers, BPMS, BRMS, ESB & Message Brokers), Programming languages (e.g. Java/J2EE, JavaScript, COBOL, C), Operating Systems (e.g. Windows, Linux, MVS), and Databases (DB2, MySQL, No SQL Databases like MongoDB, Cassandra, Hadoop, etc.)
• Must have experience implementing API Service architectures (SOAP, REST) using any of the market-leading API Management tools such as Apigee and frameworks such as Spring Boot for Microservices
• Should have Advanced skills in implementing API Service architectures (SOAP, REST) using any of the market-leading API Management tools such as Apigee or similar frameworks such as Spring Boot for Microservices 
• Appetite to manage large-scale projects and multiple tracks
•  Experience and knowhow of the e-commerce domain and retail experience are preferred
•  Good communication & people managerial skills

This person MUST have:

• BE Computer Science or equivalent
• Cloud app development experience.
• Strong Troubleshooting and debugging skills
• A strong passion for writing simple, clean, and efficient code.

• 3 years of experience with the Django framework and other backend technologies.
• Knowledge of NodeJS
• Experience with building, modifying, and extending API endpoints (REST or GraphQL) for data retrieval and persistence.
• Understand how to use a database like Postgres (preferred choice), SQLite, MongoDB, MySQL.
• Experience creating high-performance applications.
• Experience with messaging and broker tools - Rabbitmq, MQTT
• Experience with SQL and NoSQL databases
• Experience with the full software development life cycle, including requirements collection, design, implementation, testing, and operational support.
• Knowledge of web services
• Proficient understanding of code versioning tools Git.
• Hands-on experience deploying and managing infrastructure with CloudFormation/Terraform
• Experience managing AWS infrastructure.
• Hands-on experience in Linux environment.
• Basic understanding of Kubernetes/Docker orchestration.
• Manges existing infrastructure/Pipelines/Engineering tools (On-Prem or  AWS) for the engineering team (Build servers/Jenkins nodes etc.)
• Experience with scrum or other agile software development methodology.
• Excellent verbal and written communication, teamwork, decision making and
• influencing skills.
• Handle customer calls/emails regarding technical issues for end-users.
• Strong communication skills
• Attention to detail.

Experience:

• Min 3 year experience

Location:

• Ahmedabad Office Or,
• Work from home

Timings:

• 40 hours a week with a rotational shift every month.

• 15+ years of Hands-on technical application architecture experience and Application build/ modernization experience

• 15+ years of experience as a technical specialist in Customer-facing roles.

• Ability to travel to client locations as needed (25-50%)

• Extensive experience architecting, designing and programming applications in an AWS Cloud environment

• Experience with designing and building applications using AWS services such as EC2, AWS Elastic Beanstalk, AWS OpsWorks

• Experience architecting highly available systems that utilize load balancing, horizontal scalability and high availability

• Hands-on programming skills in any of the following: Python, Java, Node.js, Ruby, .NET or Scala

• Agile software development expert
• Experience with continuous integration tools (e.g. Jenkins)

• Hands-on familiarity with CloudFormation

• Experience with configuration management platforms (e.g. Chef, Puppet, Salt, or Ansible)

• Strong scripting skills (e.g. Powershell, Python, Bash, Ruby, Perl, etc.)

• Strong practical application development experience on Linux and Windows-based systems

• Extra curricula software development passion (e.g. active open source contributor)

Job Description:

TeamExtn is looking for a passionate Senior Scala Engineer. It will be expected from you to build pragmatic solutions on mission-critical initiatives. If you know your stuff, see the beauty in code, have knowledge in depth and breadth, advocate best practices, and love to work with distributed systems, then this is an ideal position for you.

As a core member of our Special Projects team, you will work on various new projects in a startup-like environment. These projects may include such things as building new APIs (REST/GraphQL/gRPC) for new products, integrating new products with core Carvana services, building highly scalable back end processing systems in Scala and integrating with systems backed by Machine Learning. You will use cutting edge functional Scala libraries such as ZIO. You will have the opportunity to work closely with our Product, Experience and Software Engineering teams to deliver impact.

Responsibilities:

• Build highly scalable APIs and back end processing systems for new products
• Contribute in the full software development lifecycle from design and development to testing and operating in production
• Communicate effectively with engineers, product managers and data scientists
• Drive scalability and performance within our distributed AI platform
• Full software development lifecycle from design and development to testing and operating in production
• Communicate effectively with engineers, product managers and data scientists

Skills And Experience:

• 4+ years experience with Scala, Java or other functional language
• Experience with Akka and Lightbend stack
• Expert with PostgreSQL, MySQL or MS SQL
• Experience in architecting, developing, deploying and operating large scale distributed systems and actor systems
• Experience with cloud APIs (e.g., GCP, AWS, Azure)
• Messaging systems such as GCP Pub/Sub, RabbitMQ, Kafka
• Strong foundation in algorithms and data structures and their real-world use cases.
• Solid understanding of computer systems and networks
• Production quality coding standards and patterns

BONUS SKILLS:

• Experience with functional programming in Scala
• Knowledge of ZIO and related ecosystem
• Experience with functional database libraries in Scala (Quill preferred)
• Kubernetes and Docker
• Elasticsearch
• Typescript, React and frontend UI development experience
• gRPC, GraphQL

• Developing a deep understanding of our vast data sources on the web and knowing exactly how, when, and which data to scrap, parse and store
• Working closely with Database Administrators to store data in SQL and NoSQL databases
• Developing frameworks for automating and maintaining constant flow of data from multiple sources
• Working independently with little supervision to research and test innovative solutions skills

Desired Candidate Profile

• Bachelor/ Master’s degree in Computer science/ Computer Engineering/ Information Technology
• 1 - 5 years of relevant experience
• Strong coding experience in Python (knowledge of Java, JavaScript is a plus)
• Experience with SQL and NoSQL databases
• Experience with multi-processing, multi-threading, and AWS/Azure
• Strong knowledge of scraping frameworks such as Python (Request, Beautiful Soup), Web Harvest and others
• In depth knowledge of algorithms and data structures & previous experience with web crawling is a must    

• Take the microservices architecture to the next level of scalability, efficiency, observability, and availability. 
• Build, deploy & run multi-homed systems that work in multiple regions and cloud providers. 
• Build (and open source) data processing, storage and fetch systems at the petabyte scale with the lowest cost/GB while still responding in milliseconds at the 99th percentile. 
• Optimize algorithms which influence personalization, fulfillment/allocation, pricing, maps & routing, fleet positioning, payments, fraud prevention etc 
• Create platforms, reusable libraries, and utilities wherever applicable 
• Write high-quality code that is modular, functional and testable; Establish the best coding practices 
• Formally mentor junior engineers on design, coding, and troubleshooting 
• Troubleshoot issues effectively in a distributed architecture 
• Communicate, collaborate and work effectively in a global environment 
• Operationalize releases by partnering with Tech operations on capacity planning and operability of the product

Experience:

• of years  - 10+ years
• Type of experience - software design, development & architecture
• Experience in Product companies working on Internet-scale applications is preferred 
• Contribution to open-source software, tech blogs, talking at tech conferences, etc. 

Educational Qualifications:

○  Must have - Bachelor’s or Master’s degree in Engineering from premier institutes preferred  

Key competencies:

•  Deep understanding of one or more of Java/Go/Scala/C++. Ability to understand and critique the core library/language constructs. 
• Knowledge of processor, memory, network and storage internals. 
• Deep understanding of distributed systems including fault modeling, concurrency, isolation, consensus etc. 
• Internals of a RDBMS like MySQL 
• Conversant with the internals of systems like Kafka, Cassandra/Scylla, Redis, RocksDB, etc 
• Working knowledge of hosting and network infrastructure (K8s, Envoy, etc) 
• Familiarity with binary serialization protocols like thrift/protobuf/flatbuffers etc 
• Familiar with gRPC, HTTP/2, QUIC, etc. 
• Troubleshooting memory issues, GC tuning, resource leaks etc. 
• Strong problem-solving skills, algorithmic skills and data structures. 
• Productionizing machine learning pipelines using Spark/Flink/TensorFlow etc