
Mid / Senior Big Data Engineer
Job Description:
Role: Big Data EngineerNumber of open positions: 5Location: PuneAt Clairvoyant, we're building a thriving big data practice to help enterprises enable and accelerate the adoption of Big data and cloud services. In the big data space, we lead and serve as innovators, troubleshooters, and enablers. Big data practice at Clairvoyant, focuses on solving our customer's business problems by delivering products designed with best in class engineering practices and a commitment to keep the total cost of ownership to a minimum.
Must Have:
- 4-10 years of experience in software development.
- At least 2 years of relevant work experience on large scale Data applications.
- Strong coding experience in Java is mandatory
- Good aptitude, strong problem solving abilities, and analytical skills, ability to take ownership as appropriate
- Should be able to do coding, debugging, performance tuning and deploying the apps to Prod.
- Should have good working experience on
- o Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)
- o Kafka
- o J2EE Frameworks (Spring/Hibernate/REST)
- o Spark Streaming or any other streaming technology.
- Strong coding experience in Java is mandatory
- Ability to work on the sprint stories to completion along with Unit test case coverage.
- Experience working in Agile Methodology
- Excellent communication and coordination skills
- Knowledgeable (and preferred hands on) - UNIX environments, different continuous integration tools.
- Must be able to integrate quickly into the team and work independently towards team goals
- Take the complete responsibility of the sprint stories' execution
- Be accountable for the delivery of the tasks in the defined timelines with good quality.
- Follow the processes for project execution and delivery.
- Follow agile methodology
- Work with the team lead closely and contribute to the smooth delivery of the project.
- Understand/define the architecture and discuss the pros-cons of the same with the team
- Involve in the brainstorming sessions and suggest improvements in the architecture/design.
- Work with other team leads to get the architecture/design reviewed.
- Work with the clients and counter-parts (in US) of the project.
- Keep all the stakeholders updated about the project/task status/risks/issues if there are any.
Experience: 4 to 9 years
Keywords: java, scala, spark, software development, hadoop, hive
Locations: Pune

About Clairvoyant India Private Limited
About
Connect with the team
Similar jobs (10)
Lightning Job By Cutshort ⚡
As part of this feature, you can expect status updates about your application and replies within 72 hours (once the screening questions are answered)
Job Overview:
We are seeking an experienced DevOps Engineer to join our team. The successful candidate will be responsible for designing, implementing, and maintaining the infrastructure and software systems required to support our development and production environments. The ideal candidate should have a strong background in Linux, GitHub, Actions/Jenkins, ArgoCD, AWS, Kubernetes, Helm, Datadog, MongoDB, Envoy Proxy, Cert-Manager, Terraform, ELK, Cloudflare, and BigRock.
Kindly apply at https://wohlig.keka.com/careers/jobdetails/54566
Responsibilities:
• Design, implement and maintain CI/CD pipelines using GitHub, Actions/Jenkins, Kubernetes, Helm, and ArgoCD.
• Deploy and manage Kubernetes clusters using AWS.
• Configure and maintain Envoy Proxy and Cert-Manager to automate deployment and manage application environments.
• Monitor system performance using Datadog, ELK, and Cloudflare tools.
• Automate infrastructure management and maintenance tasks using Terraform, Ansible, or similar tools.
• Collaborate with development teams to design, implement and test infrastructure changes.
• Troubleshoot and resolve infrastructure issues as they arise.
• Participate in on-call rotation and provide support for production issues.
Qualifications:
• Bachelor's or Master's degree in Computer Science, Engineering or a related field.
• 3+ years of experience in DevOps engineering with a focus on Linux, GitHub, Actions/CodeFresh, ArgoCD, AWS, Kubernetes, Helm, Datadog, MongoDB, Envoy Proxy, Cert-Manager, Terraform, ELK, Cloudflare, and BigRock.
• Strong understanding of Linux administration and shell scripting.
• Experience with automation tools such as Terraform, Ansible, or similar.
• Ability to write infrastructure as code using tools such as Terraform, Ansible, or similar.
• Experience with container orchestration platforms such as Kubernetes.
• Familiarity with container technologies such as Docker.
• Experience with cloud providers such as AWS.
• Experience with monitoring tools such as Datadog and ELK.
Skills:
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• Ability to work independently or in a team environment.
• Strong attention to detail.
• Ability to learn and apply new technologies quickly.
• Ability to work in a fast-paced and dynamic environment.
• Strong understanding of DevOps principles and methodologies.
We are hiring Senior Talent Acquisition Manager for an EdTech platform in Bangalore.
Responsibilities:
- Overlooking at end-to-end recruitment process.
- Prepare recruitment materials and post jobs to appropriate job boards.
- Ensure all the best-recruiting equipment, software, and practices are being used in the process.
- Developing a strategic continuous candidate pipeline.
- Consistent networking, future candidate engagement strategies and communication cadence.
- Handling communication within the team and aiding in preparing schedules for recruitment activities and their execution.
Required Skills:
- Proven recruitment experience at start-ups.
- Experience with applicant tracking systems and HR databases. Prior experience with freshteam will be desirable.
- Hands-on experience with recruiting and sourcing candidates.
- Excellent knowledge of MS Office (PPT, Word, Excel).
- Excellent analytical & time management skills.
- Excellent communication, interpersonal and people skills.
- Ability to attract and hire top-notch Engineering talent for the organisation.
- Be responsible for the group's technical strategy and roadmap - creating success metrics in close collaboration with other groups across the organisation in executing initiatives in an agile way.
- Brings a strong perspective that drives change and motivates engineers to develop simple solutions to complex problems.
- Help implement effective engineering processes and champion their adoption.
- Has the technical capacity and capability to partner with tech leads and architects in problem solving.
- Mentor the professional development of each direct report through personal and performance management.
- Give engineers the tools, confidence, and motivation to make decisions independently that lead to their recognition.
- Effective at influencing a culture of engineering craftsmanship and excellence.
- Initiate cross-functional (Product, Business, Operations) collaborations with development teams throughout Razorpay and gather feedback and requirements.
- Seek diverse perspectives to drive bottom-up innovation and create buy-in from all technical stakeholders.
- Ensure the team fully understands the goals and objectives of Razorpay as a company and how their work fits into 'the bigger picture.
Mandatory Qualifications:
- Total of 8+ years' experience.
- Experience level of 5+ years of experience in very large-scale applications and 3+ years' experience in people management.
- Strong problem solving skills, data structures and algorithms.
- Experience with distributed systems handling large amounts of data.
- Excellent coding skills in one of the languages PHP/Python/C++/Java.
- Very good understanding of Web Technologies.
- Very good understanding of any RDBMS and/or messaging.
JOB DESCRIPTION
Associate PR Manager
- About the Company: - It is a leading independent Digital Products and services agency. Founded in 2008, the agency solutions towards building future ready brands on digital, through an integration of content, technology and media, using data backed tools and practices
- ROLE:-
-To manage communication for our Network and Business Units.
- To position the network CEOs/Partners as the industry expert in leading publications
- To produce effective press notes & press releases
- To produce and circulate important pieces of information internally
- To manage networks social media channels
- To maintain healthy and engaging relationship with media houses
- To manage and maintain media contact database
- To ideate innovative PR strategies
- To draft communication material for internal business units
- To associate with bloggers to achieve online traction
- Developing effective PR plans using appropriate strategies and tactics
- Organizing and coordinating PR activities
- Liaise with marketing professionals to ensure consistency in promoting Network image
- Assess opportunities for sponsorships and other partnerships and manage relations
- Analyze results of PR campaigns or efforts and prepare reports
- To perform other essential tasks as assigned
CANDIDATES ONLY FROM PR AGENCY PREFFERED
Excellent communication and interpersonal skills
Inbound sales, negotiating and convincing skills
Skills to promote our service to potential customers and close deals to maximize sales
Actively seek out new sales opportunities through cold calling, networking, and social media
Effectively managing feedback and escalations from customers and vendors.
Working in close interface with the product and marketing team to build better processes, products for the customers.
We are the company behind EmployWise, award-winning, cloud-based software for hire-to-retire HR automation delivered in the SaaS model. Through our products and services, we help our customers leverage their human capital to achieve better business results. We believe in nurturing talent because we believe that to build a successful organization, we need people with exemplary talent! We provide our people with an environment charged with challenges, achievements, and aspirations. Each team member strives to maintain the highest standards of integrity and ethical business practices along with individual determination for quality, learning, and growth, which helps us exceed expectations.
About the Job Responsibilities :
1. Develop features across multiple subsystems within our applications, including collaboration in requirements definition, prototyping, design, coding, testing, and deployment
2. Understand how our applications operate, structured, and how customers use them
3. Provide engineering support (when necessary) to other teams who are responsible for deployment and help them with debugging issues (when needed)
4. Participate with the engineering and implementation teams to define plans for standardizing, scaling, and enhancing our products and the services utilized to deploy/install those products
5. Investigate, analyze and make recommendations to management regarding technology improvements, upgrades, and modifications.
Job Description for :
Role: Data/Integration Architect
Experience – 8-10 Years
Notice Period: Under 30 days
Key Responsibilities: Designing, Developing frameworks for batch and real time jobs on Talend. Leading migration of these jobs from Mulesoft to Talend, maintaining best practices for the team, conducting code reviews and demos.
Core Skillsets:
Talend Data Fabric - Application, API Integration, Data Integration. Knowledge on Talend Management Cloud, deployment and scheduling of jobs using TMC or Autosys.
Programming Languages - Python/Java
Databases: SQL Server, Other Databases, Hadoop
Should have worked on Agile
Sound communication skills
Should be open to learning new technologies based on business needs on the job
Additional Skills:
Awareness of other data/integration platforms like Mulesoft, Camel
Awareness Hadoop, Snowflake, S3
-
Leverage native APIs for deep integrations
-
Solving any challenges that might appear on the way
-
Diagnose and fix bugs and performance bottlenecks for performance that feels native
-
Maintain code and write automated tests of quality that sets the benchmark for your future colleagues
-
2+ years of relevant industry experience in React Native
-
A deep understanding of JavaScript
-
Familiarity with video recording, playback, and uploading libraries
-
Experience with Native Android app deployment
-
Familiarity with modern front-end build pipelines and tools
-
Familiarity with Socket.io is a plus
-
Familiarity with RESTful APIs
-
Strong UX/UI design exposure and experience in making apps work intuitively and with pixel perfect interface
-
Highly accountable and takes ownership, with a collaborative attitude, and a lifelong learner
-
Familiarity with code versioning tools (such as Git)









