Big Data Developer at xyz · Bengaluru (Bangalore) · 4 - 6 years · ₹12L - ₹15L / yr · Posted 19 Jan 2024

Job Title Big Data Developer
Job Description
Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent.
Solid Experience of software development experience and leading teams of engineers and scrum teams.
4+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark).
Solid Datawarehousing concepts.
Knowledge of Financial reporting ecosystem will be a plus.
4+ years of experience within Data Engineering/ Data Warehousing using Big Data technologies will be an addon.
Expert on Distributed ecosystem.
Hands-on experience with programming using Core Java or Python/Scala
Expert on Hadoop and Spark Architecture and its working principle
Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data.
Experience in UNIX shell scripting.
Roles & Responsibilities
Ability to design and develop optimized Data pipelines for batch and real time data processing
Should have experience in analysis, design, development, testing, and implementation of system applications
Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.
Excellent technical and analytical aptitude
Good communication skills.
Excellent Project management skills.
Results driven Approach.
Mandatory SkillsBig Data, PySpark, Hive

Similar jobs (10)
Job Title: Business Development Manager
Experience: 2-5 Year
Location: Chennai/Indore
Required Skills:
● Proven track record in US-based IT service sales (preferably in B2B).
● Excellent communication and interpersonal skills.
● Strong negotiation and closing capabilities.
● Familiarity with CRM tools like HubSpot, Salesforce, or Zoho.
Key Responsibilities:
● Identify, generate, and qualify leads for US-based service sales through various
channels (Upwork, LinkedIn, email campaigns, cold calling, etc.).
● Pitch IT services (Web/App Development, Digital Marketing, etc.) to prospects in
the US market.
● Handle the entire sales cycle – from lead generation to closure, including
negotiation and follow-ups.
BE/BTech/BS or equivalent
7+ years of experience in Java and Spring Boot
Strong fundamentals in data structure, algorithm, and object-oriented programming
4+ years of hands-on experience in designing, developing, and delivering large-scale (distributed) system
architecture with complex software design, high scalability and availability.
Extensive experience with technical leadership, defining visions/solutions and collaborating/driving to see
them to completion.
Excellent analytical and problem-solving skills
Experience with any RDBMS and strong SQL knowledge
Comfortable with Unix / Linux command line
Nice to have Skills
Experience with Big Data platforms like Hadoop / Hive / Presto
Experience with ML/AI frameworks like TensorFlow, H20, etc
Used Key Value stores or noSQL databases
Good understanding of docker and container platforms like Mesos and Kubernetes
Security-first architecture approach
Application benchmarking and optimization
We are seeking a Senior Data Scientist with hands-on experience in Generative AI (GenAI) and Large Language Models (LLM). The ideal candidate will have expertise in building, fine-tuning, and deploying LLMs, as well as managing the lifecycle of AI models through LLMOps practices. You will play a key role in driving AI innovation, developing advanced algorithms, and optimizing model performance for various business applications.
Key Responsibilities:
- Develop, fine-tune, and deploy Large Language Models (LLM) for various business use cases.
- Implement and manage the operationalization of LLMs using LLMOps best practices.
- Collaborate with cross-functional teams to integrate AI models into production environments.
- Optimize and troubleshoot model performance to ensure high accuracy and scalability.
- Stay updated with the latest advancements in Generative AI and LLM technologies.
Required Skills and Qualifications:
- Strong hands-on experience with Generative AI, LLMs, and NLP techniques.
- Proven expertise in LLMOps, including model deployment, monitoring, and maintenance.
- Proficiency in programming languages like Python and frameworks such as TensorFlow, PyTorch, or Hugging Face.
- Solid understanding of AI/ML algorithms and model optimization.
What You will do
● Create beautiful software experiences for our customers using design thinking, lean and agile methodology.
● Design and develop software products from scratch using the latest cutting edge technologies, platforms and languages such as JAVA, python, Javascript, GoLang and Scala.
● Work in a dynamic, collaborative, transparent, non-hierarchical culture.
● Help to grow the next generation of developers and have a positive impact on the industry.
Basic Qualifications
● Experience: 8+ years.
● Engineering Degree in Computer Science OR Equivalent.
● Hands-on development experience with a broad mix of languages such as JAVA, Python, Javascript etc.
● Server-side development experience mainly in JAVA, (Python and nodeJS can be considerable)
● UI development experience in ReactJS or AngularJS or PolymerJS or EmberJS or Jquery etc.
● Passion for software engineering and follow the best coding concepts. ● Good to great problem solving and communication skills.
● Must have experience in technical architecture and design , code reviews and mentoring junior developers.
● Should have experience in stakeholder management and work along with architects as and when necessary to lead the project.
Nice to have Qualifications
● Product engineering and customer-centric mindset.
● Great OOP skills, including design patterns.
● Experience with devops, continuous integration & deployment.
● Exposure to big data technologies, Machine Learning and NLP will be a plus.
Benefits
● Competitive salary.
● Work from anywhere.
● Reimbursements for remote work set up.
● Insurance (including a top up insurance for COVID).
● Free Access to Online learning libraries such as O'reilly or equivalent Location Remote - work from anywhere
- 3 years of mandatory experience developing NMS(network management system) products for large networks.
- 3+ years of hands-on programming experience in Java and related technologies.
- 3+ years of experience using management protocols like Netconf/SNMP/YANG data modelling to interact with the Network elements and agent based monitoring.
- Extensive experience implementing FCAPS (Fault, Configuration, Accounting, Performance, Security).
- Good command on Algorithms and data structures, OOAD, Client-server systems, distributed systems and multithreaded programming.
- Hands-on experience with databases like Cassandra/MongoDB.
- Experience of establishing HA, Clustering, Redundancy, Stateful Failover through design / implementation / deployment.
- Experience of performance benchmarking and performance optimization.
- Experience working with micro-service architecture using Docker. Kubernetes is a plus.
- Working knowledge of messaging middleware like - Kafka, RabbitMQ.
- Experience of IPC libraries & protocols like gRPC/REST/JSON.
- Working knowledge of KPI Reporting, Troubleshooting & Log management - ELK, KPI Reporting, TSDB, Grafana.
- Experience in various Linux tools related to source code version control, code review, bug tracking, CI/CD, e.g. Git/Gerrit/Jira/Jenkins.
Merito is a curated talent platform where we identify, assess, and connect candidates for matching job opportunities. We are working with the mission to change the way hiring is done. The company is founded by a team of alumni from IIM Ahmedabad, McKinsey with more than 2 decades of experience in recruitment, training, and coaching.
About our client :
Our client is a global data and measurement-driven media agency whose mission is to make brands more valuable to the world. Clients include Google, Flipkart, NBCUniversal, L’Oréal and the Financial Times. The agency is more than 2,000 people strong, manages $4.5B in annualized media spend, and deploys campaigns in 121 markets via 22 offices in APAC, EMEA and the Americas.
About the role :-
Accountable for quantifying and measuring the success of our executions and for delivering insights that enable us to innovate the work we deliver. Leading and supporting multi project, be involved in external reviews if needed, developing new analytical tools.
Some of the things we’d like you to do:
● Support the leadership of the Analytics team
● Build a deep understanding of marketing plans and their objectives to help account teams build comprehensive measurement, and test & learn plans
● Assist clients with objective setting for marketing plans
● Play an instrumental role in evolving and designing new, innovative measurement tools. Managing the process through to delivery and take ownership of global roll out
● Oversee junior members of the team in the delivery of their responsibilities, ensuring quality and that deadlines are met
● Oversee the creation of clear and robust campaign reporting with valuable and actionable insights
● Recruit, manage, and mentor resource ensuring workflow is efficient throughout the team, as well as a high quality output is delivered.
A bit about yourself:
● At least 10 years of relevant experience
● Degree from a top-tier College
● Proficiency with systems such as SQL, Python, and R
● Expose to marketing campaign measurement (both Direct Response and Brand Awareness campaigns)
● Strong understanding of what data points can be collected and analyzed in a digital campaign, and how each data point should be analyzed
● Excellent at presenting data in a visually engaging and insightful manner that cuts through the noise
● Strong organizational and project management skills
● Ability to delegate effectively
● Established and professional communication, presentation, and motivational skills.
Minimum 5+ years in react
Must have worked on desktop application
Must have worked in frontend and backend both
5+ years of experience with React js, work closely with design, product management, and development teams to create elegant, usable, responsive, and interactive interfaces across multiple devices; experience with Electron js framework is a plus.
We are looking for a Digital Marketing Manager with a mix of creative and analytical skills to develop, implement, track and optimize our marketing campaigns across all digital channels.
About us
BetterInvest is an investment platform focused on generating passive income streams and building wealth for investors.
We at BetterInvest provides you a variety of alternate investment options which are focussed on generating passive income and helping investors achieve financial happiness. One of the first asset classes that we are launching is fractional ownership in Commercial Real Estate. We are enabling access to wealth creation opportunities that were previously available only to the top 1% of the population. We make commercial real estate investing easy, affordable and transparent.
Visit www.betterinvest.club to learn more.
Roles and responsibilities
- Build the overall digital strategy for the company
- Plan and execute digital marketing campaigns that generate potential leads to the product
- Responsible for the monthly budgets for the digital marketing
- Use analytics tools to monitor and do complete data analysis from website traffic till conversion
- Monitor campaign performance and identify opportunities for improvement and optimise campaigns accordingly
- Collaborate with team members on campaign development and implementation
- Measure campaign performance across channels and assess against goals
Requirements
- 3+ years of experience in a digital marketing role and B2C lead generation.
- Experience in running successful marketing campaigns across multiple channels and geographies.
- Deep understanding of paid campaign strategies across channels to drive revenue (Google Ads, Facebook and LinkedIn ads).
- Deep understanding of analytics tools to track and capture key data of the campaigns.
- Excellent verbal and written communication skills.
- Ability to take new initiatives and push the boundaries constantly.
AutoScheduler is looking for a remote Front-End Full-Stack Developer to join our talented team. The ideal candidate is a self-starter who is interested in constant learning. We want this person to join our dynamic team as we take an established software and re-develop it from scratch as a part of a new start up.
We are looking for a Front-End developer responsible for rebuilding the back-end and front-end components of the AutoScheduler user interface. Your primary responsibilities will be to design and develop these applications and services, and to coordinate with the rest of the team working on different layers of the infrastructure. Therefore, a commitment to collaborative problem solving, robust design, and quality product is essential.








