Big Data

We are seeking a skilled Java Developer with hands-on experience in Java and Spark to build scalable data processing solutions. You'll contribute to high-performance data pipelines and analytics platforms in a dynamic Agile environment.

Key Responsibilities

• Design and develop Java applications integrated with Apache Spark for ETL processes, data transformations, and analytics.
• Build and optimize Spark jobs (Spark SQL, DataFrames, Streaming) for large-scale data processing.
• Collaborate with data engineers and analysts to implement robust data workflows.
• Write clean, maintainable Java code following best practices (Spring Boot, Microservices preferred).
• Perform code reviews, unit testing, and contribute to CI/CD pipelines.
• Troubleshoot and optimize Spark performance for production workloads.
• Document technical solutions and mentor junior developers.

Required Skills & Qualifications

• 4-7 years of hands-on Java development experience.
• Strong expertise in Apache Spark (Spark Core, Spark SQL, PySpark basics).
• Proficiency in Java 8/11+ with multithreading and collections frameworks.
• Experience with data processing (ETL, data pipelines, big data).
• Familiarity with build tools (Maven/Gradle) and version control (Git).
• Strong problem-solving skills and Bangalore location availability.
• Excellent communication skills for cross-team collaboration.

Good to Have

• Experience with Snowflake for cloud data warehousing.
• Knowledge of DBT (Data Build Tool) for analytics engineering.
• Python scripting for data manipulation and automation.
• Exposure to AWS/GCP/Azure cloud platforms.
• Familiarity with Kafka, Airflow, or containerization (Docker/Kubernetes).

About the Role-

Thinking big and executing beyond what is expected. The challenges cut across algorithmic problem solving, systems engineering, machine learning and infrastructure at a massive scale.

Reason to Join-

An opportunity for innovators, problem solvers & learners.  Working will be Innovative, empowering, rewarding & fun. Amazing Office, competitive pay along with excellent benefits package.

Requiremets and Responsibilities- (please read carefully before applying)

• The overall experience of 3-6 years in Java/Python Framework and Machine Learning.
• Develop Web Services, REST, XSD, XML technologies, Java, Python, AWS, API.
• Experience on Elastic Search or SOLR or Lucene -Search Engine, Text Mining, Indexing.
• Experience in highly scalable tools like Kafka, Spark, Aerospike, etc.
• Hands on experience in Design, Architecture, Implementation, Performance & Scalability, and Distributed Systems.
• Design, implement, and deploy highly scalable and reliable systems.
• Troubleshoot Solr indexing process and querying engine.
• Bachelors or Masters in Computer Science from Tier 1 Institutions

• Candidate Should have 5+ Years Of Experience in Core Java
• You will need strong development skills to work on and improve our Scala-based services, and be able to work together with senior teammates to create appropriate architectural design and ensure all aspects are appropriate to meet the business need.
• Excellent Functional Design and Functional Programming skills (more than 2 years of business experience in Scala and Java projects, respectively)
• Core skills in key supporting technologies and/or frameworks such as Play (AKKA) / Lagom
• Proven experience working in teams in the successful delivery of complex, performant and high quality products
• Excellent spoken and written communication skills
• Experience of SaaS (Software as a Service) environments
• Exposure to RESTful web APIs and a service oriented architecture
• Experience in Linux environments, Shell scripting etc
• Working with XML and JSON including parsing, asserting / matching and extracting
• Experience with Continuous Integration environments and build tools, including Terraform, Jenkins, Maven, Gradle and Ant
• Experience with messaging systems such as Apache Kafka, Amazon Kinesis, Amazon SQS and Rabbit MQ
• Experience working on Live platform SDKs such as Twilio, AWS Elemental

4-5 years of overall experience in software development.
- Experience on Hadoop (Apache/Cloudera/Hortonworks) and/or other Map Reduce Platforms
- Experience on Hive, Pig, Sqoop, Flume and/or Mahout
- Experience on NO-SQL – HBase, Cassandra, MongoDB
- Hands on experience with Spark development,  Knowledge of Storm, Kafka, Scala
- Good knowledge of Java
- Good background of Configuration Management/Ticketing systems like Maven/Ant/JIRA etc.
- Knowledge around any Data Integration and/or EDW tools is plus
- Good to have knowledge of  using Python/Perl/Shell

Please note - Hbase hive and spark are must.

Experience:

The candidate should have about 1+ years of experience with design and development in Java/Scala. Experience in algorithm, data-structure, database is mandatory.

Required Skills:

1. Java or Scala
2. Extensive experience in developing web applications. Should possess good Oops knowledge and be aware of enterprise application design patterns.
3. Should have the ability to analyze, design, develop and test complexity of spark job.
4. Basic working knowledge of Unix/Linux.

Good To have: -

1. Python
2. Distributed Computing

AutoScheduler is looking for a remote senior software developer to join our talented team. The ideal candidate is a self-starter who is interested in constant learning. We want this person to join our dynamic team as we take an established software and re-develop it from scratch as a part of a new start up.

We are looking for a Backend C++ developer responsible for maintaining and developing algorithmic C++ for new and existing customers. Your primary responsibilities will be to design and develop applications and services, and to coordinate with the rest of the team working on different layers of the infrastructure. Therefore, a commitment to collaborative problem solving, robust design, and quality product is essential.

• Work with non-technical personnel to translate business requirements into stories and epics
• Translate application storyboards and use cases into functional applications / features
• Design, build, and maintain efficient, reusable, and reliable code
• Ensure the best possible performance, quality, and responsiveness of applications
• Identify bottlenecks and bugs, and devise solutions to these problems
• Help maintain code quality, organization, and automation
• Write and maintain unit/functional/integration tests

• Bachelor’s degree with STEM concentration + 2 years’ work experience, or equivalent work experience
• Fluent in English
• Demonstrably proficient in C/C++ and the ability to parse C/C++ code
• Proficiency in Node.js and Javascript
• Basic understanding of Common Language Runtime (CLR), its limitations, weaknesses, and workarounds
• Working knowledge of at least two other programming languages (e.g. Go and Python)
• Proficient understanding of modern distributed code versioning tools (like ‘git’)
• Thorough understanding of SQL, and in-depth experience with at least one RDBMS (e.g. PostgreSQL or Microsoft SQL Server)
• Experience with automated testing frameworks and unit tests
• Solid understanding of object-oriented programming and principles
• Knowledge of functional programming principals / concepts

• Experience building applications with C++
• Experience building cross-platform applications with Scala
• Experience with functional programming
• Familiarity with concurrency patterns in Scala
• Experience building distributed systems and/or decoupled microservices
• Experience building software using cloud-based services (in any cloud platform)
• Experience using “gRPC” and Protocol Buffers (“protobuf”) and/or experience creating services that exchange non-JSON data over non-HTTP protocols
• Familiarity with continuous integration
• Familiarity with Docker / containerization

Spark / Scala experience should be more than 2 years.

Combination with Java & Scala is fine or we are even fine with Big Data Developer with strong Core Java Concepts. - Scala / Spark Developer.

Strong proficiency Scala on Spark (Hadoop) - Scala + Java is also preferred

Complete SDLC process and Agile Methodology (Scrum)

Version control / Git