Spark Scala Developer

Senior BackEnd Engineer

The ideal candidate will have a strong background in building scalable applications, a deep understanding of back-end technologies, and experience with cloud infrastructure. As a Back End Engineer, you will be responsible for designing, developing, and maintaining a scalable workflow management system. You will work closely with cross-functional teams to build robust and efficient applications that meet the needs of our users. Your expertise in Scala, Python, AI Agents/APIs, and GCP will be crucial in ensuring our system is reliable, performant, and scalable.

Key Responsibilities:

Back-End Development:

• Build and maintain back-end services and APIs using Scala.
• Implement and optimize Orchestration workflow system involving database queries and operations.
• Build API integrations with Third Party APIs and services.
• Ensure robust and scalable server-side logic.

Cloud Integration:

• Deploy, manage, and monitor applications on Google Cloud Platform (GCP).
• Utilize GCP services to enhance application performance and scalability.
• Implement cloud-based solutions for data storage, processing, and analytics.

Collaboration And Communication:

• Work closely with cross-functional teams to define, design, and ship new features.
• Participate in code reviews and contribute to sharing team knowledge.
• Document development processes, coding standards, and project requirements.

Qualifications:

• Educational Background:
• Completed a masters/bachelor degree in Computer Science, Engineering, or a related field.
• Technical Skills:
• Proficiency in Scala programming language.
• Strong experience with React and ReactJS.
• Familiarity with Google Cloud Platform (GCP) and its services.
• Knowledge of front-end development tools and best practices.
• Understanding of RESTful API design and implementation.
• Soft Skills:
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration abilities.
• Eagerness to learn and adapt to new technologies and challenges.

Preferred Qualifications:

• Experience with version control systems such as Git.
• Familiarity with CI/CD pipelines and DevOps practices.
• Understanding of workflow management systems and their requirements.
• Experience with containerization technologies like Docker.

Must have Skills

• Scala - 4 Years
• React.Js - 1 Years
• RESTful API - 4 Years
• Docker - 2 Years
• Python - 3 Years
• Artificial Intelligence - 2 Years

Software Developer

Roles and Responsibilities

• Apply knowledge set to fetch data from multiple online sources, cleanse it and build APIs on top of it
• Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store
• We're looking for people who will naturally take ownership of data products and who can bring a project all the way from a fast prototype to production.

Desired Candidate Profile

• At Least 1-2 years of experience
• Strong coding experience in Python (knowledge of Javascripts is a plus)
• Strong knowledge of scraping frameworks in Python (Request, Beautiful Soup)
• Experience with SQL and NoSQL databases
• Knowledge in Version Control tools like GIT.
• Good understanding and hands-on with scheduling and managing tasks with cron.

Nice to have:

• Experience of having worked with elastic search
• Experience with multi-processing, multi-threading, and AWS/Azure is a plus
• Experience with web crawling is a plus
• Deploy server/related components to staging, live environments.
• Experience with cloud environments like AWS,etc as well as cloud solutions like Docker,Lambda, etc
• Experience in DevOps and related practices to improve development lifecycle, continuous delivery with high quality is an advantage.
• Compile and analyze data, processes, and codes to troubleshoot problems and identify areas for improvement

·      Core responsibilities to include analyze business requirements and designs for accuracy and completeness. Develops and maintains relevant product.

·      BlueYonder is seeking a Senior/Principal Architect in the Data Services department (under Luminate Platform ) to act as one of key technology leaders to build and manage BlueYonder’ s technology assets in the Data Platform and Services.

·      This individual will act as a trusted technical advisor and strategic thought leader to the Data Services department. The successful candidate will have the opportunity to lead, participate, guide, and mentor other people in the team on architecture and design in a hands-on manner. You are responsible for technical direction of Data Platform. This position reports to the Global Head, Data Services and will be based in Bangalore, India.

·      Core responsibilities to include Architecting and designing (along with counterparts and distinguished Architects) a ground up cloud native (we use Azure) SaaS product in Order management and micro-fulfillment

·      The team currently comprises of 60+ global associates across US, India (COE) and UK and is expected to grow rapidly. The incumbent will need to have leadership qualities to also mentor junior and mid-level software associates in our team. This person will lead the Data platform architecture – Streaming, Bulk with Snowflake/Elastic Search/other tools

Our current technical environment:

·      Software: Java, Springboot, Gradle, GIT, Hibernate, Rest API, OAuth , Snowflake

·      • Application Architecture: Scalable, Resilient, event driven, secure multi-tenant Microservices architecture

·      • Cloud Architecture: MS Azure (ARM templates, AKS, HD insight, Application gateway, Virtue Networks, Event Hub, Azure AD)

·      Frameworks/Others: Kubernetes, Kafka, Elasticsearch, Spark, NOSQL, RDBMS, Springboot, Gradle GIT, Ignite

Cloudera Data Warehouse Hive team looking for a passionate senior developer to join our growing engineering team. This group is targeting the biggest enterprises wanting to utilize Cloudera’s services in a private and public cloud environment. Our product is built on open source technologies like Hive, Impala, Hadoop, Kudu, Spark and so many more providing unlimited learning opportunities. 

A Day in the Life

Over the past 10+ years, Cloudera has experienced tremendous growth making us the leading contributor to Big Data platforms and ecosystems and a leading provider for enterprise solutions based on Apache Hadoop. You will work with some of the best engineers in the industry who are tackling challenges that will continue to shape the Big Data revolution.  We foster an engaging, supportive, and productive work environment where you can do your best work. The team culture values engineering excellence, technical depth, grassroots innovation, teamwork, and collaboration.

You will manage product development for our CDP components, develop engineering tools and scalable services to enable efficient development, testing, and release operations.  You will be immersed in many exciting, cutting-edge technologies and projects, including collaboration with developers, testers, product, field engineers, and our external partners, both software and hardware vendors.

Opportunity:

Cloudera is a leader in the fast-growing big data platforms market. This is a rare chance to make a name for yourself in the industry and in the Open Source world. The candidate will responsible for Apache Hive and CDW projects. We are looking for a candidate who would like to work on these projects upstream and downstream. If you are curious about the project and code quality you can check the project and the code at the following link. You can start the development before you join. This is one of the beauties of the OSS world. 

https://hive.apache.org/" target="_blank">Apache Hive

Responsibilities:

• Build robust and scalable data infrastructure software

• Design and create services and system architecture for your projects 

• Improve code quality through writing unit tests, automation, and code reviews

• The candidate would write Java code and/or build several services in the Cloudera Data Warehouse. 

• Worked with a team of engineers who reviewed each other's code/designs and held each other to an extremely high bar for the quality of code/designs

• The candidate has to understand the basics of Kubernetes.

• Build out the production and test infrastructure. 

• Develop automation frameworks to reproduce issues and prevent regressions.

• Work closely with other developers providing services to our system.

• Help to analyze and to understand how customers use the product and improve it where necessary.  

Qualifications:

• Deep familiarity with Java programming language.

• Hands-on experience with distributed systems. 

• Knowledge of database concepts, RDBMS internals.

• Knowledge of the Hadoop stack, containers, or Kubernetes is a strong plus.  

• Has experience working in a distributed team. 

• Has 3+ years of experience in software development.

AutoScheduler is looking for a remote senior software developer to join our talented team. The ideal candidate is a self-starter who is interested in constant learning. We want this person to join our dynamic team as we take an established software and re-develop it from scratch as a part of a new start up.

We are looking for a Backend C++ developer responsible for maintaining and developing algorithmic C++ for new and existing customers. Your primary responsibilities will be to design and develop applications and services, and to coordinate with the rest of the team working on different layers of the infrastructure. Therefore, a commitment to collaborative problem solving, robust design, and quality product is essential.

• Work with non-technical personnel to translate business requirements into stories and epics
• Translate application storyboards and use cases into functional applications / features
• Design, build, and maintain efficient, reusable, and reliable code
• Ensure the best possible performance, quality, and responsiveness of applications
• Identify bottlenecks and bugs, and devise solutions to these problems
• Help maintain code quality, organization, and automation
• Write and maintain unit/functional/integration tests

• Bachelor’s degree with STEM concentration + 2 years’ work experience, or equivalent work experience
• Fluent in English
• Demonstrably proficient in C/C++ and the ability to parse C/C++ code
• Proficiency in Node.js and Javascript
• Basic understanding of Common Language Runtime (CLR), its limitations, weaknesses, and workarounds
• Working knowledge of at least two other programming languages (e.g. Go and Python)
• Proficient understanding of modern distributed code versioning tools (like ‘git’)
• Thorough understanding of SQL, and in-depth experience with at least one RDBMS (e.g. PostgreSQL or Microsoft SQL Server)
• Experience with automated testing frameworks and unit tests
• Solid understanding of object-oriented programming and principles
• Knowledge of functional programming principals / concepts

• Experience building applications with C++
• Experience building cross-platform applications with Scala
• Experience with functional programming
• Familiarity with concurrency patterns in Scala
• Experience building distributed systems and/or decoupled microservices
• Experience building software using cloud-based services (in any cloud platform)
• Experience using “gRPC” and Protocol Buffers (“protobuf”) and/or experience creating services that exchange non-JSON data over non-HTTP protocols
• Familiarity with continuous integration
• Familiarity with Docker / containerization