We are looking for a Spark developer who knows how to fully exploit the potential of our Spark cluster. You will clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data to our feature developers and business analysts. This involves both ad-hoc requests as well as data pipelines that are embedded in our production
Requirements:
The candidate should be well-versed in the Scala programming language Should have experience in Spark Architecture and Spark Internals Exp in AWS is preferable Should have experience in the full life cycle of at least one big data application
About Innova Solutions
About
Connect with the team
Company social profiles
Similar jobs
RESPONSIBILITIES:
- Oversee the sales process to attract new clients.
- Work with senior team members to identify and manage risks.
- Maintain fruitful relationships with clients and address their needs effectively.
- Prepare and deliver pitches to potential investors.
- Foster a collaborative environment within the organization.
- Transfer call to the supervisor after initial explanation.
SKILLS:
- Excellent spoken English.
- Both Graduate/Undergraduate may apply.
- Ability to develop good relationships with current and potential clients.
- Excellent communication skills.
- Knowledge of productivity tools and software.
- Ready to work in Nightshift.
Salary: 12,000.00 - 27,500.00 per month
Role: Business Development Executive (BDE)
Industry Type: BPO / Call Centre
Department: Sales & Business Development
Employment Type: Full Time, Permanent
Role Category: BD / Pre Sales
Education
UG: Graduation Not Required
AWS Glue Developer
Work Experience: 6 to 8 Years
Work Location: Noida, Bangalore, Chennai & Hyderabad
Must Have Skills: AWS Glue, DMS, SQL, Python, PySpark, Data integrations and Data Ops,
Job Reference ID:BT/F21/IND
Job Description:
Design, build and configure applications to meet business process and application requirements.
Responsibilities:
7 years of work experience with ETL, Data Modelling, and Data Architecture Proficient in ETL optimization, designing, coding, and tuning big data processes using Pyspark Extensive experience to build data platforms on AWS using core AWS services Step function, EMR, Lambda, Glue and Athena, Redshift, Postgres, RDS etc and design/develop data engineering solutions. Orchestrate using Airflow.
Technical Experience:
Hands-on experience on developing Data platform and its components Data Lake, cloud Datawarehouse, APIs, Batch and streaming data pipeline Experience with building data pipelines and applications to stream and process large datasets at low latencies.
➢ Enhancements, new development, defect resolution and production support of Big data ETL development using AWS native services.
➢ Create data pipeline architecture by designing and implementing data ingestion solutions.
➢ Integrate data sets using AWS services such as Glue, Lambda functions/ Airflow.
➢ Design and optimize data models on AWS Cloud using AWS data stores such as Redshift, RDS, S3, Athena.
➢ Author ETL processes using Python, Pyspark.
➢ Build Redshift Spectrum direct transformations and data modelling using data in S3.
➢ ETL process monitoring using CloudWatch events.
➢ You will be working in collaboration with other teams. Good communication must.
➢ Must have experience in using AWS services API, AWS CLI and SDK
Professional Attributes:
➢ Experience operating very large data warehouses or data lakes Expert-level skills in writing and optimizing SQL Extensive, real-world experience designing technology components for enterprise solutions and defining solution architectures and reference architectures with a focus on cloud technology.
➢ Must have 6+ years of big data ETL experience using Python, S3, Lambda, Dynamo DB, Athena, Glue in AWS environment.
➢ Expertise in S3, RDS, Redshift, Kinesis, EC2 clusters highly desired.
Qualification:
➢ Degree in Computer Science, Computer Engineering or equivalent.
Salary: Commensurate with experience and demonstrated competence
Desired Experience
3+ years
Job Description
What You’ll Do
- Design financial systems for scale. Measure, plan, iterate.
- Writing reusable, testable, and efficient code
- Design and implementation of low-latency, high-availability, and performant applications
- Setup and own the engineering architectures built around event sourcing, application sharding, database sharding, service communication mesh, etc.
- The tech: Go, Google Cloud Spanner, Kafka, Redis
What you bring to the table
- 3+ years of experience. Relevant experience is preferred.
- Knowledge of 2 common programming languages - Python & Go / Java & Node / Rust
- Comfortable in linux command line, AWS or GCP
- Strong unit test and debugging skills
- Great communication skills
Bonus if you have…
- Love building great products and engineering systems from scratch
- Are a Self-starter, Hustler and Curious to Learn
- Have an understanding of fundamental design principles behind a scalable application
- Thrive in an early-stage startup environment with less stability and more ambiguity
- Have an interest in financial products and/or cryptocurrency
Required a full stack Senior SDE with focus on Backend microservices/ modular monolith with 3-4+ years of experience on the following:
- Bachelor’s or Master’s degree in Computer Science or equivalent industry technical skills
- Mandatory In-depth knowledge and strong experience in Python programming language.
- Expertise and significant work experience in Python with Fastapi and Async frameworks.
- Prior experience building Microservice and/or modular monolith.
- Should be an expert Object Oriented Programming and Design Patterns.
- Has knowledge and experience with SQLAlchemy/ORM, Celery, Flower, etc.
- Has knowledge and experience with Kafka / RabbitMQ, Redis.
- Experience in Postgres/ Cockroachdb.
- Experience in MongoDB/DynamoDB and/or Cassandra are added advantages.
- Strong experience in either AWS services (e.g, EC2, ECS, Lambda, StepFunction, S3, SQS, Cognito). and/or equivalent Azure services preferred.
- Experience working with Docker required.
- Experience in socket.io added advantage
- Experience with CI/CD e.g. git actions preferred.
- Experience in version control tools Git etc.
This is one of the early positions for scaling up the Technology team. So culture-fit is really important.
- The role will require serious commitment, and someone with a similar mindset with the team would be a good fit. It's going to be a tremendous growth opportunity. There will be challenging tasks. A lot of these tasks would involve working closely with our AI & Data Science Team.
- We are looking for someone who has considerable expertise and experience on a low latency highly scaled backend / fullstack engineering stack. The role is ideal for someone who's willing to take such challenges.
- Coding Expectation – 70-80% of time.
- Has worked with enterprise solution company / client or, worked with growth/scaled startup earlier.
- Skills to work effectively in a distributed and remote team environment.
• Support in Upfront Technical Architecture and high level design to ensure
that the product meets manufacturability, Serviceability, performance,
reliability, cost, feature set ETC.
• Work with the team of design engineers for designing of analog and digital
circuits which meets functional, reliability, manufacturability, testing and
ergonomic requirements.
• Expected to maintain and improve systems and development processes.
• Manage the projects and ensure timely delivery
Experience : 3 to 7 Years
Number of Positions : 20
Job Location : Hyderabad
Notice : 30 Days
1. Expertise in building AWS Data Engineering pipelines with AWS Glue -> Athena -> Quick sight
2. Experience in developing lambda functions with AWS Lambda
3. Expertise with Spark/PySpark – Candidate should be hands on with PySpark code and should be able to do transformations with Spark
4. Should be able to code in Python and Scala.
5. Snowflake experience will be a plus
Hadoop and Hive requirements as good to have or understanding of is enough.
We are looking for a highly capable Node.js developer to optimize our web-based application performance. You will be collaborating with our front-end application developers, designing APIs, and integrating data storage and protection solutions.
Requirements
- Minimum of two years previous experience as a Node.js developer.
- Minimum of two years of experience developing applications using MongoDB.
- Minimum of one year of experience developing applications using ExpressJs.
- Extensive knowledge of JavaScript, web stacks, libraries, and frameworks.
- Exceptional analytical and problem-solving aptitude.
- Great organizational and time management skills.
- Availability to resolve urgent web application issues outside of business hours.
Responsibility
- Ensuring optimal performance of the central database and responsiveness to front-end requests.
- Collaborating with front-end developers on the integration of the APIs.
- Developing high-performance applications by writing testable, reusable, and efficient code.
- Implementing effective security protocols, data protection measures, and storage solutions.
- Running diagnostic tests and identifying bugs.
- Documenting Node.js processes, including database schemas.
- Recommending and implementing improvements to APIs.
- Responsible for client engagement & Manage the requirements
- Communicate with clients to identify their requirements and choice of property
- Coordinate the builder to arrange for the site visit and share the necessary information to clients
- Visit the connected properties and identify the USPs to pitch better to clients
- Manage the feedback from the client
- Understand the real estate market & comparison of the product
- Maintain good business relationship with client and builder
- Participate in seminars, conferences, and events to enhance the market & expand the business network
- Work with the team to share the responsibilities and work towards achieving team’s targets
We are looking to hire QA engineer to assess software quality through manual and automated testing. You will be responsible for our existing team and helping them to finding bugs and glitches.
Responsibility:
- Review and analyze system specifications
- Collaborate with QA Engineers to develop effective strategies and test plans
- Execute test cases (manual or automated) and analyze results
- Evaluate product code according to specifications
- Create logs to document testing phases and defects
- Report bugs and errors to development teams
- Help troubleshoot issues
- Conduct post-release/ post-implementation testing.
Require Skills:
- Proven 4 year of experience of team lead position in Quality Analyst
- Experience in project management and QA methodology.
- Ability to document and troubleshoot errors .
- Working experience in selenium .
- Excellent communication skills.
- Should have leadership quality.
Benefit :
- Monday to Friday working .
- Flexible working hour.
- Hassle free working environment.
Producing sample sites
Meeting with clients to discuss requirements and/or project progress
HTML / CSS conversion of the design
Website Hosting