Amazon Web Services (AWS)Profile: AWS Data Engineer
Mandate skills :AWS + Databricks + Pyspark + SQL role
Location: Bangalore/Pune/Hyderabad/Chennai/Gurgaon:
Notice Period: Immediate
Key Requirements :
- Design, build, and maintain scalable data pipelines to collect, process, and store from multiple datasets.
- Optimize data storage solutions for better performance, scalability, and cost-efficiency.
- Develop and manage ETL/ELT processes to transform data as per schema definitions, apply slicing and dicing, and make it available for downstream jobs and other teams.
- Collaborate closely with cross-functional teams to understand system and product functionalities, pace up feature development, and capture evolving data requirements.
- Engage with stakeholders to gather requirements and create curated datasets for downstream consumption and end-user reporting.
- Automate deployment and CI/CD processes using GitHub workflows, identifying areas to reduce manual, repetitive work.
- Ensure compliance with data governance policies, privacy regulations, and security protocols.
- Utilize cloud platforms like AWS and work on Databricks for data processing with S3 Storage.
- Work with distributed systems and big data technologies such as Spark, SQL, and Delta Lake.
- Integrate with SFTP to push data securely from Databricks to remote locations.
- Analyze and interpret spark query execution plans to fine-tune queries for faster and more efficient processing.
- Strong problem-solving and troubleshooting skills in large-scale distributed systems.
Shubham Vishwakarma
Full Stack Developer - Averlon
About Deqode
About
At Deqode, our purpose is to help businesses solve complex problems using new-age technologies. We provide enterprise blockchain solutions to businesses.
Connect with the team
Company social profiles
Similar jobs
Python
Django
FlaskWe are seeking enthusiastic and driven interns with strong technical expertise to join our team in Bangalore. The ideal candidate should possess:
- Proficiency in Python programming.
- Hands-on experience with Automation Anywhere, UiPath, and A360.
- A solid engineering background.
- Ability to join immediately and work collaboratively on challenging projects.
This is an excellent opportunity to gain practical experience and grow your skills in automation and programming.
Requirements:
● A minimum of 2 years of experience leading Quality assurance engineers (both automation and manual)
● Should have previously hired Quality engineers
● A minimum of 2 years of experience with automation (Setting up automation, creating test cases, writing test scripts and executing them with any automation suite)
● A minimum of 1 year of experience with manual testing
● Must be able to figure out tools required for a Test Suite and set them up and ensure they are being used properly
● Must ensure test plans are made, maintained and executed
● Must ensure defects are communicated effectively and well maintained
● Must be able to plan what needs to be automated and guide the team to
ensure maximum test coverage - Should be able to reduce the time taken for testing with this
PHP
HTML/CSS
Javascript
AngularJS (1.x)
Angular (2+)HTML/CSS
SASSExperience: 3.5 - 5 years
Description :
- Very good experience in design and development on UI front end Technologies.
- Minimum 3+ Years of web application development using HTML 5, CSS3, Bootstrap, JavaScript.
- Experience in development of Angular 2/4/6.
- Expertise in Responsive web design, HTML5, and CSS pre-processors SASS and LESS
- Good in UML, OOPS, design principles and patterns, architectural trends and data modeling.
- Strong in JavaScript (object oriented concepts) & JavaScript optimization
- Experience on JavaScript frameworks such as AngularJS, ReactJS, NodeJS etc.
- Ability to convert Wireframes in to UI design
- Good designing capabilities using Bootstrap framework, SEO and using strategies for cross-platform design initiatives with a 360-degree digital design
- Strong experience with debugging skills and fixing Cross Browser Compatibility issues and Optimization for web by using best practices
- Good Communication
- Good knowledge of quality standards and best practice
Kubernetes
DockerSr Enterprise Software Architect with Cloud skills and preferably having either a GCP Associate or Professional Certification.
The requirement is to understand existing Enterprise Applications and help design a solution to enable Load balancing & Auto Scaling the application to meet certain KPIs.
Should be well versed with
- Designing and Deploying Large enterprise software in Cloud
- Understands Cloud fundamentals
- DevOps & Kubernetes
- Experience deploying cloud applications and monitoring operations
- Preferably Google Cloud
- Associate or Professional Certification.
KubernetesCompany Description
Smarsh is the leader in communications compliance, archiving, and analytics. We provide compliance across the broadest set of communications channels with insights on what’s being captured. Smarsh customers manage over 500 million daily conversations across 80 channels and growing. Customers include the top 10 U.S., top 8 European, top 5 Canadian, and top 3 Asian banks. The Smarsh advantage is customers stay ahead of compliance and uncover patterns and relationships hidden within their data.
At Smarsh , we’ve been helping our customers manage new forms of communication since 1998. We work closely with regulators including the SEC, FINRA, IIROC, and the PRA and FCA, and with our customers, to ensure that they understand the capabilities of today’s technology and that our platform meets their most stringent requirements. Our products include Connected Capture, Connected Archive, Web Archive & Business Solutions.
About the team
Are you an SRE with excellent Observability, Containerization and Orchestration skills? As a Site Reliability Engineer (SRE) in the Smarsh SaaS Operations team, you'll be part of a team who measures and improves production performance reliability through sustainable engineering practices for our suite of applications. Toil will be your number one enemy, observability your closest friend and your mission will be to drive operational burden as close to zero as you can.
Responsibilities
- Responsible for technical direction at the platform solutions level. Is able to weigh the pros and cons of various solutions and credibly argue for the best path
- Work closely with Product Management and the rest of the engineering team to define features and their implementations with careful attention to quality, scalability, and maintainability
- Can break down complex technical solutions into abstractions that the rest of the team and understand
- Can investigate and solve complex bugs, performance, and scalability issues
- Collaborates with multiple agile teams to ensure their solutions integrate effectively
- Track work in ticketing system (JIRA)
- Participate in Pull Request reviews. Provide and receive feedback to continuously improve.
- Other duties as assigned.
Desired skills & experience
- A minimum 10+ years industry experience
- Masters in CS or equivalent
- Must have experience in Azure or AWS, either running some large-scale app there or migrating to Azure/AWS.
- Experience operating Cloud Foundry in production environments
- Experience managing CI/CD systems (Concourse, Jenkins, TravisCI etc.)
- Experience deploying and/or operating ELK stack
- Experience with container technologies and orchestration platforms (Docker, Kubernetes, Cloud Foundry)
- Experience working with monitoring and observability tools (We use Datadog and New Relic)
- Familiarity with working with PostgreSQL and MongoDB
- Background working in a multi-platform environment (Linux, Windows)
- Experience with running on a cloud platform, AWS preferred (S3, RDS, SQS)
- Familiarity with Agile/Scrum/Kanban methodologies
- Familiarity with programming/scripting languages (ie. Python, Bash, PowerShell, Go, etc.)
Additional Skills
- Expert programming skills in relevant languages
- Exceptional analytical and problem-solving skills
- Strong communication and collaboration skills
- Deep understanding of modern software architecture
- Deep domain knowledge of the industry, platform, and existing processes
- Fault-tolerant design & maintenance
- Knowledge and understanding of modern software programming/engineering.
- Product delivery lifecycle - requirement refinement through ops
Why Smarsh?
Ready to join a thriving tech company that’s redefining digital archiving and business intelligence?
Smarsh is the leading comprehensive archiving platform. Recognized as one of today’s fastest growing companies in the U.S., Smarsh delivers innovative cloud-based solutions that help organizations manage and enforce flexible and secure records retention and compliance strategies for electronic communications, including social media and enterprise social networks (Yammer, Chatter, Facebook, LinkedIn and more).
Our motto is ‘People First. Inspire Confidence. Embrace the Impossible.’ We hire lifelong learners who have a passion for their discipline and a track record of excellence. To learn more about us, visit www.smarsh.com/careers
NodeJS (Node.js)Javascript
Git
PostgreSQL
Senior Node JS developer
Job Description
- Working experience in Nodejs, MySQL, Postgres SQL
- Good knowledge of designing and writing restful API
- Working experience of GIT
- Will prefer candidates who have knowledge of GraphQL, Typescript
- Well-versed and experienced with unit testing, code coverage.
- Well versed with SOILD design principles and their application
- Knowledge of AuthO, typeORM required
- Good to have – some experience with Azure DevOps and/or azure functions.
-Working experience on Docker- good to have
Java
Spring BootSkill JD Description:
- Hands on experience in Java 7 or 8 with good working knowledge of JSON, Spring, OOPS, Hibernate frameworks, JPA, REST Services and Redis Cache.
- Should know the concepts of Data Structure and OOPS concept
- Good understanding and working experience with RDBMS i.e. Oracle, MySQL and MSSQL
- Should have good coding skills and able to think analytically on compiled code
- Should have working knowledge of SpringBoot and Hibernate
- Microservices and JPA is good to have and shall have added advantage
- Java 7 or 8
- Spring boot
- Hibernate
- Microservices
- JPA
JavaJavascriptExperience: Minimum 1-2 Years
Location: Noida ( Permanent WFH)
Please find the JD :
- Expertise in ServiceNow Administration & Development
- Thorough understanding of ITIL/ITSM processes.
- Strong understanding of ServiceNow development platform including but not limited to ITSM, CMDB, change management, Problem management, custom development, etc.
- Ability to work on Servicenow enhancement requests in Jira.
- Manages and resolves incidents against ServiceNow applications
- Manages Instance Security, User/Group Access/Access Control Lists
- Performs routine maintenance to include performance monitoring and error identification/ remediation
- Leads ServiceNow upgrade planning and execution
- Schedules and verifies instance clones
- Manages Update Set creation and migration
- Minimum 1-3 years of experience in ServiceNow configuration and administration.
- Provide Level 2 support on ServiceNow platform for users
- Strong working knowledge of ServiceNow components such as Service Catalog, Change Management, workflow management, orchestration, Cloud provisioning, etc.
- Perform core configuration tasks such as Add users, group, create workflow activities, configure alerts and notifications View, perform instance branding and customization, Monitor health, usage, and overall compliance of the application
- Experience in Platform Upgrades will be an added advantages
- Knowledge of scripting ( JAVA ) and APIs would be desired
C#
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon