Cloud Application Architect

Description: 

As a Data Engineering Lead at Company, you will be at the forefront of shaping and managing our data infrastructure with a primary focus on Google Cloud Platform (GCP). You will lead a team of data engineers to design, develop, and maintain our data pipelines, ensuring data quality, scalability, and availability for critical business insights. 

Key Responsibilities: 

1. Team Leadership: 

a. Lead and mentor a team of data engineers, providing guidance, coaching, and performance management. 

b. Foster a culture of innovation, collaboration, and continuous learning within the team. 

2. Data Pipeline Development (Google Cloud Focus): 

a. Design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP) using services such as BigQuery, Dataflow, and Dataprep.

b. Implement best practices for data extraction, transformation, and loading (ETL) processes on GCP. 

3. Data Architecture and Optimization: 

a. Define and enforce data architecture standards, ensuring data is structured and organized efficiently. 

b. Optimize data storage, processing, and retrieval for maximum 

performance and cost-effectiveness on GCP. 

4. Data Governance and Quality: 

a. Establish data governance frameworks and policies to maintain data quality, consistency, and compliance with regulatory requirements. b. Implement data monitoring and alerting systems to proactively address data quality issues. 

5. Cross-functional Collaboration: 

a. Collaborate with data scientists, analysts, and other cross-functional teams to understand data requirements and deliver data solutions that drive business insights. 

b. Participate in discussions regarding data strategy and provide technical expertise. 

6. Documentation and Best Practices: 

a. Create and maintain documentation for data engineering processes, standards, and best practices. 

b. Stay up-to-date with industry trends and emerging technologies, making recommendations for improvements as needed. 

Qualifications 

● Bachelor's or Master's degree in Computer Science, Data Engineering, or related field. 

● 5+ years of experience in data engineering, with a strong emphasis on Google Cloud Platform. 

● Proficiency in Google Cloud services, including BigQuery, Dataflow, Dataprep, and Cloud Storage. 

● Experience with data modeling, ETL processes, and data integration. ● Strong programming skills in languages like Python or Java. 

● Excellent problem-solving and communication skills. 

● Leadership experience and the ability to manage and mentor a team.

5+ years of experience designing, developing, validating, and automating ETL processes 3+ years of experience traditional ETL tools such as Visual Studio, SQL Server Management Studio, SSIS, SSAS and SSRS 2+ years of experience with cloud technologies and platforms, such as: Kubernetes, Spark, Kafka, Azure Data Factory, Snowflake, ML Flow, Databricks, Airflow or similar Must have experience with designing and implementing data access layers Must be an expert with SQL/T-SQL and Python Must have experience in Kafka Define and implement data models with various database technologies like MongoDB, CosmosDB, Neo4j, MariaDB and SQL Serve Ingest and publish data from sources and to destinations via an API Exposure to ETL/ELT with using Kafka or Azure Event Hubs with Spark or Databricks is a plus Exposure to healthcare technologies and integrations for FHIR API, HL7 or other HIE protocols is a plus

Skills Required :

Designing, Developing, ETL, Visual Studio, Python, Spark, Kubernetes, Kafka, Azure Data Factory, SQL Server, Airflow, Databricks, T-SQL, MongoDB, CosmosDB, Snowflake, SSIS, SSAS, SSRS, FHIR API, HL7, HIE Protocols

Role : Web Scraping Engineer

Experience : 2 to 3 Years

Job Location : Chennai

About OJ Commerce: 

OJ Commerce (OJC), a rapidly expanding and profitable online retailer, is headquartered in Florida, USA, with a fully-functional office in Chennai, India. We deliver exceptional value to our customers by harnessing cutting-edge technology, fostering innovation, and establishing strategic brand partnerships to enable a seamless, enjoyable shopping experience featuring high-quality products at unbeatable prices. Our advanced, data-driven system streamlines operations with minimal human intervention.

Our extensive product portfolio encompasses over a million SKUs and more than 2,500 brands across eight primary categories. With a robust presence on major platforms such as Amazon, Walmart, Wayfair, Home Depot, and eBay, we directly serve consumers in the United States.

As we continue to forge new partner relationships, our flagship website, www.ojcommerce.com, has rapidly emerged as a top-performing e-commerce channel, catering to millions of customers annually.

Job Summary:

We are seeking a Web Scraping Engineer and Data Extraction Specialist who will play a crucial role in our data acquisition and management processes. The ideal candidate will be proficient in developing and maintaining efficient web crawlers capable of extracting data from large websites and storing it in a database. Strong expertise in Python, web crawling, and data extraction, along with familiarity with popular crawling tools and modules, is essential. Additionally, the candidate should demonstrate the ability to effectively utilize API tools for testing and retrieving data from various sources. Join our team and contribute to our data-driven success!

Responsibilities:

• Develop and maintain web crawlers in Python.
• Crawl large websites and extract data.
• Store data in a database.
• Analyze and report on data.
• Work with other engineers to develop and improve our web crawling infrastructure.
• Stay up to date on the latest crawling tools and techniques.

Required Skills and Qualifications:

• Bachelor's degree in computer science or a related field.
• 2-3 years of experience with Python and web crawling.
• Familiarity with tools / modules such as
• Scrapy, Selenium, Requests, Beautiful Soup etc.
• API tools such as Postman or equivalent. 
• Working knowledge of SQL.
• Experience with web crawling and data extraction.
• Strong problem-solving and analytical skills.
• Ability to work independently and as part of a team.
• Excellent communication and documentation skills.

What we Offer

• Competitive salary

• Medical Benefits/Accident Cover

• Flexi Office Working Hours

• Fast paced start up

Looking for a .Net Engineer | Bangalore to join a team of rockstar developers. The candidate should have a minimum of 2+ yrs. of experience in .Net Core.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of development experience + work with F500 companies (our customers).

Company Background - CodeVyasa is a Software Product-Engineering and Development company that helps Early-stage & Mid-Market Product companies with IT Consulting, App Development, and On-demand Tech Resources. Our Journey over the last 3 years has been nothing short of a roller-coaster. Along our way, we've won some of the most prestigious awards while driving immense value to our customers & employees. Here's the link to our website (codevyasa.com). To give you a sense of our growth rate, we've added 70+ employees in the last 6 weeks itself and expect another 125+ by the end of Q1 2024

Requirements:

•   Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent experience).
•   Minimum of 2 years of experience as a .Net Developer
•   Proficiency in MVC Framework, WEBAPI, Webform, C#.
•   Aptitude for learning new technologies quickly.
•   Good problem-solving and analytical skills.

What We Offer:

•   Glassdoor rating of 4.8, indicating high employee satisfaction.
•   Free healthcare benefits.
•   Strong focus on upskilling and professional development opportunities.
•   Diverse and inclusive work environment.
•   Competitive compensation and benefits package.
•   Emphasis on maintaining a healthy work-life balance.

The Incumbent will:  Be the key person accountable for Project Delivery- managing end to end delivery of high quality projects, meeting all required functionality, within allocated schedule and budget.  Managing the team assigned to deliver projects and achieve assigned project goals.  Be responsible to ensure continued customer delight.

 Own the entire delivery of assigned projects.  Responsible for managing multiple projects involving 15-20-member team consisting of middle layer (PL/GL/TL) and the teams under them.  Responsible for the end to end delivery; ensuring that Project Delivery Metrics are controlled throughout the project lifecycle. Tracking project requirements and implementation throughout different phases.  Participate in business meetings with Function/Delivery Heads; review contracts, carry out risk analysis and mitigation exercises and update the Management on the same.  Project managers should have strong business management, budgeting and analytical skills.  Review and ensure the preparation of the following: ▪ System Architecture ▪ External Specifications & Internal Specifications ▪ Software Development Plan, Configuration Management Plan and Project plan ▪ Technical Documentation ▪ Weekly status updates to all stakeholders  Ensure process and system compliances in the projects.  Exhibit excellent escalation management skills, internal or external.  Manage FPP (Fixed Price Project) & T&M (Time & Material) projects on diverse functional domains  Coordinate, communicate with the client on project related matters.  Coach/ mentor the members in the project and provide necessary support to them.  Performance appraisal/ counselling of the group members.  Evaluate training needs (technical, managerial) and get the required training programs implemented.  Ensure project compliance with Company's Quality Systems and Procedures.

 The incumbent must be B.E/B. Tech. -CS/ IT/ MCA, M.Tech from a reputed institute, with 10-12 years of relevant industry experience across a wide variety of development projects.  Knowledge of current technological trends in the S/W development industry, such as OOP’s, Multi-Tier S/W development, Component Architecture, Web Based S/W  Good experience on Core Java, JSP, Servlets, EJB, Oracle/SQL, planning, budgeting & QA  PMP or PMI certification is desirable. Domain knowledge of BFSI practices is an advantage.  Thorough understanding of Project Management methodologies and tools.  Advanced knowledge of system integration issues and Data Analysis  Understanding the company’s vision and goals, business operations and market.  Is adept in stakeholder management and possess the ability to coordinate and prioritize customer requests with the assistance of other managers to ensure customer delight.  Possess good people management skills and is able to manage performance and disciplinary issues, handle employee complaints and grievances and recommend the hiring, termination and promotion of staff; Should be able to train, mentor, motivate and lead a successful team. Should be well versed with attrition related issues and case management.  Should have: Strong leadership abilities, self-driven, critical thinking, analytical abilities, flexibility, adaptability to work schedules, effective verbal and written communication & presentation skills, time management, self-confidence, open to changes & challenges, eye for detail, perseverance, discreetness and diplomacy, analytical thinking, sound independent decision making and team work. Must possess the attitude to deliver solution First Time Right.  Willingness to travel on Short term/Long term within India/Outside India/Client Site

What does this role hold for you…??

• Help define Technical Roadmap and own the entire product delivery end to end
• Work very closely with various business stakeholders to drive the execution of multiple business plans and technologies.
• Improve, optimize and identify opportunities for efficient software development processes
• Hire, Develop and Retain a strong team of engineers.
• Keep abreast of the changes in the industry and champion new technologies and development processes within the team
• Thinking backward from a customer POV and relentlessly pursuing the customer's cause in tech and product decisions

 Apply if you have…

• Graduation/Post Graduation degree in Computer Science (IITs, IIITs and NITs preferred)
• 7-10 years of strong experience in JAVA(Spring/Hibernate/JPA/REST), JavaScript,
• NodeJS with good exposure to MySQL
• Experience with AWS, Microservices, Caching, Performance Optimization, Nginx, Solr, Redis, Redshift
• Experience working with agile teams and making rapid decisions in a dynamic and disruptive environment
• 2+ years of leading and managing a team consisting of the backend, frontend and QA.
• Hands-on writing and reviewing code
• Exceptional design and architectural skills.
• Strong communication skills.
• High motivation to work in a fast-paced, dynamic, collaborative team environment

Know more about us…

• Involvement in the overall application lifecycle
• Design and develop software applications in Scala and Spark
• Understand business requirements and convert them to technical solutions
• Rest API design, implementation, and integration
• Collaborate with Frontend developers and provide mentorship for Junior engineers in the team
• An interest and preferably working experience in agile development methodologies
• A team player, eager to invest in personal and team growth
• Staying up to date with cutting edge technologies and best practices
• Advocate for improvements to product quality, security, and performance

Desired Skills and Experience

• Minimum 1.5+ years of development experience in Scala / Java language
• Strong understanding of the development cycle, programming techniques, and tools.
• Strong problem solving and verbal and written communication skills.
• Experience in working with web development using J2EE or similar frameworks
• Experience in developing REST API’s
• BE in Computer Science
• Experience with Akka or Micro services is a plus
• Experience with Big data technologies like Spark/Hadoop is a plus company offers very competitive compensation packages commensurate with your experience. We offer full benefits, continual career & compensation growth, and many other perks.

Certified Ethical Hacker Requirements:

• Bachelor’s degree in Information Technology or Computer Science.
• CEH Certification.
• Proven work experience of at least 2-5 years as a Certified Ethical Hacker.
• Effective Programming Skills required but not limited to HTML, JavaScript, Python, PHP, SQL etc.
• Advanced knowledge of networking systems and security software.
• In-depth knowledge of parameter manipulation, session hijacking, and cross-site scripting.
• Technical knowledge of routers, firewalls, and server systems.
• Good written and verbal communication skills.
• Good troubleshooting skills.
• Ability to see big-picture system flaws.

• B.Tech/B.E.(IT/Computers), B.Sc( Computers), MSc (IT), BCA (Computer) or any equivalent graduation or post-graduation