Skip to content

job search new version #258

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

job search new version #258

wants to merge 3 commits into from
+121 −99

Conversation

patil-pratik-87
Copy link

@patil-pratik-87 patil-pratik-87 commented Jul 20, 2025 •
edited
Loading

Enhance job search with advanced filtering, company URLs, and maintainable selectors

Major Features Added:

  • Location-based filtering: Search jobs by specific locations
  • Company URL extraction: Automatically extract LinkedIn company URLs
  • Advanced job descriptions: Optional detailed job description scraping
  • Configurable result limits: Control max number of jobs returned
  • Progressive scrolling: Intelligent loading of more job results

Technical Improvements:

  • Right panel extraction: Efficient job detail scraping without page navigation
  • Robust selector fallbacks: Multiple CSS selectors for resilience to LinkedIn UI changes
  • Stale element handling: Immediate data extraction to prevent WebDriver crashes
  • Smart scrolling logic: Configurable scroll distance, timing, and stop conditions

API Changes:

# Enhanced search method with new parameters
job_search.search(
    search_term="Software Engineer",
    location="San Francisco, CA",          # NEW: Location filtering
    max_results=50,                        # NEW: Result limit control
    include_description=True,              # NEW: Detailed job descriptions
    include_company_urls=True              # NEW: Company LinkedIn URLs
)
image

patil-pratik-87 and others added 3 commits July 19, 2025 12:33
@patil-pratik-87
Fixed employee extraction and added LinkedIn URL-based keyword filtering
c6d2072 
  FIXES:
  - Updated XPath selector for employee elements to match current LinkedIn page structure

  NEW FEATURES:
  - Add employee_search_keywords parameter for URL-based filtering
  - Add configurable timeout parameter (default: 10s)
  - Implement LinkedIn native search via /people/?keywords={encoded} URLs
@patil-pratik-87
Merge pull request #1 from patil-pratik-87/fix-for-company-employees-…
820624f 
…retrieval

Fixed company employees scraping and added LinkedIn URL-based keyword filter for company employees
@patil-pratik-87
Enhance job search with advanced filtering, company URLs, and mainta…
c729e76 
…inable selectors
@patil-pratik-87 patil-pratik-87 changed the title Job search new version job search new version Jul 20, 2025
@patil-pratik-87 patil-pratik-87 mentioned this pull request Jul 21, 2025
Open
@patil-pratik-87
Copy link
Author

@joeyism, can you please merge this?

@iancrichardson
Copy link

It looks like the search function was removed from JobSearch. I may be misunderstanding - how is this supposed to work now?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@patil-pratik-87 @iancrichardson