Skip to content

Noshadi-sec/Call-For-Papers-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Academic Conference & Journal Call for Papers Finder

A Python tool that automatically searches and aggregates upcoming academic conferences, workshops, symposiums, and journal special issues across multiple sources. Designed for researchers to efficiently discover publication opportunities in any field of computer science and related disciplines.

Features

Multi-Source Search

Searches 9 different data sources across the internet:

  1. WikiCFP - Conferences, workshops, and symposiums
  2. WikiCFP Journals - Journal special issues and calls
  3. AI Deadlines - Machine learning and AI conferences with CORE rankings
  4. Security Deadlines - Cybersecurity and cryptography conferences
  5. Conference Alerts - Additional conference listings
  6. Academic Journals Database - 27 journals from major publishers
  7. IEEE/ACM Flagships - Topic-based flagship conferences
  8. Top Conferences Database - Curated A*/A conferences across 7 CS fields
  9. Direct Conference Websites - Direct scraping of major conferences

Extensive Coverage

  • Conferences: 200+ conferences per search with multi-keyword expansion
  • Journals: 27 high-quality journals from 7 major publishers
  • Rankings: CORE rankings (A*, A, B, C) and journal rankings (Q1-Q4)
  • Fields: Computer Vision, NLP, Databases, Security, ML/AI, Software Engineering, HCI, Networking, Theory, and more

Key Capabilities

  • Automatic duplicate removal with fuzzy matching
  • Venue type classification (Conference/Workshop/Symposium/Journal)
  • CORE ranking extraction and mapping
  • Journal quartile ranking (Q1-Q3)
  • Clean CSV export with Excel compatibility
  • Future deadline filtering
  • Multi-keyword search for comprehensive results

Installation

Prerequisites

  • Python 3.7 or higher
  • pip (Python package manager)

Setup

  1. Clone the repository:
git clone https://github.com/Noshadi-sec/Call-For-Papers-Scraper.git
cd Call-For-Papers-Scraper
  1. Create a virtual environment (recommended):
python -m venv venv
  1. Activate the virtual environment:
  • Windows:
    venv\Scripts\activate
  • macOS/Linux:
    source venv/bin/activate
  1. Install required packages:
pip install -r requirements.txt

Usage

Command Line

Basic usage:

python cfp_finder.py "your research topic"

Examples:

python cfp_finder.py "machine learning"
python cfp_finder.py "cybersecurity"
python cfp_finder.py "natural language processing"
python cfp_finder.py "computer vision"
python cfp_finder.py "database systems"

Python Script

from cfp_finder import CFPFinder

finder = CFPFinder()
results_df = finder.search_all("machine learning")
finder.save_to_csv(results_df, "my_results.csv")

Output

The tool generates a CSV file with the following columns:

  • venue_name: Name of the conference/journal
  • deadline: Submission deadline (YYYY-MM-DD)
  • ranking: CORE ranking (A*, A, B, C) or Journal ranking (Q1-Q4)
  • type: Venue type (Conference/Workshop/Symposium/Journal)
  • conference_date: Event date
  • location: Venue location
  • link: Official website URL
  • source: Data source
  • categories: Research topics
  • notification_date: Notification date (if available)
  • acceptance_rate: Acceptance rate (if available)

Results are automatically:

  • Sorted by deadline (earliest first)
  • Filtered to show only future deadlines
  • Deduplicated to remove redundant entries
  • Cleaned for Excel compatibility

Data Sources Details

1. WikiCFP

  • Searches up to 200 conferences per query
  • Multi-keyword expansion for comprehensive coverage
  • Extracts CORE rankings from event pages
  • Covers global conferences across all CS fields

2. Academic Journals Database (27 Journals)

MDPI (6 journals)

  • Electronics (Q2)
  • Sensors (Q1)
  • Applied Sciences (Q2)
  • Information (Q3)
  • Future Internet (Q2)
  • Computers (Q3)

IEEE Transactions (4 journals - all Q1)

  • IEEE TPAMI - Pattern Analysis and Machine Intelligence
  • IEEE TIFS - Information Forensics and Security
  • IEEE TNNLS - Neural Networks and Learning Systems
  • IEEE TDSC - Dependable and Secure Computing

Springer (3 journals - all Q1)

  • Journal of Machine Learning Research (JMLR)
  • Journal of Cryptology
  • Machine Learning Journal

Elsevier (3 journals - all Q1)

  • Computer Networks
  • Computers & Security
  • Artificial Intelligence

ACM (5 journals - all Q1)

  • ACM TIST - Intelligent Systems and Technology
  • ACM CSUR - Computing Surveys
  • ACM TOPS - Privacy and Security
  • ACM TOSEM - Software Engineering and Methodology
  • ACM TODS - Database Systems

Wiley (3 journals)

  • Software: Practice and Experience (Q2)
  • Computational Intelligence (Q2)
  • Security and Communication Networks (Q3)

Nature (2 journals - all Q1)

  • Nature Machine Intelligence
  • Scientific Reports

Others (2 journals)

  • Journal of Computer and System Sciences (Q2)
  • Cybersecurity - Springer (Q2)

3. Top Conferences Database

Curated database of 25+ A*/A conferences across 7 major fields:

Computer Vision & Graphics

  • SIGGRAPH (A*)
  • SIGGRAPH Asia (A)
  • WACV (A)
  • BMVC (B)

Natural Language Processing

  • ACL (A*)
  • EMNLP (A)
  • NAACL (A)
  • COLING (A)
  • EACL (B)

Databases & Data Mining

  • VLDB (A*)
  • SIGMOD (A*)
  • EDBT (B)
  • CIKM (A)

Software Engineering

  • ASE (A)
  • ISSTA (A)
  • MSR (A)

Human-Computer Interaction

  • CHI (A*)
  • UIST (A*)
  • UbiComp (A*)
  • IUI (A)

Networking

  • NSDI (A*)
  • MobiCom (A*)
  • CoNEXT (A)
  • SenSys (A)

Theory & Algorithms

  • STOC (A*)
  • FOCS (A*)
  • SODA (A*)
  • ESA (A)

4. Security Deadlines

Manual database of 10 major security conferences:

  • IEEE S&P (Oakland) - A*
  • NDSS - A*
  • ESORICS - A
  • RAID - A
  • ACSAC - A
  • FC - A
  • PKC - A
  • TCC - A
  • ACNS - A
  • DIMVA - B

Search Results Examples

Cybersecurity Search

python cfp_finder.py "cybersecurity"

Typical results: 65+ venues

  • 56 conferences
  • 9 journals
  • 12 A*/A ranked conferences
  • 6 Q1 journals

Machine Learning Search

python cfp_finder.py "machine learning"

Typical results: 52+ venues

  • 41 conferences
  • 11 journals
  • Multiple A* conferences (NeurIPS, ICML, CVPR, etc.)

Natural Language Processing Search

python cfp_finder.py "natural language processing"

Typical results: 56+ venues

  • Including ACL (A*), EMNLP (A), NAACL (A), COLING (A)

Computer Vision Search

python cfp_finder.py "computer vision"

Typical results: 60+ venues

  • Including CVPR (A*), ICCV (A*), ECCV (A), SIGGRAPH (A*)

Technical Details

Multi-Keyword Search Strategy

The tool automatically expands searches with related keywords:

  • Security searches: security + privacy + cryptography
  • ML/AI searches: machine learning + artificial intelligence + deep learning
  • Vision searches: computer vision + image processing + video

Ranking Systems

CORE Conference Rankings

  • A*: Top 6-7% of conferences (flagship venues)
  • A: Next 15% (excellent venues)
  • B: Next 30% (good venues)
  • C: Remaining venues

Journal Rankings

  • Q1: Top 25% (highest impact)
  • Q2: 25-50%
  • Q3: 50-75%
  • Q4: Bottom 25%

Data Cleaning

All results are automatically cleaned:

  • Removal of newlines and tabs from CSV fields
  • Normalization of whitespace
  • UTF-8 encoding with BOM for Excel compatibility
  • Proper escaping of special characters

File Structure

cfp-finder/
├── cfp_finder.py          # Main application
├── requirements.txt       # Python dependencies
├── README.md             # This file
├── .gitignore           # Git ignore rules
└── venv/                # Virtual environment (not in repo)

Dependencies

Core libraries:

  • requests: HTTP requests for web scraping
  • beautifulsoup4: HTML parsing
  • pandas: Data manipulation and CSV export
  • lxml: XML/HTML parser
  • python-dateutil: Date parsing
  • pyyaml: YAML parsing for AI deadlines

See requirements.txt for complete list with versions.

Output Format

Results are saved as CSV files with timestamp:

cfp_results_YYYYMMDD_HHMMSS.csv

Example filename: cfp_results_20251202_143052.csv

The CSV includes:

  • Column headers in the first row
  • UTF-8 encoding with BOM for Excel compatibility
  • Proper escaping of commas and quotes
  • Clean formatting without embedded newlines

Known CORE A* Conferences

The tool recognizes 40+ A* conferences including:

Machine Learning/AI: CVPR, ICCV, NeurIPS, ICML, AAAI, IJCAI

NLP: ACL

Databases: SIGMOD, VLDB, KDD

Security: S&P, NDSS, USENIX Security, CCS, CRYPTO, EUROCRYPT

Systems: SOSP, OSDI, NSDI

Programming Languages: PLDI, POPL, OOPSLA

Networking: SIGCOMM, MOBICOM, INFOCOM

Software Engineering: ICSE, FSE

Theory: STOC, FOCS, SODA

HCI: CHI, UIST, UbiComp

Web: WWW, SIGIR

Limitations

  • Web scraping may occasionally fail due to website changes
  • Some conferences may not publish deadlines far in advance
  • CORE rankings are based on known databases and may not be 100% current
  • Journal rankings are approximate based on publisher and historical data
  • Network connectivity required for all searches

Troubleshooting

No results found

  • Check internet connection
  • Verify the search term is relevant to computer science
  • Try broader keywords (e.g., "AI" instead of "Generative AI")

Import errors

  • Ensure all dependencies are installed: pip install -r requirements.txt
  • Verify Python version: python --version (should be 3.7+)

CSV not opening in Excel

  • File should use UTF-8 with BOM encoding (automatic)
  • Try opening with "Import Data" feature in Excel
  • Alternative: Use LibreOffice Calc or Google Sheets

Slow searches

  • Normal behavior - searching 9 sources takes time
  • Typical search: 30-60 seconds
  • Network speed affects performance

Contributing

Contributions are welcome! Areas for improvement:

  • Additional data sources
  • More comprehensive ranking databases
  • Enhanced conference detection algorithms
  • Support for additional research fields
  • Performance optimizations
  • Better error handling

License

MIT License - See LICENSE file for details

Acknowledgments

Data sources:

  • WikiCFP (www.wikicfp.com)
  • AI Conference Deadlines (aideadlin.es)
  • Security Deadlines (sec-deadlines.github.io)
  • Conference Alerts (conferencealerts.com)
  • Publisher websites (IEEE, ACM, Springer, Elsevier, MDPI, Wiley, Nature)

CORE Rankings: Based on CORE Conference Portal (www.core.edu.au)

Contact

For issues, questions, or suggestions:

  • Open an issue on GitHub
  • Submit a pull request for improvements

Designed for Researchers | Open Source | Star Repo if You Like It

About

A python tool that helps researcher to find call for papers

Topics

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors

Languages