Build a Text Classification Model using LONGFORMER in Python

  • Status: Pending
  • Prize: $25
  • Entries Received: 3

Contest Brief

I am doing some research and want to see how longformer model works. How the attention_mask, global_attention_mask works. lets say I have a dataset with 50000 research papers. I want to classify lets say into 4 categories/labels. General, Management,Technical and Operational. It has to go through compelte article.
Note : I dont need any workaround. Dont need LSTM, BERT; Roberta or any other transformer.

# Please write Some explanation Documenatation may be few lines for the functions used as :
why you choose sliding window.. If the document is greater than 5000 words what can be done. why this performance matrix, why this obtimizer, Role of Global_attention as that makes it different from Bert

#The input parameters shouldnt just be one .
Lets say we have 4 features, Title of the article, date of the article, Author, URL of the article.

# It is Multi Class Text Classification NOT Multi Label

#It has to be LONGFORMER.

# End result should be a working model. You can take any test dataset and show the output. TRAIN/EVAL/TEST

Recommended Skills

Top entries from this contest

View More Entries

Public Clarification Board

  • Longformer0076
    Contest Holder
    • 1 week ago

    I can push little bit to 30

    • 1 week ago
  • meghraj9
    meghraj9
    • 2 weeks ago

    Skilled freelancers won't start working on this until the prize is increased significantly.

    • 2 weeks ago
  • Longformer0076
    Contest Holder
    • 2 weeks ago

    it was 15, i increased to 25

    • 2 weeks ago
  • rawatpankaj9876
    rawatpankaj9876
    • 3 weeks ago

    #increaseprize

    • 3 weeks ago
    1. Longformer0076
      Contest Holder
      • 2 weeks ago

      it was 15, i increased to 25

      • 2 weeks ago
  • meghraj9
    meghraj9
    • 3 weeks ago

    #increaseprize

    • 3 weeks ago
    1. Longformer0076
      Contest Holder
      • 3 weeks ago

      I can think about it. But have u worked on it. Can you show me some code related to it ?

      • 3 weeks ago

Show more comments

How to get started with contests

  • Post your contest

    Post Your Contest Quick and easy

  • Get tons of entries

    Get Tons of Entries From around the world

  • Award the best entry

    Award the best entry Download the files - Easy!

Post a Contest Now or Join us Today!