readme: ---
  license: apache-2.0
  tags:
  - eu
  - public procurement
  - cpv
  - sector
  - multilingual
  - transformers
  - text-classification
  widget:
  - text: "Oppegård municipality, hereafter called the contracting authority, intends to enter into a framework agreement with one supplier for the procurement of fresh bread and bakery products for Oppegård municipality.  The contract is estimated to NOK 1 400 000 per annum excluding VAT  The total for the entire period including options is NOK 5 600 000 excluding VAT"
  ---
  
  # multilingual-cpv-sector-classifier
  This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on [the Tenders Economic Daily Public Procurement Data](https://simap.ted.europa.eu/en).
  It achieves the following results on the evaluation set:
  - F1 Score: 0.686
  
  ## Model description
  The model takes procurement descriptions written in any of [104 languages](https://github.com/google-research/bert/blob/master/multilingual.md#list-of-languages) and classifies them into 45 sector classes represented by [CPV(Common Procurement Vocabulary)](https://simap.ted.europa.eu/en_GB/web/simap/cpv) code descriptions as listed below.
  
   | Common Procurement Vocabulary |
   |:-----------------------------|
   | Administration, defence and social security services. 👮‍♀️ |
   | Agricultural machinery. 🚜 |
   | Agricultural, farming, fishing, forestry and related products. 🌾 |
   | Agricultural, forestry, horticultural, aquacultural and apicultural services. 👨🏿‍🌾 |
   | Architectural, construction, engineering and inspection services. 👷‍♂️ |
   | Business services: law, marketing, consulting, recruitment, printing and security. 👩‍💼 |
   | Chemical products. 🧪 |
   | Clothing, footwear, luggage articles and accessories. 👖 |
   | Collected and purified water. 🌊 |
   | Construction structures and materials; auxiliary products to construction (excepts electric apparatus). 🧱 |
   | Construction work. 🏗️ |
   | Education and training services. 👩🏿‍🏫 |
   | Electrical machinery, apparatus, equipment and consumables; Lighting. ⚡ |
   | Financial and insurance services. 👨‍💼 |
   | Food, beverages, tobacco and related products. 🍽️ |
   | Furniture (incl. office furniture), furnishings, domestic appliances (excl. lighting) and cleaning products. 🗄️ |
   | Health and social work services. 👨🏽‍⚕️ |
   | Hotel, restaurant and retail trade services. 🏨 |
   | IT services: consulting, software development, Internet and support. 🖥️ |
   | Industrial machinery. 🏭 |
   | Installation services (except software). 🛠️ |
   | Laboratory, optical and precision equipments (excl. glasses). 🔬 |
   | Leather and textile fabrics, plastic and rubber materials. 🧵 |
   | Machinery for mining, quarrying, construction equipment. ⛏️ |
   | Medical equipments, pharmaceuticals and personal care products. 💉 |
   | Mining, basic metals and related products. ⚙️ |
   | Musical instruments, sport goods, games, toys, handicraft, art materials and accessories. 🎸 |
   | Office and computing machinery, equipment and supplies except furniture and software packages. 🖨️ |
   | Other community, social and personal services. 🧑🏽‍🤝‍🧑🏽 |
   | Petroleum products, fuel, electricity and other sources of energy. 🔋 |
   | Postal and telecommunications services. 📶 |
   | Printed matter and related products. 📰 |
   | Public utilities. ⛲ |
   | Radio, television, communication, telecommunication and related equipment. 📡 |
   | Real estate services. 🏠 |
   | Recreational, cultural and sporting services. 🚴 |
   | Repair and maintenance services. 🔧 |
   | Research and development services and related consultancy services. 👩‍🔬 |
   | Security, fire-fighting, police and defence equipment. 🧯 |
   | Services related to the oil and gas industry. ⛽ |
   | Sewage-, refuse-, cleaning-, and environmental services. 🧹 |
   | Software package and information systems. 🔣 |
   | Supporting and auxiliary transport services; travel agencies services. 🚃 |
   | Transport equipment and auxiliary products to transportation. 🚌 |
   | Transport services (excl. Waste transport). 💺
  
  ## Intended uses & limitations
  - Input description should be written in any of [the 104 languages](https://github.com/google-research/bert/blob/master/multilingual.md#list-of-languages) that MBERT supports.
  - The model is just evaluated in 22 languages. Thus there is no information about the performances in other languages.
  - The domain is also restricted by the awarded procurement notice descriptions in European Union. Evaluating on whole document texts might change the performance.
  
  ## Training and evaluation data
  - The whole data consists of 744,360 rows. Shuffled and split into train and validation sets by using 80%/20% manner.
  - Each description represents a unique contract notice description awarded between 2011 and 2018.
  - Both training and validation data have contract notice descriptions written in 22 European Languages. (Malta and Irish are extracted due to scarcity compared to whole data)
  
  ## Training procedure
  The training procedure has been completed on Google Cl