setfit pytorch safetensors bert sentence-transformers text-classification generated_from_setfit_trainer arxiv:2209.11055 base_model:BAAI/bge-small-en-v1.5 base_model:finetune:BAAI/bge-small-en-v1.5 model-index region:us
---
base_model: BAAI/bge-small-en-v1.5
library_name: setfit
metrics:
- accuracy
pipeline_tag: text-classification
tags:
- setfit
- sentence-transformers
- text-classification
- generated_from_setfit_trainer
widget:
- text: MOVED Follow mhonkasalo for updates Ethereum
- text: 'Buy online with Bitcoin Dash and other cryptocurrencies '
- text: 'Blockchain cryptographer Research partner a16z crypto '
- text: 'A Tezos News Journalistic Hub Tweets or website content are NOT investment
    or financial advice Tweets Or Retweets are not endorsements Tezos '
- text: Ethereans en el  construyendo el futuro de la Web3  Te esperamos el 3 de febrero
    en el Ethereum Lima Day  Peru
inference: true
model-index:
- name: SetFit with BAAI/bge-small-en-v1.5
  results:
  - task:
      type: text-classification
      name: Text Classification
    dataset:
      name: Unknown
      type: unknown
      split: test
    metrics:
    - type: accuracy
      value: 0.4918032786885246
      name: Accuracy
---

# SetFit with BAAI/bge-small-en-v1.5

This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [BAAI/bge-small-en-v1.5](https://huggingface.co/BAAI/bge-small-en-v1.5) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning.
2. Training a classification head with features from the fine-tuned Sentence Transformer.

## Model Details

### Model Description
- **Model Type:** SetFit
- **Sentence Transformer body:** [BAAI/bge-small-en-v1.5](https://huggingface.co/BAAI/bge-small-en-v1.5)
- **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
- **Maximum Sequence Length:** 512 tokens
- **Number of Classes:** 50 classes
<!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->

### Model Sources

- **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit)
- **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)

### Model Labels
| Label                   | Examples                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
|:------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| DEFI                    | <ul><li>'TAMAGO is a P2P protocol that empowers creators builds a digital IP ecosystem and creates safe  sustainable IP assets by utilizing public blockchain networks Worldwide'</li><li>'Building ValantisLabs  Prev Defi Engineer NethermindEth  Senior IIITDelhi Delhi India'</li><li>'The Lido Ecosystem Grants Organisation Growing the staking ecosystem one grant at a time LidoFinance '</li></ul>                                                                                                                                  |
| WALLET                  | <ul><li>'Secure by default Selfcustodial no seed phrase vulnerability Powered by MPC Your pocket'</li><li>'We build Bitcoincentric tools that empower you to reclaim your freedom including Passport hardware wallet and Envoy app Open source USA assembled Assembled in USA'</li><li>'Protecting 800 million Secure your onchain identity by linking cold  hot wallets Trusted by azuki boredapeyc pudgypenguins opensea and 100 projects '</li></ul>                                                                                      |
| INFRASTRUCTURE          | <ul><li>'Prime Trust provides financial infrastructure APIs that allow fintech and digital asset companies to innovate quickly securely and reliably Nevada'</li><li>'Native mobile Ethereum dapps  Open source and funded by grants from EF_ESP and gnosisPM Decentralized'</li><li>'Once Upon makes the blockchain humanreadable enabling users to search discover and understand whats happening in the world of Web3 web3'</li></ul>                                                                                                     |
| LSD                     | <ul><li>'Supermeta is a zkLayer2 tailored for efficient Liquid Restaking Increase the capital efficiency of your ETHLSD Join us  Ethereum '</li><li>'Liquid staking for Cosmos blockchains Join the Discord '</li><li>'Put your LSTs to work Use LSTs to get EQD stablecoins instantly '</li></ul>                                                                                                                                                                                                                                           |
| CENTRALIZED_EXCHANGE    | <ul><li>'Exchange That Empowers You Telegram Estonia'</li><li>'The Cryptocurrency Exchange on a mission to Free the Money Free the world Trade BTC ETH and more than 500 trading pairs on our secure platform '</li><li>'The worlds leading blockchain cryptocurrency exchange The most complete Cryptocurrencies The lowest fee across the whole market Website Cayman Islands'</li></ul>                                                                                                                                                   |
| NFT                     | <ul><li>'Benchmarking NFTs IPFS Blockchain'</li><li>'Bridging Blockchain and Ceramics UK'</li><li>'Experimenting with radical economic mechanisms starting with Harberger Tax for 366 NFTs for each day of the year '</li></ul>                                                                                                                                                                                                                                                                                                              |
| DEVELOPMENT_AGENCY      | <ul><li>'Scrit is a postblockchain value transfer system We are an open source project to develop the technology No ICO no premining Tech only Berlin'</li><li>'A super duper cool team working remotely since 2017 We build cool communities  products with Devs Blockchain NFTs   Singapore'</li><li>'Unifying Deep Learning  Machine Learning with Blockchain Smart Contract Engineering Earth '</li></ul>                                                                                                                                |
| PRIVACY                 | <ul><li>'Opensource privacy tests of web browsers developed and maintained by arthuredelstein Follow privacytests for the latest browser test results the World Wide Web'</li><li>'I roll d20s and add the result to your statistics to protect the people in your data at TumultLabs  hehim nowadays mainly on  Zurich Suisse'</li><li>'To envision build and defend a postsurveillance society Worldwide'</li></ul>                                                                                                                        |
| PAYMENT_PROVIDER        | <ul><li>'CEO  Seis  banking for US Spanish speakers Come partake in unlimited tacos  Mexican Coke on Jan 23 RSVP in link below USA'</li><li>'Building a better business model for the web with Interledger San Francisco CA'</li><li>'The easiest way to buy sell or swap crypto Try today  Need support  KadoSupport Crosschain'</li></ul>                                                                                                                                                                                                  |
| UNDETERMINED            | <ul><li>'A little bit of DAILY READING goes long way    Book Review Lessons Recomm  Wisdom  Engineer  Solutions Architect  Data Storage '</li><li>' CURRENTLY IN JAIL ACCOUNT MANAGED BY FRIENDS   Hong Kong activist〡joshuajoshuawongcfcom〡UnfreeSpeech Hong Kong'</li><li>'THE MEDIUM IS THE MASSAGE  tokyo'</li></ul>                                                                                                                                                                                                                     |
| DAO                     | <ul><li>'Communitydriven smart contract audit contests on the Cosmos ecosystem Join our open organization Ethereum league at code4rena '</li><li>'The supercharged governance client for nounsdao Frontend '</li><li>'The meetup group for Ethereum in Copenhagen Copenhagen Denmark'</li></ul>                                                                                                                                                                                                                                              |
| CRYPTO_MEDIA            | <ul><li>'News and Commentary about Holochain and its evolving ecosystem '</li><li>'SUPER𝙏𝙄𝙇𝙏 is a media co encouraging folks to boldly tilt into the new frontiers of web3 and impact  blaiseturnbull mahoney_magic super interplanetary metaverse'</li><li>'Get the latest local and international news from TODAY Follow us on Telegram Singapore'</li></ul>                                                                                                                                                                               |
| METAVERSE               | <ul><li>'Revolutionizing the digital economy one quest at a time '</li><li>'Innovative technology for the social gaming generation Everyrealm '</li><li>'Buidl an open Metaverse for everyone based on ethereum Projectsdragon_faceDragonCityIO  The Metaverse'</li></ul>                                                                                                                                                                                                                                                                    |
| SUPPLY_CHAIN            | <ul><li>'Amplify sustainability Cut greenwash  Provenance validates and amplifies sustainability claims so customers can make positive choices at checkout  London'</li><li>'Founder  CTO tracelabshq  origin_trail Decentralized Knowledge Graph core devs  Empowering communities to tackle misinformation with decentralized AI Vℕ2 Serbia'</li><li>'A ConsenSys company bringing traceability transparency and tradability to supply chains using blockchain swetherofficial eulerbeats are Treum NFT projects Brooklyn NY'</li></ul>    |
| VENTURE_CAPITAL_FIRM    | <ul><li>'Making Web3 for billions '</li><li>'Deep decarbonization and the business of climate Priors BloombergNEF climate VoyagerVC Working on something new Singapore'</li><li>'Community Research Investment over Volt_Cap San Francisco CA'</li></ul>                                                                                                                                                                                                                                                                                     |
| RESEARCH_AGENCY         | <ul><li>'I care about facilitating collaborative architectures in networks between and within humans My work is identifying the first principles of the Dhamma Bay Area'</li><li>'Knowledge is a competitive advantage We want to share it '</li><li>'Educating cultivating and accelerating the next leaders of the decentralised economy  Showing the world how to prosper by doing good   President DrAdaku University of Oxford'</li></ul>                                                                                               |
| MARKETING_AGENCY        | <ul><li>'Decentralized Coop Company Paris  World wide We provide HQ films UXUI design events  tech for Web3 world  films tech web3 art dev design France'</li><li>'Connecting business and website owners with the blockchain and cryptocurrency ecosystem Retweets and Hearts should not be considered as endorsements The Internet'</li><li>' Digital transformation  acceleration services for banks Follow FINTECHCircle for the latest fintech insights events and updates London'</li></ul>                                            |
| LEGAL_COMPLIANCE        | <ul><li>'blockchain deal technology '</li><li>'Abogada Lic C Política MDE Entusiasta de Blockchain Buenos Aires Argentina'</li><li>'BittyTax the opensource cryptocurrency tax calculator UK'</li></ul>                                                                                                                                                                                                                                                                                                                                      |
| L1_BLOCKCHAIN           | <ul><li>'Lightning Bitcoin LBTC is a decentralized global IoV protocol based on DPoS 30 consensus mechanism '</li><li>'Ravencoin is free  open source  fairly mined POW blockchain Users can issue and control utility game NFTs  securities digital assets tokens IPFS Global'</li><li>'The Mobile Entertainment Revolution Begins On ThunderCore UltraFast  Secure  EVM  CostEfctv  Link Treemobile_phonecrossed_swordschequered_flaghigh_voltageglobe_showing_EuropeAfricachainsmoney_bagTT'</li></ul>                                    |
| REFI                    | <ul><li>'For a thriving life economy Distributed equitable regenerative and ours commons currency design A sister project of holochain Global'</li><li>'all that we love into all that we do the bright future is for all of us nobody left behind im building CommuniTrees infra for post collapse societies Spaceship Earth'</li><li>'Founder  CEO at CEVENtech  Cofounder  President ReFi_ZH  Talks about biodiversity ReFi Web3  Tweets Xs are my private opinion Zurich Switzerland'</li></ul>                                          |
| GAMEFI                  | <ul><li>'Decentralized AI x Gaming Protocol that is building the future of virtual interactions  TG '</li><li>'Undoomed is a play2earn strategy crypto game by CroesusCrypto_ with fair and balanced tokenomics that is going to redefine GameFi Metaverse'</li><li>'Head of Ecosystem Oasys_Games  Ex VC  2016年組  Web3市場 Tokenomics 資金調達をツイート  EN yas10io  DMs open Singapore'</li></ul>                                                                                                                                                    |
| NFT_MARKETPLACE         | <ul><li>'We walked for 4 years so you can sprint Introducing RaribleX your turnkey marketplace solution tailored for web2  web3 brands '</li><li>'A fully decentralized noncustodial peertopeer marketplace for the exchange and management of ENS domain names eth Powered by ethereum  district0x Ethereum'</li><li>'working on getting past 日本語上手  ex opensea '</li></ul>                                                                                                                                                                 |
| L0_BLOCKCHAIN           | <ul><li>'Team of cryptoresearchers and software veterans that have set the global standard for Ultrafast DeFi trading on the ETH MATIC BNB and SOL Chains Layer0 '</li><li>'IBC Maximalist since 2016 '</li><li>'Tracking IBC adoption Follow ibcprotocol for protocol updates '</li></ul>                                                                                                                                                                                                                                                   |
| L2_BLOCKCHAIN           | <ul><li>' ZKTech Based Ethereum Acceleration Engine Layer 2 and CrossRollup'</li><li>'ChainXa Trusted and Scalable BTC Layer2 Network BRC20 ORC20 BRC30 Taproot EVM Metmask and so on Discord Bitcoin'</li><li>'METARIX A Layer2 blockchain for Gaming NFTs Marketing and Launchpad Platform all through Metaverse Metarix Metaverse'</li></ul>                                                                                                                                                                                              |
| SOCIAL_MEDIA            | <ul><li>'Live audio convos you can join whenever wherever planet earth'</li><li>'Share your pictures on Web 30 with Liketu and the Hive Blockchain '</li><li>'Connect thousands of people with the Hive blockchain ecosystem hive'</li></ul>                                                                                                                                                                                                                                                                                                 |
| CHARITY                 | <ul><li>'501c3 nonprofit empowering women to excel in tech Creating a diverse  inclusive tech industry  360k Members in 147 Countries WWCode WomenWhoCode Global'</li><li>'Homeless outreach dedicated to finding lasting solutions to hunger homelessness and poverty Powered by bitcoin Donate 38ccq12hPFoiSksxUdr6SQ5VosyjY7s9AU '</li><li>'Aaron Swartzinspired Hackathons are now going on all year all over the world Joining us is easy just by helping those around you however you can love San Francisco and everywhere'</li></ul> |
| NFT_DIGITAL_ART         | <ul><li>'Artist residency  collector community building the home for experiential art Join us  Explore the work '</li><li>'A powerful toolkit for digital collectible creators who dont code  Our new toolhigh_voltage  Help '</li><li>'Optipunks are punks on Optimism Mint cost 0005 eth All profit will go to public goods on Optimism Unofficial punks project unaffiliated with OptimismPBC '</li></ul>                                                                                                                                 |
| NFT_GAMING              | <ul><li>'Come and save the broken world A digital representation of your progression on PhalaNetwork Discord PhalaWorld'</li><li>'Collect and breed digital cats with CryptoKitties  the worlds first ever ERC721 token Join our Discord family KittyVerse'</li><li>'foundation blueprints and raw materials for decentralized gaming building wrasslersgg and other experiments the metaverse'</li></ul>                                                                                                                                    |
| FOUNDATION              | <ul><li>'Our mission is to steward the development of the Ethereum Classic protocol and to support its growth into a mature ecosystem '</li><li>'Writer for Risk Labs the foundation behind the UMAprotocol optimistic oracle  AcrossProtocol intentsbased bridge '</li><li>'Free Cities are selfgoverning territories that uphold individual rights and freedoms Visit our website to find out more Liechtenstein'</li></ul>                                                                                                                |
| REAL_ESTATE             | <ul><li>'Focus on real estate solution with blockchain technology offchain oracle NFTFi RWA and p2p transition since 2017 '</li><li>'Trade real estate prices with up to 10x leverage  The best venue for liquid real estate exposure  Built on solana  Solana'</li><li>'Bitcoin REIT '</li></ul>                                                                                                                                                                                                                                            |
| DECENTRALIZED_STORAGE   | <ul><li>'Decentralized Storage Made Simple Build apps backed by Filecoin no infrastructure required web3storage '</li><li>'Autonomous hosting network for p2p data systems  loading alpha release open collective '</li><li>'We store your data safely and securely on the blockchain Pay a small fee to upload then access your data anytime for FREE no subscription NFTs supported '</li></ul>                                                                                                                                            |
| DEX                     | <ul><li>'Trade Earn and Learn All In One Place Explore perpetual swaps earn yield and learn the future of DeFi with our decentralized trading protocol on optimismFND Ethereum'</li><li>'Next gen AMM protocol by 1inch Redistributes earnings to liquidity providers capitalizes on user slippages and protects traders from frontrunning attacks Moon'</li><li>'Crypto Token Manager  Decentralized Exchange '</li></ul>                                                                                                                   |
| LENDING_BORROWING       | <ul><li>'Collateralized fixedrate borrowing and lending on EthereumArbitrum App '</li><li>'Unlock P2P lending using any token as collateral NFTs included PWN is live on 7 chains and counting Multiverse'</li><li>'Building the most efficient lending protocol on Ethereum Join the community '</li></ul>                                                                                                                                                                                                                                  |
| SOCIALFI                | <ul><li>'A social aggregator app for Web3 natives by realmasknetwork  Follow us for chances to skip to the front of the line of our 50k person waitlist Onchain'</li><li>'Nextgen Social Media empowering creators via subscription revenue in realtime Join our community on v3 launch Q1 24 '</li><li>' Web3 Social Network  Explore web3 Social with link3to  thecyberwallet  Learn More at Web3'</li></ul>                                                                                                                               |
| PODCAST                 | <ul><li>'Where we talk decentralization and technology open source communities  ZK proofs Hosted by AnnaRRose '</li><li>'BreakingBanks is the 1 Global Fintech Podcast and Radio Show  New Episodes Thursdays  From Provoke Media provokecast New York City'</li><li>'TheBlock__ podcasts bring you the stories defining the crypto industry  home of The Scoop w fintechfrank  The Block Research Podcast w lawmaster New York'</li></ul>                                                                                                   |
| MEME_COIN               | <ul><li>'Community Utility Charity  FLOKI has it all On a mission to become the worlds most known and used cryptocurrency Join Flokis TG '</li><li>' turn on notifications'</li><li>'a sarcastic cartoon dog wearing glasses  newsletter businessbillym2knet  amazon affiliate South of Hell'</li></ul>                                                                                                                                                                                                                                      |
| SYNTHETIC_ASSETS        | <ul><li>'Marqet combines AAVE credit delegation with Synthetix P2C exchange to uniquely provide trustless margin trading of any synthetic asset with no slippage '</li><li>'Stable and liquid synthetic fiat currencies DeFi overtaking TradFigreen_squaregreen_squaregreen_squaregreen_squaregreen_squaregreen_squareblack_large_squareblack_large_squareblack_large_square 100 EVM'</li><li>'Positional markets  Ethereum A new frontier in simple onchain derivatives THALES Join  Play  Ethereum '</li></ul>                             |
| YIELD_FARMING           | <ul><li>'Yield  Rewards Power from lockable tokens Metagov  '</li><li>'Yield Aggregator  on Astar Network Polkadot About Join us Telegram Coming soon'</li><li>'Yield Booster on ve tokenomics About  Join us  '</li></ul>                                                                                                                                                                                                                                                                                                                   |
| GOVERNMENT              | <ul><li>'Yes this is the official X account of Ukraine Офіційний акаунт твоєї Неньки Ukraine'</li><li>'Super PAC to elect congresspeople who give consumers and innovators the opportunity to build and use nextgen web3blockchain tech and services in America '</li><li>'Empowering small businesses to start grow expand or recover Administrator SBAIsabel Policies Retweets or  mentions  endorsements Nationwide'</li></ul>                                                                                                            |
| PERPS                   | <ul><li>'Qilin V2 Permissionless Perpetuals Market is now LIVE on Ethereum Launch on BSC coming up Telegram Memesphere'</li><li>'CoFounder SyndrHQ Crypto derivatives '</li><li>'Automatically concentrated liquidity dynamic fees and parametrizable pools Perpetual swaps on zkSync Era Join our community Decentralized'</li></ul>                                                                                                                                                                                                        |
| DECENTRALIZED_COMPUTING | <ul><li>'Cofounder GensynAI  the trustless protocol for machine learning compute  previously founded data sovereignty startup  researched NN architecture evolution London  California'</li><li>'Fueling the AI Revolution One GPU Cluster at a Time  Putting Together 1 Million GPUs  Powered by solana filecoin rendernetwork Manhattan New York'</li><li>'Monetize computing power datasets  apps Build Web3 apps that preserve ownership  privacy '</li></ul>                                                                            |
| STABLECOIN              | <ul><li>'Bringing USDA a decentralized stablecoin to Aptos App Space'</li><li>'Automated tweets about the DAI stablecoin Liquidations major CDP txs and random DAI stats Built by marcandu Worldwide'</li><li>'Neutral Dollar is a metastable basket of stablecoins A digital dollar with lower volatility and globally shared liquidity San Francisco CA'</li></ul>                                                                                                                                                                         |
| NFT_IDENTITY            | <ul><li>'Semantic SBTs Encode Social Relationships on Web3 Relation Chat Plugin SBT SocialGraph Web3 Web3'</li><li>'ketlxyz  anonymous social app for founders  vcs sealcred  zk nfts i think ocean'</li><li>'in search of the internets last identity system '</li></ul>                                                                                                                                                                                                                                                                    |
| INSURANCE               | <ul><li>'Technology to prevent  protect against theft fraud  loss of crypto assets Cardiff Wales'</li><li>'Umbrella Protection by Yam '</li><li>'Realtime security alerts from the Cyvers platform  Protect your digital assets with Cyvers   infocyversai   Cyvers_ '</li></ul>                                                                                                                                                                                                                                                             |
| RWA                     | <ul><li>'We unlock the value of realworld assets Discord Brooklyn NY  Onchain'</li><li>'Definitive reference point for RWA Indexes  Inflation  18M Data Points 60 Providers Censorshipresistant  Transparent Backed by Chainlink  Coinbase '</li><li>'XAUt is a digital token backed by physical gold By putting gold on Blockchain we unlock a variety of characteristics that typically only crypto assets possess '</li></ul>                                                                                                             |
| GAMBLEFI                | <ul><li>'Evolving finance one Bet at a Time  Community owned BetFi protocol on injective_  Injective'</li><li>'MultichainMultitoken Decentralized Lottery Join the Revolution of DeFi BSC FTM AVAX ARB MATIC    World'</li><li>'Building Polkamarkets the 100 userrun fully open source Web3 Prediction Markets protocol  V2 live at Polygon Moonriver  Moonbeam'</li></ul>                                                                                                                                                                  |
| L3_BLOCKCHAIN           | <ul><li>'Nexusbackhand_index_pointing_right Building the Layer3 Rollup Infra for high performance ZK applications '</li><li>'Slush allows you to easily spin up L3s App specific rollups with the optimisations you care about '</li><li>'³  cypherpunk and cryptoanarchist Working on FabricProtocol an earlystage Layer 3 system for Bitcoin  HACK THE PLANET  fc008'</li></ul>                                                                                                                                                            |
| OPTIONS                 | <ul><li>'cega_fi structured investments onchain  jp arisatoyo_jp '</li><li>'Opyn  building open finance via DeFi strategies and perpetual options Discord '</li><li>'FIA is the leading global trade organization for futures options centrally cleared derivatives markets   Washington DC'</li></ul>                                                                                                                                                                                                                                       |
| OTC_EXCHANGE            | <ul><li>'Powering liquidity to crypto markets  Onestop shop OTC  Builders of decentralized future  CEO evgenygaevoy  COO emgurevich Not directed towards UK users '</li><li>'creators of Urbits largest planet market first network explorer and first Urbit OTC trading desk galaxy purchasessales otcurbitlive Mars'</li><li>'Entrepreneur busy with crypto blockchain web3  boutique Swiss crypto gateway for HNW crypto ZugSwtizerland'</li></ul>                                                                                        |
| HEALTHCARE              | <ul><li>'Decentralized life sciences ecosystem The world is our stakeholder Powered by the internetcomputer Linktree waitlist Discord media Colorado USA'</li><li>'Working toward radical extension of human healthspan using epigenetic reprogramming South San Francisco CA'</li><li>'We advance science so that we all have more time with the people we love Read our community guidelines Basel Switzerland'</li></ul>                                                                                                                  |

## Evaluation

### Metrics
| Label   | Accuracy |
|:--------|:---------|
| **all** | 0.4918   |

## Uses

### Direct Use for Inference

First install the SetFit library:

```bash
pip install setfit
```

Then you can load this model and run inference.

```python
from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("kasparas12/crypto_organization_infer_model_setfit")
# Run inference
preds = model("MOVED Follow mhonkasalo for updates Ethereum")
```

<!--
### Downstream Use

*List how someone could finetune this model on their own dataset.*
-->

<!--
### Out-of-Scope Use

*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->

<!--
## Bias, Risks and Limitations

*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->

<!--
### Recommendations

*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->

## Training Details

### Training Set Metrics
| Training set | Min | Median  | Max |
|:-------------|:----|:--------|:----|
| Word count   | 2   | 16.1218 | 45  |

| Label                   | Training Sample Count |
|:------------------------|:----------------------|
| DEVELOPMENT_AGENCY      | 308                   |
| RESEARCH_AGENCY         | 367                   |
| MARKETING_AGENCY        | 107                   |
| FOUNDATION              | 128                   |
| CHARITY                 | 72                    |
| L0_BLOCKCHAIN           | 27                    |
| L1_BLOCKCHAIN           | 170                   |
| L2_BLOCKCHAIN           | 143                   |
| L3_BLOCKCHAIN           | 3                     |
| VENTURE_CAPITAL_FIRM    | 550                   |
| GOVERNMENT              | 54                    |
| CENTRALIZED_EXCHANGE    | 124                   |
| OTC_EXCHANGE            | 3                     |
| DEX                     | 162                   |
| LENDING_BORROWING       | 36                    |
| INSURANCE               | 14                    |
| YIELD_FARMING           | 22                    |
| SYNTHETIC_ASSETS        | 9                     |
| LSD                     | 54                    |
| PERPS                   | 11                    |
| OPTIONS                 | 18                    |
| WALLET                  | 171                   |
| STABLECOIN              | 33                    |
| DEFI                    | 770                   |
| NFT                     | 121                   |
| NFT_MARKETPLACE         | 100                   |
| NFT_DIGITAL_ART         | 278                   |
| NFT_GAMING              | 181                   |
| NFT_IDENTITY            | 64                    |
| PRIVACY                 | 97                    |
| DECENTRALIZED_STORAGE   | 110                   |
| DECENTRALIZED_COMPUTING | 38                    |
| SOCIALFI                | 54                    |
| SOCIAL_MEDIA            | 54                    |
| SUPPLY_CHAIN            | 9                     |
| REAL_ESTATE             | 12                    |
| REFI                    | 49                    |
| HEALTHCARE              | 8                     |
| LEGAL_COMPLIANCE        | 92                    |
| GAMEFI                  | 20                    |
| GAMBLEFI                | 18                    |
| INFRASTRUCTURE          | 649                   |
| RWA                     | 19                    |
| METAVERSE               | 59                    |
| MEME_COIN               | 37                    |
| PAYMENT_PROVIDER        | 89                    |
| DAO                     | 522                   |
| CRYPTO_MEDIA            | 829                   |
| PODCAST                 | 89                    |
| UNDETERMINED            | 728                   |

### Training Hyperparameters
- batch_size: (64, 64)
- num_epochs: (1, 1)
- max_steps: -1
- sampling_strategy: oversampling
- num_iterations: 20
- body_learning_rate: (2e-05, 1e-05)
- head_learning_rate: 0.01
- loss: CosineSimilarityLoss
- distance_metric: cosine_distance
- margin: 0.25
- end_to_end: False
- use_amp: False
- warmup_proportion: 0.1
- seed: 42
- eval_max_steps: -1
- load_best_model_at_end: False

### Training Results
| Epoch  | Step | Training Loss | Validation Loss |
|:------:|:----:|:-------------:|:---------------:|
| 0.0002 | 1    | 0.232         | -               |
| 0.0104 | 50   | 0.2604        | -               |
| 0.0208 | 100  | 0.2484        | -               |
| 0.0312 | 150  | 0.2445        | -               |
| 0.0416 | 200  | 0.2294        | -               |
| 0.0521 | 250  | 0.2207        | -               |
| 0.0625 | 300  | 0.1996        | -               |
| 0.0729 | 350  | 0.2222        | -               |
| 0.0833 | 400  | 0.206         | -               |
| 0.0937 | 450  | 0.1937        | -               |
| 0.1041 | 500  | 0.1651        | -               |
| 0.1145 | 550  | 0.2341        | -               |
| 0.1249 | 600  | 0.1862        | -               |
| 0.1354 | 650  | 0.1922        | -               |
| 0.1458 | 700  | 0.1987        | -               |
| 0.1562 | 750  | 0.1537        | -               |
| 0.1666 | 800  | 0.1281        | -               |
| 0.1770 | 850  | 0.102         | -               |
| 0.1874 | 900  | 0.1395        | -               |
| 0.1978 | 950  | 0.1816        | -               |
| 0.2082 | 1000 | 0.1109        | -               |
| 0.2187 | 1050 | 0.0924        | -               |
| 0.2291 | 1100 | 0.089         | -               |
| 0.2395 | 1150 | 0.1228        | -               |
| 0.2499 | 1200 | 0.1303        | -               |
| 0.2603 | 1250 | 0.1084        | -               |
| 0.2707 | 1300 | 0.1483        | -               |
| 0.2811 | 1350 | 0.1545        | -               |
| 0.2915 | 1400 | 0.129         | -               |
| 0.3020 | 1450 | 0.1177        | -               |
| 0.3124 | 1500 | 0.1936        | -               |
| 0.3228 | 1550 | 0.1427        | -               |
| 0.3332 | 1600 | 0.0968        | -               |
| 0.3436 | 1650 | 0.1252        | -               |
| 0.3540 | 1700 | 0.0896        | -               |
| 0.3644 | 1750 | 0.1281        | -               |
| 0.3748 | 1800 | 0.0965        | -               |
| 0.3853 | 1850 | 0.0725        | -               |
| 0.3957 | 1900 | 0.0625        | -               |
| 0.4061 | 1950 | 0.1           | -               |
| 0.4165 | 2000 | 0.086         | -               |
| 0.4269 | 2050 | 0.0793        | -               |
| 0.4373 | 2100 | 0.1193        | -               |
| 0.4477 | 2150 | 0.0812        | -               |
| 0.4581 | 2200 | 0.1102        | -               |
| 0.4686 | 2250 | 0.0862        | -               |
| 0.4790 | 2300 | 0.0749        | -               |
| 0.4894 | 2350 | 0.0864        | -               |
| 0.4998 | 2400 | 0.0974        | -               |
| 0.5102 | 2450 | 0.0707        | -               |
| 0.5206 | 2500 | 0.0981        | -               |
| 0.5310 | 2550 | 0.098         | -               |
| 0.5414 | 2600 | 0.0787        | -               |
| 0.5519 | 2650 | 0.1141        | -               |
| 0.5623 | 2700 | 0.0705        | -               |
| 0.5727 | 2750 | 0.0922        | -               |
| 0.5831 | 2800 | 0.0713        | -               |
| 0.5935 | 2850 | 0.1087        | -               |
| 0.6039 | 2900 | 0.0311        | -               |
| 0.6143 | 2950 | 0.0674        | -               |
| 0.6247 | 3000 | 0.0472        | -               |
| 0.6352 | 3050 | 0.0591        | -               |
| 0.6456 | 3100 | 0.0641        | -               |
| 0.6560 | 3150 | 0.0925        | -               |
| 0.6664 | 3200 | 0.0473        | -               |
| 0.6768 | 3250 | 0.0461        | -               |
| 0.6872 | 3300 | 0.0778        | -               |
| 0.6976 | 3350 | 0.0818        | -               |
| 0.7080 | 3400 | 0.0603        | -               |
| 0.7185 | 3450 | 0.0603        | -               |
| 0.7289 | 3500 | 0.0633        | -               |
| 0.7393 | 3550 | 0.09          | -               |
| 0.7497 | 3600 | 0.079         | -               |
| 0.7601 | 3650 | 0.0814        | -               |
| 0.7705 | 3700 | 0.0433        | -               |
| 0.7809 | 3750 | 0.0425        | -               |
| 0.7913 | 3800 | 0.0858        | -               |
| 0.8017 | 3850 | 0.0601        | -               |
| 0.8122 | 3900 | 0.052         | -               |
| 0.8226 | 3950 | 0.1124        | -               |
| 0.8330 | 4000 | 0.0666        | -               |
| 0.8434 | 4050 | 0.0744        | -               |
| 0.8538 | 4100 | 0.099         | -               |
| 0.8642 | 4150 | 0.0734        | -               |
| 0.8746 | 4200 | 0.0996        | -               |
| 0.8850 | 4250 | 0.0761        | -               |
| 0.8955 | 4300 | 0.0848        | -               |
| 0.9059 | 4350 | 0.0414        | -               |
| 0.9163 | 4400 | 0.0596        | -               |
| 0.9267 | 4450 | 0.067         | -               |
| 0.9371 | 4500 | 0.1015        | -               |
| 0.9475 | 4550 | 0.0602        | -               |
| 0.9579 | 4600 | 0.0496        | -               |
| 0.9683 | 4650 | 0.053         | -               |
| 0.9788 | 4700 | 0.0922        | -               |
| 0.9892 | 4750 | 0.0853        | -               |
| 0.9996 | 4800 | 0.0912        | -               |

### Framework Versions
- Python: 3.9.16
- SetFit: 1.0.3
- Sentence Transformers: 2.2.2
- Transformers: 4.21.3
- PyTorch: 1.12.1+cu116
- Datasets: 2.4.0
- Tokenizers: 0.12.1

## Citation

### BibTeX
```bibtex
@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}
```

<!--
## Glossary

*Clearly define terms in order to be accessible across audiences.*
-->

<!--
## Model Card Authors

*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->

<!--
## Model Card Contact

*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->