multiel 0.5


pip install multiel

  Latest version

Released: Jun 29, 2023


Meta
Author: Wannaphong
Requires Python: >=3.6

Classifiers

Development Status
  • 3 - Alpha

Programming Language
  • Python :: 3

Intended Audience
  • Developers

License
  • OSI Approved :: MIT License

Topic
  • Scientific/Engineering :: Artificial Intelligence
  • Text Processing
  • Text Processing :: General
  • Text Processing :: Linguistic

MultiEL

Multilingual Entity Linking model by BELA model

This project want to create easy-to-use Multilingual Entity Linking model by BELA model.

Origin Project

Install

pip install multiel

Usage

from multiel import BELA

bela_run = BELA(device="cuda")

print(bela_run.process_batch(["นายกประยุทธ์ประกาศจัดการเลือกตั้ง"]))

output:

[{'offsets': [0], 'lengths': [12], 'entities': ['Q2108126'], 'md_scores': [0.22365164756774902], 'el_scores': [0.6967974901199341]}]

API

from multiel import BELA

BELA(
 md_threshold:float=0.2,
 el_threshold:float=0.4, 
 checkpoint_name: str="wiki", 
 device: str="cuda:0",
 config_name:str="joint_el_mel_new",
 repo:str="wannaphong/BELA"
)
  • md_threshold: md threshold
  • el_threshold: Entity Linking threshold
  • checkpoint_name: checkpoint name (wiki, aida, mewsli, and e2e) or your file name with extension
  • device: device
  • config_name: config name (in the BELA project)
  • repo: Huggingface Hub repo (Default wannaphong/BELA)

Predict

BELA.process_batch([str, str])

License

MIT license and the model is MIT license. (BELA is MIT licensed)

Wheel compatibility matrix

Platform Python 3
any

Files in release

Extras: None
Dependencies:
faiss-gpu
fairscale
hydra-core
hydra-submitit-launcher
pyyaml
pytorch-lightning
transformers
tqdm
sentencepiece
h5py
protobuf (==3.20)
ujson
huggingface-hub
accelerate (>=0.9.0)