multi_cased_bert_base_uk.zip — a multilingual cased base BERT model fine-tuned on a combined Ukrainian dataset (SQuAD 2.0 and SDSJ 2017) with the following parameters: epochs: 5, learning rate: 5e-5, max sequence length: 180, batch size: 16. Training used the script developed by the authors of the model (https://github.com/google-research/bert) and ran on an RTX 2080 Ti (11GB). On the squad-2.0-uk test set the model achieves 61.2% exact answers.