GitHub

MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models

Execute the following command to create the conda environment for inference and evaluation. This environment will install PyTorch 1.13.1 with CUDA 11.6. If your ...
Thorax

Disparities in lung function trajectories among tobacco-exposed individuals

Background The relationship of social determinants of health (SDOH), environmental exposures and medical history to lung function trajectories is underexplored. A better understanding of these ...
GitHub

AI DIAL RAG EVAL

The example of how to get retrieval metrics along with answer inference based on the context. "ctx" refers to 'context' "ans" refers to 'answer' "gt" refers to 'ground truth answer' "ctx_ans_inference ...
IEEE

Frequency Resource Allocation Using Combined Evaluation Function in High Throughput Satellite Communication System

Abstract: The resource allocation in high throughput satellites (HTSs) has been extensively investigated due to their payload ability to provide high-capacity and high-speed communication. To date, ...
IEEE

Evaluation of Model Quantization Method on Vitis-AI for Mitigating Adversarial Examples

Abstract: Adversarial examples (AEs) are typical model evasion attacks and security threats in deep neural networks (DNNs). One of the countermeasures is adversarial training (AT), and it trains DNNs ...