03647ntm a22005537i 4500 000719541 CZ-PrVSE 20250126140333.0 m d cr n|||||||||| 250126s2024 xr fsbm 000 0 eng d NEZPRACOVANÝ IMPORT ABA006 cze ABA006 ABA006 rda Ježek, Petr ISIS:170704 dis Empirické porovnání velkých jazykových modelů (LLM) eng Empirické porovnání velkých jazykových modelů (LLM) / Petr Ježek 2024 ?? stran : digital, PDF soubor Vedoucí práce: Petr Berka Diplomová práce (Ing.)—Vysoká škola ekonomická v Praze. Fakulta informatiky a statistiky, 2025 Obsahuje bibliografii Textový (vysokoškolská kvalifikační práce) Rok obhajoby 2025 The aim of this paper is to find criteria suitable for evaluating and comparing large language models (LLM) and leveraging those criteria for model evaluation. The work includes a thorough description of large language models and the principles which they are based on, including an introduction to recent important breakthroughs responsible for their growing popularity. Furthermore, this work focuses on extensive analysis of the state of research and literature in the area of evaluation and comparison of large language models in the domain of software engineering. The aim of the thesis is to develop a methodology for the evaluation and comparison of large language models and to apply this methodology on the most popular large language models. The methodology takes the form of a benchmark and comes with a custom CLI application which automates the comparison of large language models in their ability to develop applications written in the Golang programming language using the Test Driven Development methodology. The models are graded based on their ability to fulfill functional requirements and iteratively develop applications which pass a set of automated tests. The generated applications are then reviewed in the qualitative analysis section, where code quality and adherence to best software engineering practices is checked. Also included is an analysis of the strengths and weaknesses of all selected models and recommendations are provided on what each model is suitable for and where caution is advised. Způsob přístupu: Internet znalostní a webové technologie [obor dipl. práce] diplomové práce fd132022 czenas master's theses eczenas large language models LLMs empirical comparison benchmark software engineering test driven development golang Berka, Petr, 1959- jn20001103427 ths Chudán, David js20100609002 opn Vysoká škola ekonomická v Praze. Fakulta informatiky a statistiky kn20010709399 dgg https://insis.vse.cz/zp/88091/podrobnosti VŠKP v InSIS https://insis.vse.cz/zp/88091 Hlavní práce https://insis.vse.cz/zp/88091/posudek/vedouci Hodnocení vedoucího https://insis.vse.cz/zp/88091/posudek/oponent/84706 Oponentura https://insis.vse.cz/zp/88091/priloha/30102 Přiloha k práci https://insis.vse.cz/zp/88091/podrobnosti dc:identifier NEPOSILAT VSKP vse88091 250121 88091