<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "https://jats.nlm.nih.gov/publishing/1.3/JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xml:lang="ru">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Computing, Telecommunication and Control</journal-title>
        <trans-title-group xml:lang="ru">
          <trans-title>Информатика, телекоммуникации и управление</trans-title>
        </trans-title-group>
      </journal-title-group>
      <issn pub-type="epub">2687-0517</issn>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id">1</article-id>
      <article-id pub-id-type="doi">10.18721/JCSTCS.18101</article-id>
      <title-group>
        <article-title>Improved anomaly detection by using the attention-based isolation forest with trainable scoring function</article-title>
        <trans-title-group xml:lang="ru">
          <trans-title>Улучшенное обнаружение аномалий с помощью леса изоляции на основе внимания с обучаемой функцией оценки</trans-title>
        </trans-title-group>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid">0000-0002-1562-2676</contrib-id>
          <name>
            <surname>Ageev</surname>
            <given-names>Andrey</given-names>
          </name>
        </contrib>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid">0000-0002-5637-1420</contrib-id>
          <contrib-id contrib-id-type="scopus">7004013271</contrib-id>
          <contrib-id contrib-id-type="researcherid">F-6480-2013</contrib-id>
          <name>
            <surname>Lev</surname>
            <given-names>V.</given-names>
          </name>
          <xref ref-type="aff" rid="aff1"/>
          <email>lev.utkin@mail.ru</email>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Konstantinov</surname>
            <given-names>Andrei</given-names>
          </name>
          <xref ref-type="aff" rid="aff2"/>
          <email>andrue.konst@gmail.com</email>
        </contrib>
      </contrib-group>
      <aff id="aff1">Peter the Great St.Petersburg Polytechnic University</aff>
      <aff id="aff2">Peter the Great St. Petersburg Polytechnic University</aff>
      <pub-date publication-format="electronic" date-type="pub" iso-8601-date="2025-03-31">
        <day>31</day>
        <month>03</month>
        <year>2025</year>
      </pub-date>
      <volume>18</volume>
      <issue>1</issue>
      <fpage>7</fpage>
      <lpage>22</lpage>
      <abstract xml:lang="en">
        <p>This paper proposes a novel anomaly detection model, called Attention-Based Isolation Forest with trainable Scoring Function (ABIF-SF). ABIF-SF enhances the original isolation forest algorithm by incorporating attention weights determined by scoring functions whose parameters are trained using gradient descent. The attention weights indicate the relevance of each data instance to the anomaly assessment task for each tree in the isolation forest. Two scoring functions are explored – scaled dot product and additive attention. Numerical experiments on real-world datasets demonstrate that ABIF-SF achieves better anomaly detection performance compared to isolation forest and attention-based isolation forest with the contamination model. The proposed method simplifies the computation of attention weights by using scoring functions and hinge loss optimization. The code implementation of ABIF-SF has been made publicly available for further research and benchmarking. Overall, the incorporation of trainable scoring functions to compute context-aware attention weights improves isolation forests for anomaly detection tasks.</p>
      </abstract>
      <kwd-group xml:lang="en">
        <kwd>anomaly detection</kwd>
        <kwd>attention mechanism</kwd>
        <kwd>isolation forest</kwd>
        <kwd>Nadaraya–Watson regression</kwd>
        <kwd>quadratic programming</kwd>
        <kwd>contamination model</kwd>
        <kwd>additive attention</kwd>
      </kwd-group>
    </article-meta>
  </front>
</article>
