title: FashionReGen: LLM-Empowered Fashion Report Generation

abstract: Fashion analysis refers to the process of examining and evaluating trends, styles, and elements within the fashion industry to understand and interpret its current state, generating fashion reports. It is traditionally performed by fashion professionals based on their expertise and experience, which requires high labour cost and may also produce biased results for relying heavily on a small group of people. In this paper, to tackle the Fashion Report Generation (FashionReGen) task, we propose an intelligent Fashion Analyzing and Reporting system based the advanced Large Language Models (LLMs), debbed as GPT-FAR. Specifically, it tries to deliver FashionReGen based on effective catwalk analysis, which is equipped with several key procedures, namely, catwalk understanding, collective organization and analysis, and report generation. By posing and exploring such an open-ended, complex and domain-specific task of FashionReGen, it is able to test the general capability of LLMs in fashion domain. It also inspires the explorations of more high-level tasks with industrial significance in other domains. Video illustration and more materials of GPT-FAR can be found in https://github.com/CompFashion/FashionReGen.


title: epsilon-Mesh Attack: A Surface-based Adversarial Point Cloud Attack for Facial Expression Recognition

abstract: Point clouds and meshes are widely used 3D data structures for many computer vision applications. While the meshes represent the surfaces of an object, point cloud represents sampled points from the surface which is also the output of modern sensors such as LiDAR and RGB-D cameras. Due to the wide application area of point clouds and the recent advancements in deep neural networks, studies focusing on robust classification of the 3D point cloud data emerged. To evaluate the robustness of deep classifier networks, a common method is to use adversarial attacks where the gradient direction is followed to change the input slightly. The previous studies on adversarial attacks are generally evaluated on point clouds of daily objects. However, considering 3D faces, these adversarial attacks tend to affect the person's facial structure more than the desired amount and cause malformation. Specifically for facial expressions, even a small adversarial attack can have a significant effect on the face structure. In this paper, we suggest an adversarial attack called $\epsilon$-Mesh Attack, which operates on point cloud data via limiting perturbations to be on the mesh surface. We also parameterize our attack by $\epsilon$ to scale the perturbation mesh. Our surface-based attack has tighter perturbation bounds compared to $L_2$ and $L_\infty$ norm bounded attacks that operate on unit-ball. Even though our method has additional constraints, our experiments on CoMA, Bosphorus and FaceWarehouse datasets show that $\epsilon$-Mesh Attack (Perpendicular) successfully confuses trained DGCNN and PointNet models $99.72\%$ and $97.06\%$ of the time, with indistinguishable facial deformations. The code is available at https://github.com/batuceng/e-mesh-attack.


title: A PDE Framework of Consensus-Based Optimization for Objectives with Multiple Global Minimizers

abstract: Consensus-based optimization (CBO) is an agent-based derivative-free method for non-smooth global optimization that has been introduced in 2017, leveraging a surprising interplay between stochastic exploration and Laplace principle. In addition to its versatility and effectiveness in handling high-dimensional, non-convex, and nonsmooth optimization problems, this approach lends itself well to theoretical analysis. Indeed, its dynamics is governed by a degenerate nonlinear Fokker-Planck equation, whose large-time behavior explains the convergence of the method. Recent results provide guarantees of convergence under the restrictive assumption of a unique global minimizer for the objective function. In this work, we proposed a novel and simple variation of CBO to tackle nonconvex optimizations with multiple minimizers. Despite the simplicity of this new model, its analysis is particularly challenging because of its nonlinearity and nonlocal nature. We prove the existence of solutions of the corresponding nonlinear Fokker-Planck equation and we show exponential concentration in time to the set of minimizers made of multiple smooth, convex, and compact components. Our proofs require combining several ingredients, such as delicate geometrical arguments, new variants of a quantitative Laplace principle, ad hoc regularizations and approximations, and regularity theory for parabolic equations. Ultimately, this result suggests that the corresponding CBO algorithm, formulated as an Euler-Maruyama discretization of the underlying empirical stochastic process, tends to converge to global minimizers.


title: Anick resolution for the free unitary quantum group

abstract: A resolution $P$ of the counit of the Hopf $\ast$-algebra $\mathcal{O}(U_n^+)$ of representative functions on van Daele and Wang's free unitary quantum group $U_n^+$ in terms of free $\mathcal{O}(U_n^+)$-modules is computed for arbitrary $n$. A different such resolution was recently found by Baraquin, Franz, Gerhold, Kula and Tobolski. While theirs has desirable properties which $P$ lacks, $P$ is still good enough to compute the (previously known) quantum group cohomology and comes instead with an important advantage: $P$ can be arrived at without the clever combination of certain results potentially very particular to $U_n^+$ that enabled the aforementioned authors to find their resolution. Especially, $P$ relies neither on the resolution for $O_n^+$ obtained by Collins, H\"artel and Thom nor the one for $SL_2(q)$ found by Hadfield and Kr\"ahmer. Rather, as shown in the present article, the recursion defining the Anick resolution of the counit of $\mathcal{O}(U_n^+)$ can be solved in closed form. That suggests a potential strategy for determining the cohomologies of arbitrary easy quantum groups.


title: Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System

abstract: The recent huge advance of Large Language Models (LLMs) is mainly driven by the increase in the number of parameters. This has led to substantial memory capacity requirements, necessitating the use of dozens of GPUs just to meet the capacity. One popular solution to this is storage-offloaded training, which uses host memory and storage as an extended memory hierarchy. However, this obviously comes at the cost of storage bandwidth bottleneck because storage devices have orders of magnitude lower bandwidth compared to that of GPU device memories. Our work, Smart-Infinity, addresses the storage bandwidth bottleneck of storage-offloaded LLM training using near-storage processing devices on a real system. The main component of Smart-Infinity is SmartUpdate, which performs parameter updates on custom near-storage accelerators. We identify that moving parameter updates to the storage side removes most of the storage traffic. In addition, we propose an efficient data transfer handler structure to address the system integration issues for Smart-Infinity. The handler allows overlapping data transfers with fixed memory consumption by reusing the device buffer. Lastly, we propose accelerator-assisted gradient compression/decompression to enhance the scalability of Smart-Infinity. When scaling to multiple near-storage processing devices, the write traffic on the shared channel becomes the bottleneck. To alleviate this, we compress the gradients on the GPU and decompress them on the accelerators. It provides further acceleration from reduced traffic. As a result, Smart-Infinity achieves a significant speedup compared to the baseline. Notably, Smart-Infinity is a ready-to-use approach that is fully integrated into PyTorch on a real system. We will open-source Smart-Infinity to facilitate its use.


title: Experimental realization of universal quantum gates and six-qubit state using photonic quantum walk

abstract: Controlled quantum walk forms the basis for various quantum algorithm and quantum simulation schemes. Though theoretical proposals are also available to realize universal quantum computation using quantum walks, no experimental demonstration of universal set of gates has been reported. Here we report the experimental realize of universal set of quantum gates using photonic quantum walk. Taking cue from the discrete-time quantum walk formalism, we encode multiple qubits using polarization and paths degree of freedom for photon and demonstrate realization of universal set of gates with 100\% success probability and high fidelity, as characterised by quantum state tomography. For a 3-qubit system we encode first qubit with $H$ and $V-$polarization of photon and path information for the second and third qubit, closely resembling a Mach-Zehnder interference setup. To generate a 6-qubit system and demonstrate 6-qubit GHZ state, entangled photon pairs are used as source to two 3-qubit systems. We also provide insights into the mapping of quantum circuits to quantum walk operations on photons and way to resourcefully scale. This work marks a significant progress towards using photonic quantum walk for quantum computing. It also provides a framework for photonic quantum computing using lesser number of photons in combination with path degree of freedom to increase the success rate of multi-qubit gate operations.


title: Beyond Pairwise: Higher-order physical interactions affect phase separation in multi-component liquids

abstract: Phase separation, crucial for spatially segregating biomolecules in cells, is well-understood in the simple case of a few components with pairwise interactions. Yet, biological cells challenge the simple picture in at least two ways: First, biomolecules, like proteins and nucleic acids, exhibit complex, higher-order interactions, where a single molecule may interact with multiple others simultaneously. Second, cells comprise a myriad of different components that form various droplets. Such multicomponent phase separation has been studied in the simple case of pairwise interactions, but an analysis of higher-order interactions is lacking. We propose such a theory and study the corresponding phase diagrams numerically. We find that interactions between three components are similar to pairwise interactions, whereas composition-dependent higher-order interactions between two components can oppose phase separation. This surprising result can only be revealed from the equilibrium phase diagrams, implying that the often-used stability analysis of homogeneous states is inadequate to study these systems. We thus show that higher-order interactions could play a crucial role in forming droplets in cells, and their manipulation could offer novel approaches to controlling multicomponent phase separation.


title: Optimal Bounds for Distinct Quartics

abstract: A fundamental concept related to strings is that of repetitions. It has been extensively studied in many versions, from both purely combinatorial and algorithmic angles. One of the most basic questions is how many distinct squares, i.e., distinct strings of the form $UU$, a string of length $n$ can contain as fragments. It turns out that this is always $\mathcal{O}(n)$, and the bound cannot be improved to sublinear in $n$ [Fraenkel and Simpson, JCTA 1998]. Several similar questions about repetitions in strings have been considered, and by now we seem to have a good understanding of their repetitive structure. For higher-dimensional strings, the basic concept of periodicity has been successfully extended and applied to design efficient algorithms -- it is inherently more complex than for regular strings. Extending the notion of repetitions and understanding the repetitive structure of higher-dimensional strings is however far from complete. Quartics were introduced by Apostolico and Brimkov [TCS 2000] as analogues of squares in two dimensions. Charalampopoulos, Radoszewski, Rytter, Wale\'n, and Zuba [ESA 2020] proved that the number of distinct quartics in an $n\times n$ 2D string is $\mathcal{O}(n^2 \log^2 n)$ and that they can be computed in $\mathcal{O}(n^2 \log^2 n)$ time. Gawrychowski, Ghazawi, and Landau [SPIRE 2021] constructed an infinite family of $n \times n$ 2D strings with $\Omega(n^2 \log n)$ distinct quartics. This brings the challenge of determining asymptotically tight bounds. Here, we settle both the combinatorial and the algorithmic aspects of this question: the number of distinct quartics in an $n\times n$ 2D string is $\mathcal{O}(n^2 \log n)$ and they can be computed in the worst-case optimal $\mathcal{O}(n^2 \log n)$ time.


title: PeerAiD: Improving Adversarial Distillation from a Specialized Peer Tutor

abstract: Adversarial robustness of the neural network is a significant concern when it is applied to security-critical domains. In this situation, adversarial distillation is a promising option which aims to distill the robustness of the teacher network to improve the robustness of a small student network. Previous works pretrain the teacher network to make it robust against the adversarial examples aimed at itself. However, the adversarial examples are dependent on the parameters of the target network. The fixed teacher network inevitably degrades its robustness against the unseen transferred adversarial examples which target the parameters of the student network in the adversarial distillation process. We propose PeerAiD to make a peer network learn the adversarial examples of the student network instead of adversarial examples aimed at itself. PeerAiD is an adversarial distillation that trains the peer network and the student network simultaneously in order to specialize the peer network for defending the student network. We observe that such peer networks surpass the robustness of the pretrained robust teacher model against adversarial examples aimed at the student network. With this peer network and adversarial distillation, PeerAiD achieves significantly higher robustness of the student network with AutoAttack (AA) accuracy by up to 1.66%p and improves the natural accuracy of the student network by up to 4.72%p with ResNet-18 on TinyImageNet dataset. Code is available at https://github.com/jaewonalive/PeerAiD.


title: Performance of Expansive Soil Stabilized with Bamboo Charcoal, Quarry Dust, and Lime for Use as Road Subgrade Material

abstract: Expansive soils such as Black Cotton Soils (BCS) present significant challenges for road subgrade construction due to their high plasticity, swelling potential, and low strength. This study explores a triphasic stabilization method using Bamboo Charcoal (BC), Quarry Dust (QD), and Lime (L) to enhance the engineering properties of BCS for rural road applications. Initial soil characterization involved standard tests, including Atterberg limits, compaction, and Californian Bearing Ratio (CBR) assessments. The soil was treated with varying BC proportions (5% to 35% at 5% intervals) in the initial phase, leading to a progressive reduction in the Plasticity Index (PI) and swell index and an enhancement in the CBR up to 20% BC content. This further resulted in a soaked CBR value of 2.7%. In the second phase, additional treatment combined with BC and QD, incorporating diverse QD proportions (4% to 24%) relative to the optimal BC content. This further improved the CBR to 7.7% at 12% QD, but the PI exhibited a non-linear trend. Finally, 5% lime was introduced in the final phase. This minimized the PI to 11.2% and significantly increased the CBR to 19%. The optimal combination of 20% BC, 12% QD, and 5% Lime achieved optimal plasticity, compaction, and strength characteristics, demonstrating the viability of this approach for transforming BCS into a sustainable and cost-effective alternative for rural road subgrade construction.


title: CEAT: Continual Expansion and Absorption Transformer for Non-Exemplar Class-Incremental Learning

abstract: In real-world applications, dynamic scenarios require the models to possess the capability to learn new tasks continuously without forgetting the old knowledge. Experience-Replay methods store a subset of the old images for joint training. In the scenario of more strict privacy protection, storing the old images becomes infeasible, which leads to a more severe plasticity-stability dilemma and classifier bias. To meet the above challenges, we propose a new architecture, named continual expansion and absorption transformer~(CEAT). The model can learn the novel knowledge by extending the expanded-fusion layers in parallel with the frozen previous parameters. After the task ends, we losslessly absorb the extended parameters into the backbone to ensure that the number of parameters remains constant. To improve the learning ability of the model, we designed a novel prototype contrastive loss to reduce the overlap between old and new classes in the feature space. Besides, to address the classifier bias towards the new classes, we propose a novel approach to generate the pseudo-features to correct the classifier. We experiment with our methods on three standard Non-Exemplar Class-Incremental Learning~(NECIL) benchmarks. Extensive experiments demonstrate that our model gets a significant improvement compared with the previous works and achieves 5.38%, 5.20%, and 4.92% improvement on CIFAR-100, TinyImageNet, and ImageNet-Subset.


title: Untangling Gaussian Mixtures

abstract: Tangles were originally introduced as a concept to formalize regions of high connectivity in graphs. In recent years, they have also been discovered as a link between structural graph theory and data science: when interpreting similarity in data sets as connectivity between points, finding clusters in the data essentially amounts to finding tangles in the underlying graphs. This paper further explores the potential of tangles in data sets as a means for a formal study of clusters. Real-world data often follow a normal distribution. Accounting for this, we develop a quantitative theory of tangles in data sets drawn from Gaussian mixtures. To this end, we equip the data with a graph structure that models similarity between the points and allows us to apply tangle theory to the data. We provide explicit conditions under which tangles associated with the marginal Gaussian distributions exist asymptotically almost surely. This can be considered as a sufficient formal criterion for the separabability of clusters in the data.


title: Provable Mutual Benefits from Federated Learning in Privacy-Sensitive Domains

abstract: Cross-silo federated learning (FL) allows data owners to train accurate machine learning models by benefiting from each others private datasets. Unfortunately, the model accuracy benefits of collaboration are often undermined by privacy defenses. Therefore, to incentivize client participation in privacy-sensitive domains, a FL protocol should strike a delicate balance between privacy guarantees and end-model accuracy. In this paper, we study the question of when and how a server could design a FL protocol provably beneficial for all participants. First, we provide necessary and sufficient conditions for the existence of mutually beneficial protocols in the context of mean estimation and convex stochastic optimization. We also derive protocols that maximize the total clients' utility, given symmetric privacy preferences. Finally, we design protocols maximizing end-model accuracy and demonstrate their benefits in synthetic experiments.


title: Ensemble inequivalence in long-range quantum systems

abstract: Ensemble inequivalence, i.e. the possibility of observing different thermodynamic properties depending on the statistical ensemble which describes the system, is one of the hallmarks of long-range physics, which has been demonstrated in numerous classical systems. Here, an example of ensemble inequivalence of a long-range quantum ferromagnet is presented. While the $T=0$ microcanonical quantum phase-diagram coincides with that in the canonical ensemble, the phase-diagrams of the two ensembles are different at finite temperature. This is in contrast with the common lore of statistical mechanics of systems with short-range interactions where thermodynamic properties are bound to coincide for macroscopic systems described by different ensembles. The consequences of these findings in the context of atomic, molecular and optical (AMO) setups are delineated.


title: Car Damage Detection and Patch-to-Patch Self-supervised Image Alignment

abstract: Most computer vision applications aim to identify pixels in a scene and use them for diverse purposes. One intriguing application is car damage detection for insurance carriers which tends to detect all car damages by comparing both pre-trip and post-trip images, even requiring two components: (i) car damage detection; (ii) image alignment. Firstly, we implemented a Mask R-CNN model to detect car damages on custom images. Whereas for the image alignment section, we especially propose a novel self-supervised Patch-to-Patch SimCLR inspired alignment approach to find perspective transformations between custom pre/post car rental images except for traditional computer vision methods.


title: Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Code

abstract: AI-based code generators have gained a fundamental role in assisting developers in writing software starting from natural language (NL). However, since these large language models are trained on massive volumes of data collected from unreliable online sources (e.g., GitHub, Hugging Face), AI models become an easy target for data poisoning attacks, in which an attacker corrupts the training data by injecting a small amount of poison into it, i.e., astutely crafted malicious samples. In this position paper, we address the security of AI code generators by identifying a novel data poisoning attack that results in the generation of vulnerable code. Next, we devise an extensive evaluation of how these attacks impact state-of-the-art models for code generation. Lastly, we discuss potential solutions to overcome this threat.


title: CAM Back Again: Large Kernel CNNs from a Weakly Supervised Object Localization Perspective

abstract: Recently, convolutional neural networks (CNNs) with large size kernels have attracted much attention in the computer vision field, following the success of the Vision Transformers. Large kernel CNNs have been reported to perform well in downstream vision tasks as well as in classification performance. The reason for the high-performance of large kernel CNNs in downstream tasks has been attributed to the large effective receptive field (ERF) produced by large size kernels, but this view has not been fully tested. We therefore revisit the performance of large kernel CNNs in downstream task, focusing on the weakly supervised object localization (WSOL) task. WSOL, a difficult downstream task that is not fully supervised, provides a new angle to explore the capabilities of the large kernel CNNs. Our study compares the modern large kernel CNNs ConvNeXt, RepLKNet, and SLaK to test the validity of the naive expectation that ERF size is important for improving downstream task performance. Our analysis of the factors contributing to high performance provides a different perspective, in which the main factor is feature map improvement. Furthermore, we find that modern CNNs are robust to the CAM problems of local regions of objects being activated, which has long been discussed in WSOL. CAM is the most classic WSOL method, but because of the above-mentioned problems, it is often used as a baseline method for comparison. However, experiments on the CUB-200-2011 dataset show that simply combining a large kernel CNN, CAM, and simple data augmentation methods can achieve performance (90.99% MaxBoxAcc) comparable to the latest WSOL method, which is CNN-based and requires special training or complex post-processing. The code is available at https://github.com/snskysk/CAM-Back-Again.


title: Streamlining in the Riemannian Realm: Efficient Riemannian Optimization with Loopless Variance Reduction

abstract: In this study, we investigate stochastic optimization on Riemannian manifolds, focusing on the crucial variance reduction mechanism used in both Euclidean and Riemannian settings. Riemannian variance-reduced methods usually involve a double-loop structure, computing a full gradient at the start of each loop. Determining the optimal inner loop length is challenging in practice, as it depends on strong convexity or smoothness constants, which are often unknown or hard to estimate. Motivated by Euclidean methods, we introduce the Riemannian Loopless SVRG (R-LSVRG) and PAGE (R-PAGE) methods. These methods replace the outer loop with probabilistic gradient computation triggered by a coin flip in each iteration, ensuring simpler proofs, efficient hyperparameter selection, and sharp convergence guarantees. Using R-PAGE as a framework for non-convex Riemannian optimization, we demonstrate its applicability to various important settings. For example, we derive Riemannian MARINA (R-MARINA) for distributed settings with communication compression, providing the best theoretical communication complexity guarantees for non-convex distributed optimization over Riemannian manifolds. Experimental results support our theoretical findings.


title: Observing neutrinos from failed Supernovae at LNGS

abstract: We discuss the possibility to observe neutrinos emitted from a failed core collapse Supernova in the various experiments at Laboratori Nazionali del Gran Sasso. We show that the veto regions of dark matter and neutrinoless double beta decay experiments can be used as a network of small detectors to measure Supernova neutrinos. In addition we show that this network can measure very precisely the moment of black hole formation, which can be then used in the nearby VIRGO detector and future Einstein Telescope to look for the gravitational wave counterpart to the neutrino signal.

categories: astro-ph.HE hep-ex hep-ph physics.ins-det


title: Answering Diverse Questions via Text Attached with Key Audio-Visual Clues

abstract: Audio-visual question answering (AVQA) requires reference to video content and auditory information, followed by correlating the question to predict the most precise answer. Although mining deeper layers of audio-visual information to interact with questions facilitates the multimodal fusion process, the redundancy of audio-visual parameters tends to reduce the generalization of the inference engine to multiple question-answer pairs in a single video. Indeed, the natural heterogeneous relationship between audiovisuals and text makes the perfect fusion challenging, to prevent high-level audio-visual semantics from weakening the network's adaptability to diverse question types, we propose a framework for performing mutual correlation distillation (MCD) to aid question inference. MCD is divided into three main steps: 1) firstly, the residual structure is utilized to enhance the audio-visual soft associations based on self-attention, then key local audio-visual features relevant to the question context are captured hierarchically by shared aggregators and coupled in the form of clues with specific question vectors. 2) Secondly, knowledge distillation is enforced to align audio-visual-text pairs in a shared latent space to narrow the cross-modal semantic gap. 3) And finally, the audio-visual dependencies are decoupled by discarding the decision-level integrations. We evaluate the proposed method on two publicly available datasets containing multiple question-and-answer pairs, i.e., Music-AVQA and AVQA. Experiments show that our method outperforms other state-of-the-art methods, and one interesting finding behind is that removing deep audio-visual features during inference can effectively mitigate overfitting. The source code is released at http://github.com/rikeilong/MCD-forAVQA.


title: Identifikation ausl\"osender Umst\"ande von SOTIF-Gef\"ahrdungen durch systemtheoretische Prozessanalyse

abstract: Developers have to obtain a sound understanding of existing risk potentials already in the concept phase of driverless vehicles. Deductive as well as inductive SOTIF analyses of potential triggering conditions for hazardous behavior help to achieve this goal. In this regard, ISO 21448 suggests conducting a System-Theoretic Process Analysis (STPA). In this article, we introduce German terminology for SOTIF considerations and critically discuss STPA theory in the course of an example application, while also proposing methodological additions. -- -- Um bereits in der Konzeptphase autonomer Fahrzeuge einen fundierten Eindruck bestehender Risikopotenziale zu erhalten, werden im Zuge von deduktiven und induktiven SOTIF-Analysen m\"ogliche ausl\"osende Umst\"ande f\"ur gef\"ahrliches Verhalten untersucht. In diesem Zusammenhang wird in der ISO 21448 die Durchf\"uhrung einer systemtheoretischen Prozessanalyse (STPA) vorgeschlagen. In diesem Beitrag f\"uhren wir deutsche Terminologie f\"ur SOTIF-Betrachtungen ein und setzen uns im Zuge einer Anwendung kritisch mit der STPA-Theorie auseinander, wobei wir begleitend methodische Erg\"anzungen anregen.


title: Out-of-distribution Partial Label Learning

abstract: Partial Label Learning (PLL) tackles model learning from the data with inexact labels under the assumption that training and test objects are in the same distribution, i.e., closed-set scenario. Nevertheless, this assumption does not hold in real-world open-set scenarios where test data may come from Out-Of-Distribution (OOD), resulting in object detection failure and hence significantly compromising the PLL model's security and trustworthiness. This is a previously unexplored problem called Out-Of-Distribution Partial Label Learning (OODPLL) that our newly proposed PLOOD framework can effectively resolve. During the training phase, our framework leverages self-supervised learning strategy to generate positive and negative samples for each object, emulating in and out-of-distributions respectively. Under these distributions, PLL methods can learn discriminative features for OOD objects. In the inference phase, a novel Partial Energy (PE) scoring technique is proposed which leverages the label confidence established during the above training phase to mine the actual labels. In this way, the issue of inexact labeling in PLL can be effectively addressed for significantly better performance in OOD object detection. PLOOD is compared with SOTA PLL models and OOD scores on CIFAR-10 and CIFAR-100 datasets against various OOD datasets. The results demonstrate the effectiveness of our PLOOD framework, significantly outperforming SOTA PLL models and marking a substantial advancement in addressing PLL problems in real-world OOD scenarios.


title: Restoring Ancient Ideograph: A Multimodal Multitask Neural Network Approach

abstract: Cultural heritage serves as the enduring record of human thought and history. Despite significant efforts dedicated to the preservation of cultural relics, many ancient artefacts have been ravaged irreversibly by natural deterioration and human actions. Deep learning technology has emerged as a valuable tool for restoring various kinds of cultural heritages, including ancient text restoration. Previous research has approached ancient text restoration from either visual or textual perspectives, often overlooking the potential of synergizing multimodal information. This paper proposes a novel Multimodal Multitask Restoring Model (MMRM) to restore ancient texts, particularly emphasising the ideograph. This model combines context understanding with residual visual information from damaged ancient artefacts, enabling it to predict damaged characters and generate restored images simultaneously. We tested the MMRM model through experiments conducted on both simulated datasets and authentic ancient inscriptions. The results show that the proposed method gives insightful restoration suggestions in both simulation experiments and real-world scenarios. To the best of our knowledge, this work represents the pioneering application of multimodal deep learning in ancient text restoration, which will contribute to the understanding of ancient society and culture in digital humanities fields.


title: Transferring Relative Monocular Depth to Surgical Vision with Temporal Consistency

abstract: Relative monocular depth, inferring depth up to shift and scale from a single image, is an active research topic. Recent deep learning models, trained on large and varied meta-datasets, now provide excellent performance in the domain of natural images. However, few datasets exist which provide ground truth depth for endoscopic images, making training such models from scratch unfeasible. This work investigates the transfer of these models into the surgical domain, and presents an effective and simple way to improve on standard supervision through the use of temporal consistency self-supervision. We show temporal consistency significantly improves supervised training alone when transferring to the low-data regime of endoscopy, and outperforms the prevalent self-supervision technique for this task. In addition we show our method drastically outperforms the state-of-the-art method from within the domain of endoscopy. We also release our code, model and ensembled meta-dataset, Meta-MED, establishing a strong benchmark for future work.


title: The associated graded algebras of Brauer graph algebras II: infinite representation type

abstract: Let $G$ be a Brauer graph and $A$ the associated Brauer graph algebra. Denote by $gr(A)$ the graded algebra associated with the radical filtration of $A$. The question when $gr(A)$ is of finite representation type was answered in [9]. In the present paper, we characterize when $gr(A)$ is domestic in terms of the associated Brauer graph $G$.


title: NLP4RE Tools: Classification, Overview, and Management

abstract: Tools constitute an essential contribution to natural language processing for requirements engineering (NLP4RE) research. They are executable instruments that make research usable and applicable in practice. In this chapter, we first introduce a systematic classification of NLP4RE tools to improve the understanding of their types and properties. Then, we extend an existing overview with a systematic summary of 126 NLP4RE tools published between April 2019 and June 2023 to ease reuse and evolution of existing tools. Finally, we provide instructions on how to create, maintain, and disseminate NLP4RE tools to support a more rigorous management and dissemination.


title: Non-convex relaxation and 1/2-approximation algorithm for the chance-constrained binary knapsack problem

abstract: We consider the chance-constrained binary knapsack problem (CKP), where the item weights are independent and normally distributed. We introduce a continuous relaxation for the CKP, represented as a non-convex optimization problem, which we call the non-convex relaxation. A comparative study shows that the non-convex relaxation provides an upper bound for the CKP, at least as tight as those obtained from other continuous relaxations for the CKP. Furthermore, the quality of the obtained upper bound is guaranteed to be at most twice the optimal objective value of the CKP. Despite its non-convex nature, we show that the non-convex relaxation can be solved in polynomial time. Subsequently, we proposed a polynomial-time 1/2-approximation algorithm for the CKP based on this relaxation, providing a lower bound for the CKP. Computational test results demonstrate that the non-convex relaxation and the proposed approximation algorithm yields tight lower and upper bounds for the CKP within a short computation time, ensuring the quality of the obtained bounds.


title: Advancing Graph Neural Networks with HL-HGAT: A Hodge-Laplacian and Attention Mechanism Approach for Heterogeneous Graph-Structured Data

abstract: Graph neural networks (GNNs) have proven effective in capturing relationships among nodes in a graph. This study introduces a novel perspective by considering a graph as a simplicial complex, encompassing nodes, edges, triangles, and $k$-simplices, enabling the definition of graph-structured data on any $k$-simplices. Our contribution is the Hodge-Laplacian heterogeneous graph attention network (HL-HGAT), designed to learn heterogeneous signal representations across $k$-simplices. The HL-HGAT incorporates three key components: HL convolutional filters (HL-filters), simplicial projection (SP), and simplicial attention pooling (SAP) operators, applied to $k$-simplices. HL-filters leverage the unique topology of $k$-simplices encoded by the Hodge-Laplacian (HL) operator, operating within the spectral domain of the $k$-th HL operator. To address computation challenges, we introduce a polynomial approximation for HL-filters, exhibiting spatial localization properties. Additionally, we propose a pooling operator to coarsen $k$-simplices, combining features through simplicial attention mechanisms of self-attention and cross-attention via transformers and SP operators, capturing topological interconnections across multiple dimensions of simplices. The HL-HGAT is comprehensively evaluated across diverse graph applications, including NP-hard problems, graph multi-label and classification challenges, and graph regression tasks in logistics, computer vision, biology, chemistry, and neuroscience. The results demonstrate the model's efficacy and versatility in handling a wide range of graph-based scenarios.


title: Ground-state chiral current via periodic modulation

abstract: In this study, we engineer the Dzyaloshinskii-Moriya interaction mediated by photons to emulate ground-state chiral current based on three-level atoms driven by quantum and classical fields. We employ adiabatic elimination techniques to derive an effective Dzyaloshinskii-Moriya interaction Hamiltonian of two-level systems, which can address the challenges arising from the finite lifetime of excited states. Furthermore, we can ensure to achieve desired dynamics through the implementation of periodic modulation on the atomic ground states. Besides, three-state and multi-state chiral current can be obtained by choosing appropriate driving frequencies and phases. We also design the Dzyaloshinskii-Moriya interaction for the other components based on a toggling frame. The numerical simulation results further indicate that our proposal can generate a perfectly reliable ground-state chiral current and open up possibilities for quantum state transfer and the development of future quantum networks.


title: Dynamics of matrix coupled Kuramoto oscillators on modular networks: excitable behavior and global decoherence

abstract: Synchronization is observed in many natural systems, with examples ranging from neuronal activation to walking pedestrians. The models proposed by Winfree and Kuramoto stand as the classic frameworks for investigating these phenomena. The Kuramoto model, in particular, has been extended in different ways since its original formulation to account for more general scenarios. One such extension replaces the coupling parameter with a coupling matrix, describing a form of generalized frustration with broken rotational symmetry. A key feature of this model is the existence of {\it phase tuned states}, characterized by having the phase of the order parameter pointing in the direction of the dominant eigenvector of the coupling matrix. Here we investigate the matrix coupled Kuramoto model on networks with two modules, such that one module is in the phase tuned state and the other in a state where the order parameter rotates. We identified different regimes in which one or the other module dominates the dynamics. We found, in particular, that the phase tuned module can create a bottleneck for the oscillation of the rotating module, leading to a behavior similar to the charge and fire regimes of excitable systems. We also found an extended region in the parameter space where motion is globally disordered, even though one of the modules presented high levels of synchronization when uncoupled.


title: From S-matrix theory to strings: Scattering data and the commitment to non-arbitrariness

abstract: The early history of string theory is marked by a shift from strong interaction physics to quantum gravity. The first string models and associated theoretical framework were formulated in the late 1960s and early 1970s in the context of the S-matrix program for the strong interactions. In the mid-1970s, the models were reinterpreted as a potential theory unifying the four fundamental forces. This paper provides a historical analysis of how string theory was developed out of S-matrix physics, aiming to clarify how modern string theory, as a theory detached from experimental data, grew out of an S-matrix program that was strongly dependent upon observable quantities. Surprisingly, the theoretical practice of physicists already turned away from experiment before string theory was recast as a potential unified quantum gravity theory. With the formulation of dual resonance models (the "hadronic string theory"), physicists were able to determine almost all of the models' parameters on the basis of theoretical reasoning. It was this commitment to "non-arbitrariness", i.e., a lack of free parameters in the theory, that initially drove string theorists away from experimental input, and not the practical inaccessibility of experimental data in the context of quantum gravity physics. This is an important observation when assessing the role of experimental data in string theory.


title: Approximating Maximum Edge 2-Coloring by Normalizing Graphs

abstract: In a simple, undirected graph G, an edge 2-coloring is a coloring of the edges such that no vertex is incident to edges with more than 2 distinct colors. The problem maximum edge 2-coloring (ME2C) is to find an edge 2-coloring in a graph G with the goal to maximize the number of colors. For a relevant graph class, ME2C models anti-Ramsey numbers and it was considered in network applications. For the problem a 2-approximation algorithm is known, and if the input graph has a perfect matching, the same algorithm has been shown to have a performance guarantee of 5/3. It is known that ME2C is APX-hard and that it is UG-hard to obtain an approximation ratio better than 1.5. We show that if the input graph has a perfect matching, there is a polynomial time 1.625-approximation and if the graph is claw-free or if the maximum degree of the input graph is at most three (i.e., the graph is subcubic), there is a polynomial time 1.5-approximation algorithm for ME2C


title: Log motivic exceptional direct image functors

abstract: In this paper, we construct the motivic exceptional direct image functors for fs log schemes. This construction is a part of the motivic six-functor formalism for fs log schemes.


title: Chart4Blind: An Intelligent Interface for Chart Accessibility Conversion

abstract: In a world driven by data visualization, ensuring the inclusive accessibility of charts for Blind and Visually Impaired (BVI) individuals remains a significant challenge. Charts are usually presented as raster graphics without textual and visual metadata needed for an equivalent exploration experience for BVI people. Additionally, converting these charts into accessible formats requires considerable effort from sighted individuals. Digitizing charts with metadata extraction is just one aspect of the issue; transforming it into accessible modalities, such as tactile graphics, presents another difficulty. To address these disparities, we propose Chart4Blind, an intelligent user interface that converts bitmap image representations of line charts into universally accessible formats. Chart4Blind achieves this transformation by generating Scalable Vector Graphics (SVG), Comma-Separated Values (CSV), and alternative text exports, all comply with established accessibility standards. Through interviews and a formal user study, we demonstrate that even inexperienced sighted users can make charts accessible in an average of 4 minutes using Chart4Blind, achieving a System Usability Scale rating of 90%. In comparison to existing approaches, Chart4Blind provides a comprehensive solution, generating end-to-end accessible SVGs suitable for assistive technologies such as embossed prints (papers and laser cut), 2D tactile displays, and screen readers. For additional information, including open-source codes and demos, please visit our project page https://moured.github.io/chart4blind/.


title: $C_{2k+1}$-coloring of bounded-diameter graphs

abstract: For a fixed graph $H$, in the graph homomorphism problem, denoted by $Hom(H)$, we are given a graph $G$ and we have to determine whether there exists an edge-preserving mapping $\varphi: V(G) \to V(H)$. Note that $Hom(C_3)$, where $C_3$ is the cycle of length $3$, is equivalent to $3$-Coloring. The question whether $3$-Coloring is polynomial-time solvable on diameter-$2$ graphs is a well-known open problem. In this paper we study the $Hom(C_{2k+1})$ problem on bounded-diameter graphs for $k\geq 2$, so we consider all other odd cycles than $C_3$. We prove that for $k\geq 2$, the $Hom(C_{2k+1})$ problem is polynomial-time solvable on diameter-$(k+1)$ graphs -- note that such a result for $k=1$ would be precisely a polynomial-time algorithm for $3$-Coloring of diameter-$2$ graphs. Furthermore, we give subexponential-time algorithms for diameter-$(k+2)$ and -$(k+3)$ graphs. We complement these results with a lower bound for diameter-$(2k+2)$ graphs -- in this class of graphs the $Hom(C_{2k+1})$ problem is NP-hard and cannot be solved in subexponential-time, unless the ETH fails. Finally, we consider another direction of generalizing $3$-Coloring on diameter-$2$ graphs. We consider other target graphs $H$ than odd cycles but we restrict ourselves to diameter $2$. We show that if $H$ is triangle-free, then $Hom(H)$ is polynomial-time solvable on diameter-$2$ graphs.


title: A Minority of C++ Objects Account for the Majority of Allocation CPU Time

abstract: In C++, an object can be allocated in static memory, on the stack, or on the heap, where the latter is by the order of magnitude more expensive operation, performance wise, than the first two. However, it is not clear how much overall performance loss may be attributed to the use of on-heap objects in C++ applications. This study aims to fill this gap by analyzing object allocation practices in open-source C++ code, investigating the frequency of stack and heap allocations using real-time dynamic analysis with tools such as DynamoRIO and Valgrind. We found out that the majority of objects (97.2%) are allocated on the stack, with only a small portion (2.8%) allocated on the heap. However, when considering the computational cost of each allocation method, we find that heap allocations account for a substantial 85% of the total CPU cycles consumed by object allocations. These findings underscore the importance of optimization of on-heap object allocations, in C++ programming.


title: On the smallness of mean oscillations on metric-measure spaces and applications

abstract: It will be established that the mean oscillation of a function on a metric-measure space $X\times Y$ will be small if its mean oscillation on $X$ is small and some simple information on its (partial $Y$) upper-gradient is given. Applications to the regularity and global existence of bounded solutions to strongly coupled elliptic/parabolic systems on thin domains are also considered.


title: Additive kinematic formulas for convex functions

abstract: We prove a functional version of the additive kinematic formula as an application of the Hadwiger theorem on convex functions together with a Kubota-type formula for mixed Monge-Amp\`ere measures. As an application, we give a new explanation for the equivalence of the representations of functional intrinsic volumes as singular Hessian valuations and as integrals with respect to mixed Monge-Amp\`ere measures. In addition, we obtain a new integral geometric formula for mixed area measures of convex bodies, where integration on $\operatorname{SO}(n-1)\times \operatorname{O}(1)$ is considered.


title: PCLD: Point Cloud Layerwise Diffusion for Adversarial Purification

abstract: Point clouds are extensively employed in a variety of real-world applications such as robotics, autonomous driving and augmented reality. Despite the recent success of point cloud neural networks, especially for safety-critical tasks, it is essential to also ensure the robustness of the model. A typical way to assess a model's robustness is through adversarial attacks, where test-time examples are generated based on gradients to deceive the model. While many different defense mechanisms are studied in 2D, studies on 3D point clouds have been relatively limited in the academic field. Inspired from PointDP, which denoises the network inputs by diffusion, we propose Point Cloud Layerwise Diffusion (PCLD), a layerwise diffusion based 3D point cloud defense strategy. Unlike PointDP, we propagated the diffusion denoising after each layer to incrementally enhance the results. We apply our defense method to different types of commonly used point cloud models and adversarial attacks to evaluate its robustness. Our experiments demonstrate that the proposed defense method achieved results that are comparable to or surpass those of existing methodologies, establishing robustness through a novel technique. Code is available at https://github.com/batuceng/diffusion-layer-robustness-pc.


title: Solving Distributed Flexible Job Shop Scheduling Problems in the Wool Textile Industry with Quantum Annealing

abstract: Many modern manufacturing companies have evolved from a single production site to a multi-factory production environment that must handle both geographically dispersed production orders and their multi-site production steps. The availability of a range of machines in different locations capable of performing the same operation and shipping times between factories have transformed planning systems from the classic Job Shop Scheduling Problem (JSSP) to Distributed Flexible Job Shop Scheduling Problem (DFJSP). As a result, the complexity of production planning has increased significantly. In our work, we use Quantum Annealing (QA) to solve the DFJSP. In addition to the assignment of production orders to production sites, the assignment of production steps to production sites also takes place. This requirement is based on a real use case of a wool textile manufacturer. To investigate the applicability of this method to large problem instances, problems ranging from 50 variables up to 250 variables, the largest problem that could be embedded into a D-Wave quantum annealer Quantum Processing Unit (QPU), are formulated and solved. Special attention is dedicated to the determination of the Lagrange parameters of the Quadratic Unconstrained Binary Optimization (QUBO) model and the QPU configuration parameters, as these factors can significantly impact solution quality. The obtained solutions are compared to solutions obtained by Simulated Annealing (SA), both in terms of solution quality and calculation time. The results demonstrate that QA has the potential to solve large problem instances specific to the industry.


title: Enhancing Adversarial Training with Prior Knowledge Distillation for Robust Image Compression

abstract: Deep neural network-based image compression (NIC) has achieved excellent performance, but NIC method models have been shown to be susceptible to backdoor attacks. Adversarial training has been validated in image compression models as a common method to enhance model robustness. However, the improvement effect of adversarial training on model robustness is limited. In this paper, we propose a prior knowledge-guided adversarial training framework for image compression models. Specifically, first, we propose a gradient regularization constraint for training robust teacher models. Subsequently, we design a knowledge distillation based strategy to generate a priori knowledge from the teacher model to the student model for guiding adversarial training. Experimental results show that our method improves the reconstruction quality by about 9dB when the Kodak dataset is elected as the backdoor attack object for psnr attack. Compared with Ma2023, our method has a 5dB higher PSNR output at high bitrate points.


title: Exceptional or half-integral chirally cosmetic surgeries

abstract: A pair of Dehn surgeries on a knot is called chirally cosmetic if they yield orientation-reversingly homeomorphic 3-manifolds. In this paper, we consider exceptional or half-integral chirally cosmetic surgeries, and obtain several restrictions.


title: Fast Text-to-3D-Aware Face Generation and Manipulation via Direct Cross-modal Mapping and Geometric Regularization

abstract: Text-to-3D-aware face (T3D Face) generation and manipulation is an emerging research hot spot in machine learning, which still suffers from low efficiency and poor quality. In this paper, we propose an End-to-End Efficient and Effective network for fast and accurate T3D face generation and manipulation, termed $E^3$-FaceNet. Different from existing complex generation paradigms, $E^3$-FaceNet resorts to a direct mapping from text instructions to 3D-aware visual space. We introduce a novel Style Code Enhancer to enhance cross-modal semantic alignment, alongside an innovative Geometric Regularization objective to maintain consistency across multi-view generations. Extensive experiments on three benchmark datasets demonstrate that $E^3$-FaceNet can not only achieve picture-like 3D face generation and manipulation, but also improve inference speed by orders of magnitudes. For instance, compared with Latent3D, $E^3$-FaceNet speeds up the five-view generations by almost 470 times, while still exceeding in generation quality. Our code is released at https://github.com/Aria-Zhangjl/E3-FaceNet.


title: A viscoelastic model for skin via homogenization theory

abstract: We carry out the homogenization of a fluid-structure interaction problem consisting in the periodic inclusions of a viscous fluid in an elastic body. We get a macrostructure model where the body behaves as a viscoelastic material with a long-range memory term. Our aim is not only to get this limit problem but also to study its main properties. Using the micro-structure variables it is simple to check that it satisfies an energy conservation law assuring in particular the existence and uniqueness of solution. The difficulty is to characterize these properties using only the macroscopic system. We prove that the nonlocal term is given through a convolution kernel which exponentially decreases to zero and satisfies some positive conditions which we write in terms of the Laplace transform. These conditions can be used to directly prove the existence and uniqueness of solution. The results apply to modeling the mechanical behavior of skin as an indicator of what kind of models we should use. In a naive interpretation the fluid inclusions represent the cells and the elastic medium the extracellular matrix.


title: Proof complexity of universal algebra in a CSP dichotomy proof

abstract: The constraint satisfaction problem (CSP) can be formulated as a homomorphism problem between relational structures: given a structure $\mathcal{A}$, for any structure $\mathcal{X}$, whether there exists a homomorphism from $\mathcal{X}$ to $\mathcal{A}$. For years, it has been conjectured that all problems of this type are divided into polynomial-time and NP-complete problems, and the conjecture was proved in 2017 separately by Zhuk (2017) and Bulatov (2017). Zhuk's algorithm solves tractable CSPs in polynomial time. The algorithm is partly based on universal algebra theorems: informally, they state that after reducing some domain of an instance to its strong subuniverses, a satisfiable instance maintains a solution. In this paper, we present the formalization of the proofs of these theorems in the bounded arithmetic $W^1_1$ introduced by Skelley (2004). The formalization, together with our previous results (2022), shows that $W_1^1$ proves the soundness of Zhuk's algorithm, where by soundness we mean that any rejection of the algorithm is correct. From the known relation of the theory to propositional calculus $G$, it follows that tautologies, expressing the non-existence of a solution for unsatisfiable instances, have short proofs in $G$.


title: Multimodal Transformers for Real-Time Surgical Activity Prediction

abstract: Real-time recognition and prediction of surgical activities are fundamental to advancing safety and autonomy in robot-assisted surgery. This paper presents a multimodal transformer architecture for real-time recognition and prediction of surgical gestures and trajectories based on short segments of kinematic and video data. We conduct an ablation study to evaluate the impact of fusing different input modalities and their representations on gesture recognition and prediction performance. We perform an end-to-end assessment of the proposed architecture using the JHU-ISI Gesture and Skill Assessment Working Set (JIGSAWS) dataset. Our model outperforms the state-of-the-art (SOTA) with 89.5\% accuracy for gesture prediction through effective fusion of kinematic features with spatial and contextual video features. It achieves the real-time performance of 1.1-1.3ms for processing a 1-second input window by relying on a computationally efficient model.


title: Propagation of Solar Energetic Particles in 3D MHD Simulations of the Solar Wind

abstract: We propagate relativistic test particles in the field of a steady 3D MHD simulations of the solar wind. We use the MPI-AMRVAC code for the wind simulations and integrate the relativistic guiding center equations using a new third-order accurate time integration scheme to solve the particle trajectories. Diffusion in velocity space, given a particle-turbulence mean free path $\lambda_\parallel$ along the magnetic field, is also included. Preliminary results for $81\:{\rm keV}$ electrons injected at 0.139 AU heliocentric distance and mean free path $\lambda_\parallel =0.5\:{\rm AU}$ are in a good qualitative agreement with measurements at 1 AU.


title: Deriving Dependently-Typed OOP from First Principles -- Extended Version with Additional Appendices

abstract: The expression problem describes how most types can easily be extended with new ways to produce the type or new ways to consume the type, but not both. When abstract syntax trees are defined as an algebraic data type, for example, they can easily be extended with new consumers, such as print or eval, but adding a new constructor requires the modification of all existing pattern matches. The expression problem is one way to elucidate the difference between functional or data-oriented programs (easily extendable by new consumers) and object-oriented programs (easily extendable by new producers). This difference between programs which are extensible by new producers or new consumers also exists for dependently typed programming, but with one core difference: Dependently-typed programming almost exclusively follows the functional programming model and not the object-oriented model, which leaves an interesting space in the programming language landscape unexplored. In this paper, we explore the field of dependently-typed object-oriented programming by deriving it from first principles using the principle of duality. That is, we do not extend an existing object-oriented formalism with dependent types in an ad-hoc fashion, but instead start from a familiar data-oriented language and derive its dual fragment by the systematic use of defunctionalization and refunctionalization. Our central contribution is a dependently typed calculus which contains two dual language fragments. We provide type- and semantics-preserving transformations between these two language fragments: defunctionalization and refunctionalization. We have implemented this language and these transformations and use this implementation to explain the various ways in which constructions in dependently typed programming can be explained as special instances of the phenomenon of duality.


title: Tikhonov Regularization for Stochastic Non-Smooth Convex Optimization in Hilbert Spaces

abstract: To solve non-smooth convex optimization problems with a noisy gradient input, we analyze the global behavior of subgradient-like flows under stochastic errors. The objective function is composite, being equal to the sum of two convex functions, one being differentiable and the other potentially non-smooth. We then use stochastic differential inclusions where the drift term is minus the subgradient of the objective function, and the diffusion term is either bounded or square-integrable. In this context, under Lipschitz's continuity of the differentiable term and a growth condition of the non-smooth term, our first main result shows almost sure weak convergence of the trajectory process towards a minimizer of the objective function. Then, using Tikhonov regularization with a properly tuned vanishing parameter, we can obtain almost sure strong convergence of the trajectory towards the minimum norm solution. We find an explicit tuning of this parameter when our objective function satisfies a local error-bound inequality. We also provide a comprehensive complexity analysis by establishing several new pointwise and ergodic convergence rates in expectation for the convex and strongly convex case.


title: Validation of the GreenX library time-frequency component for efficient GW and RPA calculations

abstract: Electronic structure calculations based on many-body perturbation theory (e.g. GW or the random-phase approximation (RPA)) require function evaluations in the complex time and frequency domain, for example inhomogeneous Fourier transforms or analytic continuation from the imaginary axis to the real axis. For inhomogeneous Fourier transforms, the time-frequency component of the GreenX library provides time-frequency grids that can be utilized in low-scaling RPA and GW implementations. In addition, the adoption of the compact frequency grids provided by our library also reduces the computational overhead in RPA implementations with conventional scaling. In this work, we present low-scaling GW and conventional RPA benchmark calculations using the GreenX grids with different codes (FHI-aims, CP2K and ABINIT) for molecules, two-dimensional materials and solids. Very small integration errors are observed when using 30 time-frequency points for our test cases, namely $<10^{-8}$ eV/electron for the RPA correlation energies, and 10 meV for the GW quasiparticle energies.


title: HILL: A Hallucination Identifier for Large Language Models

abstract: Large language models (LLMs) are prone to hallucinations, i.e., nonsensical, unfaithful, and undesirable text. Users tend to overrely on LLMs and corresponding hallucinations which can lead to misinterpretations and errors. To tackle the problem of overreliance, we propose HILL, the "Hallucination Identifier for Large Language Models". First, we identified design features for HILL with a Wizard of Oz approach with nine participants. Subsequently, we implemented HILL based on the identified design features and evaluated HILL's interface design by surveying 17 participants. Further, we investigated HILL's functionality to identify hallucinations based on an existing question-answering dataset and five user interviews. We find that HILL can correctly identify and highlight hallucinations in LLM responses which enables users to handle LLM responses with more caution. With that, we propose an easy-to-implement adaptation to existing LLMs and demonstrate the relevance of user-centered designs of AI artifacts.


title: Identifying plasma fractionation processes in the chromosphere using IRIS

abstract: The composition of the solar corona differs from that of the photosphere, with the plasma thought to fractionate in the solar chromosphere according to the First Ionisation Potential (FIP) of the different elements. This produces a FIP bias, wherein elements with a low FIP are preferentially enhanced in the corona compared to their photospheric abundance, but direct observations of this process remain elusive. Here we use a series of spectroscopic observations of Active Region AR 12759 as it transited the solar disc over a period of 6 days from 2-7 April 2020 taken using the Hinode Extreme ultraviolet Imaging Spectrometer (EIS) and Interface Region Imaging Spectrograph (IRIS) instruments to look for signatures of plasma fractionation in the solar chromosphere. Using the Si X/S X and Ca XIV/Ar XIV diagnostics, we find distinct differences between the FIP bias of the leading and following polarities of the active region. The widths of the IRIS Si IV lines exhibited clear differences between the leading and following polarity regions, indicating increased unresolved wave activity in the following polarity region compared to the leading polarity region, with the chromospheric velocities derived using the Mg II lines exhibiting comparable, albeit much weaker, behaviour. These results are consistent with plasma fractionation via resonant/non-resonant waves at different locations in the solar chromosphere following the ponderomotive force model, and indicate that IRIS could be used to further study this fundamental physical process.


title: The Ouroboros of Memristors: Neural Networks Facilitating Memristor Programming

abstract: Memristive devices hold promise to improve the scale and efficiency of machine learning and neuromorphic hardware, thanks to their compact size, low power consumption, and the ability to perform matrix multiplications in constant time. However, on-chip training with memristor arrays still faces challenges, including device-to-device and cycle-to-cycle variations, switching non-linearity, and especially SET and RESET asymmetry. To combat device non-linearity and asymmetry, we propose to program memristors by harnessing neural networks that map desired conductance updates to the required pulse times. With our method, approximately 95% of devices can be programmed within a relative percentage difference of +-50% from the target conductance after just one attempt. Our approach substantially reduces memristor programming delays compared to traditional write-and-verify methods, presenting an advantageous solution for on-chip training scenarios. Furthermore, our proposed neural network can be accelerated by memristor arrays upon deployment, providing assistance while reducing hardware overhead compared with previous works. This work contributes significantly to the practical application of memristors, particularly in reducing delays in memristor programming. It also envisions the future development of memristor-based machine learning accelerators.


title: Influence of Li-stoichiometry on electrical and acoustic properties and temperature stability of Li(Nb,Ta)O$_{3}$ solid solutions up to 900 {\deg}C

abstract: The current work is focused on the impact of the lithium stoichiometry on electrical conductivity, acoustic properties and high-temperature stability of single crystalline Li(Nb,Ta)O$_{3}$ at high temperatures. The crystals grown from Li-deficient melts were treated by the vapor transport equilibration (VTE) method, achieving near stoichiometric Li-content. It is shown, that the VTE-treated specimens generally exhibit lower conductivity at temperatures below 800 {\deg}C, which is attributed to the reduced number of Li-vacancies in near stoichiometric Li(Nb,Ta)O$_{3}$, provided that the Li-ion migration dominates the conductivity in this temperature range. Further, it is shown, that above 600-650 {\deg}C different mechanism increasingly contributes to the conductivity, which is consequently attributed to the electronic conduction. Further, it is shown that losses in LNT strongly increase above about 500 {\deg}C, which is interpreted to originate from conductivity-related relaxation mechanism. Finally, the thermal stability of Li(Nb,Ta)O$_{3}$ is evaluated by the measurement of the conductivity and resonance frequency as a function of time. It is found that during annealing at 700 {\deg}C for 350 hours, the resonance frequency of LiNbO$_{3}$ remains in a {\textpm} 100 ppm range of the initial value of 3.5 MHz.


title: Societal and scientific impact of policy research: A large-scale empirical study of some explanatory factors using Altmetric and Overton

abstract: This study investigates how scientific research influences policymaking by analyzing citations of research articles in policy documents (policy impact) for nearly 125,000 articles across 434 public policy journals. We reveal distinct citation patterns between policymakers and other stakeholders like researchers, journalists, and the public. News and blog mentions, social media engagement, and open access publications (excluding fully open access) significantly increase the likelihood of a research article being cited in policy documents. Conversely, articles locked behind paywalls and those published under the full open access model (based on Altmetric data) have a lower chance of being policy-cited. Publication year and policy type show no significant influence. Our findings emphasize the crucial role of science communication channels like news media and social media in bridging the gap between research and policy. Interestingly, academic citations hold a weaker influence on policy citations compared to news mentions, suggesting a potential disconnect between how researchers reference research and how policymakers utilize it. This highlights the need for improved communication strategies to ensure research informs policy decisions more effectively. This study provides valuable insights for researchers, policymakers, and science communicators. Researchers can tailor their dissemination efforts to reach policymakers through media channels. Policymakers can leverage these findings to identify research with higher policy relevance. Science communicators can play a critical role in translating research for policymakers and fostering dialogue between the scientific and policymaking communities.


title: Dynamic minimisation of the commute time for a one-dimensional diffusion

abstract: Motivated in part by a problem in simulated tempering (a form of Markov chain Monte Carlo) we seek to minimise, in a suitable sense, the time it takes a (regular) diffusion with instantaneous reflection at 0 and 1 to travel to $1$ and then return to the origin (the so-called commute time from 0 to 1). Substantially extending results in a previous paper, we consider a dynamic version of this problem where the control mechanism is related to the diffusion's drift via the corresponding scale function. We are only able to choose the drift at each point at the time of first visiting that point and the drift is constrained on a set of the form $[0,\ell)\cup(i,1]$. This leads to a type of stochastic control problem with infinite dimensional state.


title: Emergency Response Inference Mapping (ERIMap): A Bayesian Network-based Method for Dynamic Observation Processing in Spatially Distributed Emergencies

abstract: In emergencies, high stake decisions often have to be made under time pressure and strain. In order to support such decisions, information from various sources needs to be collected and processed rapidly. The information available tends to be temporally and spatially variable, uncertain, and sometimes conflicting, leading to potential biases in decisions. Currently, there is a lack of systematic approaches for information processing and situation assessment which meet the particular demands of emergency situations. To address this gap, we present a Bayesian network-based method called ERIMap that is tailored to the complex information-scape during emergencies. The method enables the systematic and rapid processing of heterogeneous and potentially uncertain observations and draws inferences about key variables of an emergency. It thereby reduces complexity and cognitive load for decision makers. The output of the ERIMap method is a dynamically evolving and spatially resolved map of beliefs about key variables of an emergency that is updated each time a new observation becomes available. The method is illustrated in a case study in which an emergency response is triggered by an accident causing a gas leakage on a chemical plant site.


title: Unprotected 4G/5G Control Procedures at Low Layers Considered Dangerous

abstract: Over the years, several security vulnerabilities in the 3GPP cellular systems have been demonstrated in the literature. Most studies focus on higher layers of the cellular radio stack, such as the RRC and NAS, which are cryptographically protected. However, lower layers of the stack, such as PHY and MAC, are not as thoroughly studied, even though they are neither encrypted nor integrity protected. Furthermore, the latest releases of 5G significantly increased the number of low-layer control messages and procedures. The complexity of the cellular standards and the high degree of cross-layer operations, makes reasoning about security non-trivial, and requires a systematic analysis. We study the control procedures carried by each physical channel, and find that current cellular systems are susceptible to several new passive attacks due to information leakage, and active attacks by injecting MAC and PHY messages. For instance, we find that beamforming information leakage enables fingerprinting-based localization and tracking of users. We identify active attacks that reduce the users' throughput by disabling RF front ends at the UE, disrupt user communications by tricking other connected UEs into acting as jammers, or stealthily disconnect an active user. We evaluate our attacks against COTS UEs in various scenarios and demonstrate their practicality by measuring current operators' configurations across three countries. Our results show that an attacker can, among other things, localize users with an accuracy of 20 meters 96% of the time, track users' moving paths with a probability of 90%, reduce throughput by more than 95% within 2 seconds (by spoofing a 39 bits DCI), and disconnect users.


title: Bayesian prediction regions and density estimation with type-2 censored data

abstract: For exponentially distributed lifetimes, we consider the prediction of future order statistics based on having observed the first $m$ order statistics. We focus on the previously less explored aspects of predicting: (i) an arbitrary pair of future order statistics such as the next and last ones, as well as (ii) the next $N$ future order statistics. We provide explicit and exact Bayesian credible regions associated with Gamma priors, and constructed by identifying a region with a given credibility $1-\lambda$ under the Bayesian predictive density. For (ii), the HPD region is obtained, while a two-step algorithm is given for (i). The predictive distributions are represented as mixtures of bivariate Pareto distributions, as well as multivariate Pareto distributions. For the non-informative prior density choice, we demonstrate that a resulting Bayesian credible region has matching frequentist coverage probability, and that the resulting predictive density possesses the optimality properties of best invariance and minimaxity.


title: Injection spectra of different species of cosmic rays from AMS-02, ACE-CRIS and Voyager-1

abstract: Precise measurements of energy spectra of different cosmic ray species were obtained in recent years, by particularly the AMS-02 experiment on the International Space Station. It has been shown that apparent differences exist in different groups of the primary cosmic rays. However, it is not straightforward to conclude that the source spectra of different particle groups are different since they will experience different propagation processes (e.g., energy losses and fragmentations) either. In this work, we study the injection spectra of different nuclear species using the measurements from Voyager-1 outside the solar system, and ACR-CRIS and AMS-02 on top of atmosphere, in a physical framework of cosmic ray transportation. Two types of injection spectra are assumed, the broken power-law and the non-parametric spline interpolation form. The non-parametric form fits the data better than the broken power-law form, implying that potential structures beyond the constrained spectral shape of broken power-law may exist. For different nuclei the injection spectra are overall similar in shape but do show some differences among each other. For the non-parametric spectral form, the helium injection spectrum is the softest at low energies and the hardest at high energies. For both spectral shapes, the low-energy injection spectrum of neon is the hardest among all these species, and the carbon and oxygen spectra have more prominent bumps in 1-10 GV in the R2dN/dR presentation. Such differences suggest the existence of differences in the sources or acceleration processes of various nuclei of cosmic rays.


title: On the Secrecy Rate of In-Band Full-duplex Two-way Wiretap Channel

abstract: In this paper, we consider a two-way wiretap Multi-Input Multi-Output Multi-antenna Eve (MIMOME) channel, where both nodes (Alice and Bob) transmit and receive in an in-band full-duplex (IBFD) manner. For this system with keyless security, we provide a novel artificial noise (AN) based signal design, where the AN is injected in both signal and null spaces. We present an ergodic secrecy rate approximation to derive the power allocation algorithm. We consider scenarios where AN is known and unknown to legitimate users and include imperfect channel information effects. To maximize secrecy rates subject to the transmit power constraint, a two-step power allocation solution is proposed, where the first step is known at Eve, and the second step helps to improve the secrecy further. We also consider scenarios where partial information is known by Eve and the effects of non-ideal self-interference cancellation. The usefulness and limitations of the resulting power allocation solution are analyzed and verified via simulations. Results show that secrecy rates are less when AN is unknown to receivers or Eve has more information about legitimate users. Since the ergodic approximation only considers Eves distance, the resulting power allocation provides secrecy rates close to the actual ones.


title: Fundamental Theorems for Timelike Surfaces in the Minkowski 4-Space

abstract: In the present paper, we study timelike surfaces free of minimal points in the four-dimensional Minkowski space. For each such surface we introduce a geometrically determined pseudo-orthonormal frame field and writing the derivative formulas with respect to this moving frame field and using the integrability conditions, we obtain a system of six functions satisfying some natural conditions. In the general case, we prove a Fundamental Bonnet-type theorem (existence and uniqueness theorem) stating that these six functions, satisfying the natural conditions, determine the surface up to a motion. In some particular cases, we reduce the number of functions and give the fundamental theorems.


title: Asymptotics of the finite-temperature sine kernel determinant

abstract: In the present paper, we study the asymptotics of the Fredholm determinant $D(x,s)$ of the finite-temperature deformation of the sine kernel, which represents the probability that there is no particles on the interval $(-x/\pi,x/\pi)$ in the bulk scaling limit of the finite-temperature fermion system. The variable $s$ in $D(x,s)$ is related to the temperature. The determinant also corresponds to the finite-temperature correlation function of one dimensional Bose gas. We derive the asymptotics of $D(x,s)$ in several different regimes in the $(x,s)$-plane. A third-order phase transition is observed in the asymptotic expansions as both $x$ and $s$ tend to positive infinity at certain related speed. The phase transition is then shown to be described by an integral involving the Hastings-McLeod solution of the second Painlev\'e equation.


title: A SysML Profile for the Standardized Description of Processes during System Development

abstract: A key aspect in creating models of production systems with the use of model-based systems engineering (MBSE) lies in the description of system functions. These functions shouldbe described in a clear and standardized manner.The VDI/VDE 3682 standard for Formalised Process De-scription (FPD) provides a simple and easily understandable representation of processes. These processes can be conceptualized as functions within the system model, making the FPD particularly well-suited for the standardized representation ofthe required functions. Hence, this contribution focuses on thedevelopment of a Domain-Specific Modeling Language(DSML) that facilitates the integration of VDI/VDE 3682 into the Systems Modeling Language (SysML). The presented approach not onlyextends classical SysML with domain-specific requirements but also facilitates model verification through constraints modeled in Object Constraint Language (OCL). Additionally, it enables automatic serialization of process descriptions into the Extensible Markup Language (XML) using the Velocity Template Language (VTL). This serialization enables the use of process modeling in applications outside of MBSE. The approach was validated using an collar screwing use case in the major component assembly in aircraft production.


title: A note on the Segal conjecture for large objects

abstract: The Segal conjecture for $C_p$ (as proved by Lin and Gunawardena) asserts that the canonical map from the $p$-complete sphere spectrum to the Tate construction for the trivial action of $C_p$ on the $p$-complete sphere spectrum is an isomorphism. In this article we extend the collection of spectra for which the canonical map $X \to X^{tC_p}$ is known to be an isomorphism to include any $p$-complete, bounded below spectrum whose mod $p$ homology, viewed a module over the Steenrod algebra, is complete with respect to the maximal ideal $I \subseteq \mathcal{A}$.


title: Improving Low-Resource Knowledge Tracing Tasks by Supervised Pre-training and Importance Mechanism Fine-tuning

abstract: Knowledge tracing (KT) aims to estimate student's knowledge mastery based on their historical interactions. Recently, the deep learning based KT (DLKT) approaches have achieved impressive performance in the KT task. These DLKT models heavily rely on the large number of available student interactions. However, due to various reasons such as budget constraints and privacy concerns, observed interactions are very limited in many real-world scenarios, a.k.a, low-resource KT datasets. Directly training a DLKT model on a low-resource KT dataset may lead to overfitting and it is difficult to choose the appropriate deep neural architecture. Therefore, in this paper, we propose a low-resource KT framework called LoReKT to address above challenges. Inspired by the prevalent "pre-training and fine-tuning" paradigm, we aim to learn transferable parameters and representations from rich-resource KT datasets during the pre-training stage and subsequently facilitate effective adaptation to low-resource KT datasets. Specifically, we simplify existing sophisticated DLKT model architectures with purely a stack of transformer decoders. We design an encoding mechanism to incorporate student interactions from multiple KT data sources and develop an importance mechanism to prioritize updating parameters with high importance while constraining less important ones during the fine-tuning stage. We evaluate LoReKT on six public KT datasets and experimental results demonstrate the superiority of our approach in terms of AUC and Accuracy. To encourage reproducible research, we make our data and code publicly available at https://anonymous.4open.science/r/LoReKT-C619.


title: Probabilistic Contrastive Learning for Long-Tailed Visual Recognition

abstract: Long-tailed distributions frequently emerge in real-world data, where a large number of minority categories contain a limited number of samples. Such imbalance issue considerably impairs the performance of standard supervised learning algorithms, which are mainly designed for balanced training sets. Recent investigations have revealed that supervised contrastive learning exhibits promising potential in alleviating the data imbalance. However, the performance of supervised contrastive learning is plagued by an inherent challenge: it necessitates sufficiently large batches of training data to construct contrastive pairs that cover all categories, yet this requirement is difficult to meet in the context of class-imbalanced data. To overcome this obstacle, we propose a novel probabilistic contrastive (ProCo) learning algorithm that estimates the data distribution of the samples from each class in the feature space, and samples contrastive pairs accordingly. In fact, estimating the distributions of all classes using features in a small batch, particularly for imbalanced data, is not feasible. Our key idea is to introduce a reasonable and simple assumption that the normalized features in contrastive learning follow a mixture of von Mises-Fisher (vMF) distributions on unit space, which brings two-fold benefits. First, the distribution parameters can be estimated using only the first sample moment, which can be efficiently computed in an online manner across different batches. Second, based on the estimated distribution, the vMF distribution allows us to sample an infinite number of contrastive pairs and derive a closed form of the expected contrastive loss for efficient optimization. Our code is available at https://github.com/LeapLabTHU/ProCo.


title: Minimisers of supremal functionals and mass-minimising 1-currents

abstract: We study vector-valued functions that minimise the $L^\infty$-norm of their derivatives for prescribed boundary data. We construct a vector-valued, mass minimising $1$-current (i.e., a generalised geodesic) in the domain such that all solutions of the problem coincide on its support. Furthermore, this current can be interpreted as a streamline of the solutions. It also has maximal support among all $1$-currents with certain properties. The construction relies on a $p$-harmonic approximation. In the case of scalar-valued functions, it is closely related to a construction of Evans and Yu. We therefore obtain an extension of their theory.


title: Large Model driven Radiology Report Generation with Clinical Quality Reinforcement Learning

abstract: Radiology report generation (RRG) has attracted significant attention due to its potential to reduce the workload of radiologists. Current RRG approaches are still unsatisfactory against clinical standards. This paper introduces a novel RRG method, \textbf{LM-RRG}, that integrates large models (LMs) with clinical quality reinforcement learning to generate accurate and comprehensive chest X-ray radiology reports. Our method first designs a large language model driven feature extractor to analyze and interpret different regions of the chest X-ray image, emphasizing specific regions with medical significance. Next, based on the large model's decoder, we develop a multimodal report generator that leverages multimodal prompts from visual features and textual instruction to produce the radiology report in an auto-regressive way. Finally, to better reflect the clinical significant and insignificant errors that radiologists would normally assign in the report, we introduce a novel clinical quality reinforcement learning strategy. It utilizes the radiology report clinical quality (RadCliQ) metric as a reward function in the learning process. Extensive experiments on the MIMIC-CXR and IU-Xray datasets demonstrate the superiority of our method over the state of the art.


title: Galaxy Morphologies Revealed with Subaru HSC and Super-Resolution Techniques II: Environmental Dependence of Galaxy Mergers at z~2-5

abstract: We super-resolve the seeing-limited Subaru Hyper Suprime-Cam (HSC) images for 32,187 galaxies at z~2-5 in three techniques, namely, the classical Richardson-Lucy (RL) point spread function (PSF) deconvolution, sparse modeling, and generative adversarial networks to investigate the environmental dependence of galaxy mergers. These three techniques generate overall similar high spatial resolution images but with some slight differences in galaxy structures, for example, more residual noises are seen in the classical RL PSF deconvolution. To alleviate disadvantages of each technique, we create combined images by averaging over the three types of super-resolution images, which result in galaxy sub-structures resembling those seen in the Hubble Space Telescope images. Using the combined super-resolution images, we measure the relative galaxy major merger fraction corrected for the chance projection effect, f_merg, for galaxies in the ~300 deg^2-area data of the HSC Strategic Survey Program and the CFHT Large Area U-band Survey. Our f_merg measurements at z~3 validate previous findings showing that f_merg is higher in regions with a higher galaxy overdensity delta at z~2-3. Thanks to the large galaxy sample, we identify a nearly linear increase in f_merg with increasing delta at z~4-5, providing the highest-z observational evidence that galaxy mergers are related to delta. In addition to our f_merg measurements, we find that the galaxy merger fractions in the literature also broadly align with the linear f_merg-delta relation across a wide redshift range of z~2-5. This alignment suggests that the linear f_merg-delta relation can serve as a valuable tool for quantitatively estimating the contributions of galaxy mergers to various environmental dependences. This super-resolution analysis can be readily applied to datasets from wide field-of-view space telescopes such as Euclid and Roman.


title: An invariance principle for the 2d weakly self-repelling Brownian polymer

abstract: We investigate the large-scale behaviour of the Self-Repelling Brownian Polymer (SRBP) in the critical dimension $d=2$. The SRBP is a model of self-repelling motion, which is formally given by the solution a stochastic differential equation driven by a standard Brownian motion and with a drift given by the negative gradient of its own local time. As with its discrete counterpart, the "true" self-avoiding walk (TSAW) of [D.J. Amit, G. Parisi, & L. Peliti, Asymptotic behaviour of the "true" self-avoiding walk, Phys. Rev. B, 1983], it is conjectured to be logarithmically superdiffusive, i.e. to be such that its mean-square displacement grows as $t(\log t)^\beta$ for $t$ large and some currently unknown $\beta\in(0,1)$. The main result of the paper is an invariance principle for the SRBP under the weak coupling scaling, which corresponds to scaling the SRBP diffusively and simultaneously tuning down the strength of the self-interaction in a scale-dependent way. The diffusivity for the limiting Brownian motion is explicit and its expression provides compelling evidence that the $\beta$ above should be $1/2$. Further, we derive the scaling limit of the so-called environment seen by the particle process, which formally solves a non-linear singular stochastic PDE of transport-type, and prove this is given by the solution of a stochastic linear transport equation with enhanced diffusivity.


title: On the Approximation of Kernel functions

abstract: Various methods in statistical learning build on kernels considered in reproducing kernel Hilbert spaces. In applications, the kernel is often selected based on characteristics of the problem and the data. This kernel is then employed to infer response variables at points, where no explanatory data were observed. The data considered here are located in compact sets in higher dimensions and the paper addresses approximations of the kernel itself. The new approach considers Taylor series approximations of radial kernel functions. For the Gauss kernel on the unit cube, the paper establishes an upper bound of the associated eigenfunctions, which grows only polynomially with respect to the index. The novel approach substantiates smaller regularization parameters than considered in the literature, overall leading to better approximations. This improvement confirms low rank approximation methods such as the Nystr\"om method.


title: Greedy construction of quadratic manifolds for nonlinear dimensionality reduction and nonlinear model reduction

abstract: Dimensionality reduction on quadratic manifolds augments linear approximations with quadratic correction terms. Previous works rely on linear approximations given by projections onto the first few leading principal components of the training data; however, linear approximations in subspaces spanned by the leading principal components alone can miss information that are necessary for the quadratic correction terms to be efficient. In this work, we propose a greedy method that constructs subspaces from leading as well as later principal components so that the corresponding linear approximations can be corrected most efficiently with quadratic terms. Properties of the greedily constructed manifolds allow applying linear algebra reformulations so that the greedy method scales to data points with millions of dimensions. Numerical experiments demonstrate that an orders of magnitude higher accuracy is achieved with the greedily constructed quadratic manifolds compared to manifolds that are based on the leading principal components alone.


title: On the construction of a quantum channel corresponding to non-commutative graph for a qubit interacting with quantum oscillator

abstract: We consider error correction, based on the theory of non-commutative graphs, for a model of a qubit interacting with quantum oscillator. The dynamics of the composite system is governed by the Schr\"odinger equation which generates positive operator-valued measure (POVM) for the system dynamics. We construct a quantum channel generating the non-commutative graph as a linear envelope of the POVM. The idea is based on applying a generalized version of a quantum channel using the apparatus of von Neumann algebras. The results are analyzes for a non-commutative graph generated by a qubit interacting with quantum oscillator. For this model the quantum anticlique which determines the error correcting subspace has an explicit expression.


title: Real-Time Multimodal Cognitive Assistant for Emergency Medical Services

abstract: Emergency Medical Services (EMS) responders often operate under time-sensitive conditions, facing cognitive overload and inherent risks, requiring essential skills in critical thinking and rapid decision-making. This paper presents CognitiveEMS, an end-to-end wearable cognitive assistant system that can act as a collaborative virtual partner engaging in the real-time acquisition and analysis of multimodal data from an emergency scene and interacting with EMS responders through Augmented Reality (AR) smart glasses. CognitiveEMS processes the continuous streams of data in real-time and leverages edge computing to provide assistance in EMS protocol selection and intervention recognition. We address key technical challenges in real-time cognitive assistance by introducing three novel components: (i) a Speech Recognition model that is fine-tuned for real-world medical emergency conversations using simulated EMS audio recordings, augmented with synthetic data generated by large language models (LLMs); (ii) an EMS Protocol Prediction model that combines state-of-the-art (SOTA) tiny language models with EMS domain knowledge using graph-based attention mechanisms; (iii) an EMS Action Recognition module which leverages multimodal audio and video data and protocol predictions to infer the intervention/treatment actions taken by the responders at the incident scene. Our results show that for speech recognition we achieve superior performance compared to SOTA (WER of 0.290 vs. 0.618) on conversational data. Our protocol prediction component also significantly outperforms SOTA (top-3 accuracy of 0.800 vs. 0.200) and the action recognition achieves an accuracy of 0.727, while maintaining an end-to-end latency of 3.78s for protocol prediction on the edge and 0.31s on the server.


title: Enhancing Image Caption Generation Using Reinforcement Learning with Human Feedback

abstract: Research on generative models to produce human-aligned / human-preferred outputs has seen significant recent contributions. Between text and image-generative models, we narrowed our focus to text-based generative models, particularly to produce captions for images that align with human preferences. In this research, we explored a potential method to amplify the performance of the Deep Neural Network Model to generate captions that are preferred by humans. This was achieved by integrating Supervised Learning and Reinforcement Learning with Human Feedback (RLHF) using the Flickr8k dataset. Also, a novel loss function that is capable of optimizing the model based on human feedback is introduced. In this paper, we provide a concise sketch of our approach and results, hoping to contribute to the ongoing advances in the field of human-aligned generative AI models.