title: Sharing Key Semantics in Transformer Makes Efficient Image Restoration

abstract: Image Restoration (IR), a classic low-level vision task, has witnessed significant advancements through deep models that effectively model global information. Notably, the Vision Transformers (ViTs) emergence has further propelled these advancements. When computing, the self-attention mechanism, a cornerstone of ViTs, tends to encompass all global cues, even those from semantically unrelated objects or regions. This inclusivity introduces computational inefficiencies, particularly noticeable with high input resolution, as it requires processing irrelevant information, thereby impeding efficiency. Additionally, for IR, it is commonly noted that small segments of a degraded image, particularly those closely aligned semantically, provide particularly relevant information to aid in the restoration process, as they contribute essential contextual cues crucial for accurate reconstruction. To address these challenges, we propose boosting IR's performance by sharing the key semantics via Transformer for IR (i.e., SemanIR) in this paper. Specifically, SemanIR initially constructs a sparse yet comprehensive key-semantic dictionary within each transformer stage by establishing essential semantic connections for every degraded patch. Subsequently, this dictionary is shared across all subsequent transformer blocks within the same stage. This strategy optimizes attention calculation within each block by focusing exclusively on semantically related components stored in the key-semantic dictionary. As a result, attention calculation achieves linear computational complexity within each window. Extensive experiments across 6 IR tasks confirm the proposed SemanIR's state-of-the-art performance, quantitatively and qualitatively showcasing advancements.


title: Primary and secondary source of energy in the superluminous supernova 2018ibb

abstract: We examine the pair-instability origin of superluminous supernova 2018ibb. As the base model, we use a non-rotating stellar model with an initial mass of 250 Msun at about 1/15 solar metallicity. We consider three versions of the model as input for radiative transfer simulations done with the STELLA and ARTIS codes: with 25 Msun of 56Ni, 34 Msun of 56Ni, and a chemically mixed case with 34 Msun of 56Ni. We present light curves and spectra in comparison to the observed data of SN 2018ibb, and conclude that the pair-instability supernova model with 34 Msun of 56Ni explains broad-band light curves reasonably well between -100 and 250 days around the peak. Our synthetic spectra have many similarities with the observed spectra. The luminosity excess in the light curves and the blue-flux excess in the spectra can be explained by an additional energy source, which may be interaction of the SN ejecta with circumstellar matter. We discuss possible mechanisms of the origin of the circumstellar matter being ejected in the decades before the pair-instability explosion.


title: A construction of homotopically non-trivial embedded spheres for hyperplane arrangements

abstract: We introduce the notion of locally consistent system of half-spaces for a real hyperplane arrangement. We embed a sphere in the complexified complement by shifting the real unit sphere into the imaginary direction indicated by the half-spaces. We then prove that the sphere is homotopically trivial if and only if the system of half-spaces is globally consistent. To prove its non-triviality, we compute the twisted intersection number of the sphere with a specific, explicitly constructed twisted Borel-Moore cycle.


title: Optical activity and phase transformations in {\gamma}/{\beta} Ga2O3 bilayers under annealing

abstract: Gallium oxide (Ga2O3) can be crystallized in several polymorphs exhibiting different physical properties. In this work, polymorphic structures consisting of the cubic defective spinel (gamma) film on the top of the monoclinic (beta) substrate were fabricated by disorder-induced ordering, known to be a practical way to stack these polymorphs together. Such bilayer structures were annealed to investigate the optical properties and phase transformations. Specifically, photoluminescence and diffuse reflectance spectroscopies were combined with transmission electron microscopy, Rutherford backscattering/channeling spectrometry and x-ray diffraction to monitor the evolutions. As a result we observe a two-stage annealing kinetics in gamma/beta Ga2O3 bilayers associated with the epitaxial gamma-to-beta regrowth at the interface at temperatures below 700 {\deg}C and a non-planar gamma-to-beta phase transformation starting at higher temperatures. Thus, the present data enhance understanding of the polymorphism in Ga2O3, interconnecting the phase transformation kinetics with the evolution of the optical properties.


title: FlexiDrop: Theoretical Insights and Practical Advances in Random Dropout Method on GNNs

abstract: Graph Neural Networks (GNNs) are powerful tools for handling graph-type data. Recently, GNNs have been widely applied in various domains, but they also face some issues, such as overfitting, over-smoothing and non-robustness. The existing research indicates that random dropout methods are an effective way to address these issues. However, random dropout methods in GNNs still face unresolved problems. Currently, the choice of dropout rate, often determined by heuristic or grid search methods, can increase the generalization error, contradicting the principal aims of dropout. In this paper, we propose a novel random dropout method for GNNs called FlexiDrop. First, we conduct a theoretical analysis of dropout in GNNs using rademacher complexity and demonstrate that the generalization error of traditional random dropout methods is constrained by a function related to the dropout rate. Subsequently, we use this function as a regularizer to unify the dropout rate and empirical loss within a single loss function, optimizing them simultaneously. Therefore, our method enables adaptive adjustment of the dropout rate and theoretically balances the trade-off between model complexity and generalization ability. Furthermore, extensive experimental results on benchmark datasets show that FlexiDrop outperforms traditional random dropout methods in GNNs.


title: Repeatable and Reliable Efforts of Accelerated Risk Assessment

abstract: Risk assessment of a robot in controlled environments, such as laboratories and proving grounds, is a common means to assess, certify, validate, verify, and characterize the robots' safety performance before, during, and even after their commercialization in the real-world. A standard testing program that acquires the risk estimate is expected to be (i) repeatable, such that it obtains similar risk assessments of the same testing subject among multiple trials or attempts with the similar testing effort by different stakeholders, and (ii) reliable against a variety of testing subjects produced by different vendors and manufacturers. Both repeatability and reliability are fundamental and crucial for a testing algorithm's validity, fairness, and practical feasibility, especially for standardization. However, these properties are rarely satisfied or ensured, especially as the subject robots become more complex, uncertain, and varied. This issue was present in traditional risk assessments through Monte-Carlo sampling, and remains a bottleneck for the recent accelerated risk assessment methods, primarily those using importance sampling. This study aims to enhance existing accelerated testing frameworks by proposing a new algorithm that provably integrates repeatability and reliability with the already established formality and efficiency. It also features demonstrations assessing the risk of instability from frontal impacts, initiated by push-over disturbances on a controlled inverted pendulum and a 7-DoF planar bipedal robot Rabbit managed by various control algorithms.


title: subMFL: Compatiple subModel Generation for Federated Learning in Device Heterogenous Environment

abstract: Federated Learning (FL) is commonly used in systems with distributed and heterogeneous devices with access to varying amounts of data and diverse computing and storage capacities. FL training process enables such devices to update the weights of a shared model locally using their local data and then a trusted central server combines all of those models to generate a global model. In this way, a global model is generated while the data remains local to devices to preserve privacy. However, training large models such as Deep Neural Networks (DNNs) on resource-constrained devices can take a prohibitively long time and consume a large amount of energy. In the current process, the low-capacity devices are excluded from the training process, although they might have access to unseen data. To overcome this challenge, we propose a model compression approach that enables heterogeneous devices with varying computing capacities to participate in the FL process. In our approach, the server shares a dense model with all devices to train it: Afterwards, the trained model is gradually compressed to obtain submodels with varying levels of sparsity to be used as suitable initial global models for resource-constrained devices that were not capable of train the first dense model. This results in an increased participation rate of resource-constrained devices while the transferred weights from the previous round of training are preserved. Our validation experiments show that despite reaching about 50 per cent global sparsity, generated submodels maintain their accuracy while can be shared to increase participation by around 50 per cent.


title: Efficient LLM-Jailbreaking by Introducing Visual Modality

abstract: This paper focuses on jailbreaking attacks against large language models (LLMs), eliciting them to generate objectionable content in response to harmful user queries. Unlike previous LLM-jailbreaks that directly orient to LLMs, our approach begins by constructing a multimodal large language model (MLLM) through the incorporation of a visual module into the target LLM. Subsequently, we conduct an efficient MLLM-jailbreak to generate jailbreaking embeddings embJS. Finally, we convert the embJS into text space to facilitate the jailbreaking of the target LLM. Compared to direct LLM-jailbreaking, our approach is more efficient, as MLLMs are more vulnerable to jailbreaking than pure LLM. Additionally, to improve the attack success rate (ASR) of jailbreaking, we propose an image-text semantic matching scheme to identify a suitable initial input. Extensive experiments demonstrate that our approach surpasses current state-of-the-art methods in terms of both efficiency and effectiveness. Moreover, our approach exhibits superior cross-class jailbreaking capabilities.


title: On the Random Minimum Spanning Subgraph Problem for Hypergraphs

abstract: The weight of the minimum spanning tree in a complete weighted graph with random edge weights is a well-known problem. For various classes of distributions, it is proved that the weight of the minimum spanning tree tends to a constant, which can be calculated depending on the distribution. In this paper, we generalise this result to the hypergraphs setting.


title: Direct, indirect, and self-trapped excitons in Cs$_2$AgBiBr$_6$

abstract: Cs$_2$AgBiBr$_6$ is a representative halide double perovskite which exhibits promising photovoltaic and light-emitting properties, making it a candidate for next-generation solar cells and LED technologies. Here, we study various possible excited states of this material to understand its absorption and emission properties. We use Time-Dependent Density Functional Theory (TD-DFT) coupled with non-empirical hybrid functionals, specifically PBE0($\alpha$) and dielectric-dependent hybrids (DDH) to explore direct, indirect, and self-trapped excitons in this material. Based on comparison with experiment, we show that these methods can give excellent prediction of the absorption spectrum and that the fundamental band gap has been underestimated in previous computational studies. We connect the experimental photoluminescence signals at 1.9-2.0 eV to the emission from self-trapped excitons and electron polarons. Finally, we reveal a complex landscape with energetically competing direct, indirect, and self-trapped excitons in the material.


title: Safe Multi-agent Reinforcement Learning with Natural Language Constraints

abstract: The role of natural language constraints in Safe Multi-agent Reinforcement Learning (MARL) is crucial, yet often overlooked. While Safe MARL has vast potential, especially in fields like robotics and autonomous vehicles, its full potential is limited by the need to define constraints in pre-designed mathematical terms, which requires extensive domain expertise and reinforcement learning knowledge, hindering its broader adoption. To address this limitation and make Safe MARL more accessible and adaptable, we propose a novel approach named Safe Multi-agent Reinforcement Learning with Natural Language constraints (SMALL). Our method leverages fine-tuned language models to interpret and process free-form textual constraints, converting them into semantic embeddings that capture the essence of prohibited states and behaviours. These embeddings are then integrated into the multi-agent policy learning process, enabling agents to learn policies that minimize constraint violations while optimizing rewards. To evaluate the effectiveness of SMALL, we introduce the LaMaSafe, a multi-task benchmark designed to assess the performance of multiple agents in adhering to natural language constraints. Empirical evaluations across various environments demonstrate that SMALL achieves comparable rewards and significantly fewer constraint violations, highlighting its effectiveness in understanding and enforcing natural language constraints.


title: Zeros of the Brownian Sheet

abstract: In this work we firstly answer to a question raised by Khoshnevisan in \cite[Open Problem 4]{khoshnevisan2007slices} by proving that almost surely there is no projection of big enough rank changing the Hausdorff dimension of the zeros of the Brownian sheet. Secondly, we prove that almost surely for every projection whose rank isn't matching the aforementioned condition, the projection of the zero set is the entirety of the projective space. Key words: Brownian sheet, zeros set, Hausdorff dimension, orthogonal projection.


title: About truncated Chebyshev spectral method for solving numerical differentiation and summation

abstract: The problems of optimal recovering univariate functions and their derivatives are studied. To solve these problems, two variants of the truncation method are constructed, which are order-optimal both in the sense of accuracy and in terms of the amount of involved Galerkin information. For numerical summation, it has been established how the parameters characterizing the problem being solved affect its stability.


title: Chaotic advection in a steady three-dimensional MHD flow

abstract: We investigate a real 3D stationary flow characterized by chaotic advection generated by a magnetic field created by permanent magnets acting on a weakly conductive fluid subjected to a weak constant current. The model under consideration involves the Stokes equations for viscous incompressible fluid at low Reynolds number in which the density forces correspond to the Lorentz force generated by the magnetic field of the magnets and the electric current through the fluid. An innovative numerical approach based on a mixed finite element method has been developed and implemented for computing the flow velocity fields with the electromagnetic force. This ensures highly accurate numerical results, allowing a detailed analysis of the chaotic behavior of fluid trajectories through the computations of associated Poincar\'e sections and Lyapunov exponents. Subsequently, an examination of mixing efficiency is conducted, employing computations of contamination and homogeneity rates, as well as mixing time. The obtained results underscore the relevance of the modeling and computational tools employed, as well as the design of the magnetohydrodynamic device used.


title: Thermodynamic topology of topological black hole in $F(R)$-ModMax gravity's rainbow

abstract: In order to include the effect of high energy and topological parameters on black holes in $F(R)$ gravity, we consider two corrections to this gravity: energy-dependent spacetime with different topological constants, and a nonlinear electrodynamics field. In other words, we combine $F(R)$ gravity's rainbow with ModMax nonlinear electrodynamics theory to see the effects of high energy and topological parameters on the physics of black holes. For this purpose, we first extract topological black hole solutions in $F(R)$% -ModMax gravity's rainbow. Then, by considering black holes as thermodynamic systems, we obtain thermodynamic quantities and check the first law of thermodynamics. The effect of the topological parameter on the Hawking temperature and the total mass of black holes is obvious. We also discuss the thermodynamic topology of topological black holes in $F(R)$-ModMax gravity's rainbow using the off-shell free energy method. In this formalism, black holes are assumed to be equivalent to defects in their thermodynamic spaces. For our analysis, we consider two different types of thermodynamic ensembles. These are: fixed $q$ ensemble and fixed $\phi$ ensemble. We take into account all the different types of curvature hypersurfaces that can be constructed in these black holes. The local and global topology of these black holes are studied by computing the topological charges at the defects in their thermodynamic spaces. Finally, in accordance with their topological charges, we classify the black holes into three topological classes with total winding numbers corresponding to $-1, 0$, and $1$. We observe that the topological classes of these black holes are dependent on the value of the rainbow function, the sign of the scalar curvature, and the choice of ensembles.


title: Equality between two general ridge estimators and equivalence of their residual sums of squares

abstract: General ridge estimators are typical linear estimators in a general linear model. The class of them include some shrinkage estimators in addition to classical linear unbiased estimators such as the ordinary least squares estimator and the weighted least squares estimator. We derive necessary and sufficient conditions under which two general ridge estimators coincide. In particular, two noteworthy conditions are added to those from previous studies. The first condition is given as a seemingly column space relationship to the covariance matrix of the error term, and the second one is based on the biases of general ridge estimators. Another problem studied in this paper is to derive an equivalence condition such that equality between two residual sums of squares holds when general ridge estimators are considered.


title: Applications of Generative AI (GAI) for Mobile and Wireless Networking: A Survey

abstract: The success of Artificial Intelligence (AI) in multiple disciplines and vertical domains in recent years has promoted the evolution of mobile networking and the future Internet toward an AI-integrated Internet-of-Things (IoT) era. Nevertheless, most AI techniques rely on data generated by physical devices (e.g., mobile devices and network nodes) or specific applications (e.g., fitness trackers and mobile gaming). To bypass this circumvent, Generative AI (GAI), a.k.a. AI-generated content (AIGC), has emerged as a powerful AI paradigm; thanks to its ability to efficiently learn complex data distributions and generate synthetic data to represent the original data in various forms. This impressive feature is projected to transform the management of mobile networking and diversify the current services and applications provided. On this basis, this work presents a concise tutorial on the role of GAIs in mobile and wireless networking. In particular, this survey first provides the fundamentals of GAI and representative GAI models, serving as an essential preliminary to the understanding of the applications of GAI in mobile and wireless networking. Then, this work provides a comprehensive review of state-of-the-art studies and GAI applications in network management, wireless security, semantic communication, and lessons learned from the open literature. Finally, this work summarizes the current research on GAI for mobile and wireless networking by outlining important challenges that need to be resolved to facilitate the development and applicability of GAI in this edge-cutting area.


title: From Forest to Zoo: Great Ape Behavior Recognition with ChimpBehave

abstract: This paper addresses the significant challenge of recognizing behaviors in non-human primates, specifically focusing on chimpanzees. Automated behavior recognition is crucial for both conservation efforts and the advancement of behavioral research. However, it is significantly hindered by the labor-intensive process of manual video annotation. Despite the availability of large-scale animal behavior datasets, the effective application of machine learning models across varied environmental settings poses a critical challenge, primarily due to the variability in data collection contexts and the specificity of annotations. In this paper, we introduce ChimpBehave, a novel dataset featuring over 2 hours of video (approximately 193,000 video frames) of zoo-housed chimpanzees, meticulously annotated with bounding boxes and behavior labels for action recognition. ChimpBehave uniquely aligns its behavior classes with existing datasets, allowing for the study of domain adaptation and cross-dataset generalization methods between different visual settings. Furthermore, we benchmark our dataset using a state-of-the-art CNN-based action recognition model, providing the first baseline results for both within and cross-dataset settings. The dataset, models, and code can be accessed at: https://github.com/MitchFuchs/ChimpBehave


title: The CFG Complexity of Singleton Sets

abstract: Let G be a context-free grammar (CFG) in Chomsky normal form. We take the number of rules in G to be the size of G. We also assume all CFGs are in Chomsky normal form. We consider the question of, given a string w of length n, what is the smallest CFG such that L(G)={w}? We show the following: 1) For all w, |w|=n, there is a CFG of size with O(n/log n) rules, such that L(G)={w}. 2) There exists a string w, |w|=n, such that every CFG G with L(G)={w} is of size Omega(n/log n). We give two proofs of: one nonconstructive, the other constructive.


title: SEA Cache: A Performance-Efficient Countermeasure for Contention-based Attacks

abstract: Many cache designs have been proposed to guard against contention-based side-channel attacks. One well-known type of cache is the randomized remapping cache. Many randomized remapping caches provide fixed or over protection, which leads to permanent performance degradation, or they provide flexible protection, but sacrifice performance against strong contention-based attacks. To improve the secure cache design, we extend an existing secure cache design, CEASER-SH cache, and propose the SEA cache. The novel cache configurations in both caches are logical associativity, which allows the cache line to be placed not only in its mapped cache set but also in the subsequent cache sets. SEA cache allows each user or each process to have a different local logical associativity. Hence, only those users or processes that request extra protection against contention-based attacks are protected with high logical associativity. Other users or processes can access the cache with lower latency and higher performance. Compared to a CEASER-SH cache with logical associativity of 8, an SEA cache with logical associativity of 1 for normal protection users and 16 for high protection users has a Cycles Per Instruction penalty that is about 0.6% less for users under normal protections and provides better security against contention-based attacks. Based on a 45nm technology library, and compared to a conventional cache, we estimate the power overhead is about 20% and the area overhead is 3.4%.


title: A Simple and Adaptive Learning Rate for FTRL in Online Learning with Minimax Regret of $\Theta(T^{2/3})$ and its Application to Best-of-Both-Worlds

abstract: Follow-the-Regularized-Leader (FTRL) is a powerful framework for various online learning problems. By designing its regularizer and learning rate to be adaptive to past observations, FTRL is known to work adaptively to various properties of an underlying environment. However, most existing adaptive learning rates are for online learning problems with a minimax regret of $\Theta(\sqrt{T})$ for the number of rounds $T$, and there are only a few studies on adaptive learning rates for problems with a minimax regret of $\Theta(T^{2/3})$, which include several important problems dealing with indirect feedback. To address this limitation, we establish a new adaptive learning rate framework for problems with a minimax regret of $\Theta(T^{2/3})$. Our learning rate is designed by matching the stability, penalty, and bias terms that naturally appear in regret upper bounds for problems with a minimax regret of $\Theta(T^{2/3})$. As applications of this framework, we consider two major problems dealing with indirect feedback: partial monitoring and graph bandits. We show that FTRL with our learning rate and the Tsallis entropy regularizer improves existing Best-of-Both-Worlds (BOBW) regret upper bounds, which achieve simultaneous optimality in the stochastic and adversarial regimes. The resulting learning rate is surprisingly simple compared to the existing learning rates for BOBW algorithms for problems with a minimax regret of $\Theta(T^{2/3})$.


title: A Random Forest-based Prediction Model for Turning Points in Antagonistic Event-Group Competitions

abstract: At present, most of the prediction studies related to antagonistic event-group competitions focus on the prediction of competition results, and less on the prediction of the competition process, which can not provide real-time feedback of the athletes' state information in the actual competition, and thus can not analyze the changes of the competition situation. In order to solve this problem, this paper proposes a prediction model based on Random Forest for the turning point of the antagonistic event-group. Firstly, the quantitative equation of competitive potential energy is proposed; Secondly, the quantitative value of competitive potential energy is obtained by using the dynamic combination of weights method, and the turning point of the competition situation of the antagonistic event-group is marked according to the quantitative time series graph; Finally, the random forest prediction model based on the optimisation of the KM-SMOTE algorithm and the grid search method is established. The experimental analysis shows that: The quantitative equation of competitive potential energy can effectively reflect the dynamic situation of the competition; The model can effectively predict the turning point of the competition situation of the antagonistic event-group, and the recall rate of the model in the test set is 86.13%; The model has certain significance for the future study of the competition situation of the antagonistic event-group.


title: EMAG: Ego-motion Aware and Generalizable 2D Hand Forecasting from Egocentric Videos

abstract: Predicting future human behavior from egocentric videos is a challenging but critical task for human intention understanding. Existing methods for forecasting 2D hand positions rely on visual representations and mainly focus on hand-object interactions. In this paper, we investigate the hand forecasting task and tackle two significant issues that persist in the existing methods: (1) 2D hand positions in future frames are severely affected by ego-motions in egocentric videos; (2) prediction based on visual information tends to overfit to background or scene textures, posing a challenge for generalization on novel scenes or human behaviors. To solve the aforementioned problems, we propose EMAG, an ego-motion-aware and generalizable 2D hand forecasting method. In response to the first problem, we propose a method that considers ego-motion, represented by a sequence of homography matrices of two consecutive frames. We further leverage modalities such as optical flow, trajectories of hands and interacting objects, and ego-motions, thereby alleviating the second issue. Extensive experiments on two large-scale egocentric video datasets, Ego4D and EPIC-Kitchens 55, verify the effectiveness of the proposed method. In particular, our model outperforms prior methods by $7.0$\% on cross-dataset evaluations. Project page: https://masashi-hatano.github.io/EMAG/


title: Structure Gaussian SLAM with Manhattan World Hypothesis

abstract: Gaussian SLAM systems have made significant advancements in improving the efficiency and fidelity of real-time reconstructions. However, these systems often encounter incomplete reconstructions in complex indoor environments, characterized by substantial holes due to unobserved geometry caused by obstacles or limited view angles. To address this challenge, we present Manhattan Gaussian SLAM (MG-SLAM), an RGB-D system that leverages the Manhattan World hypothesis to enhance geometric accuracy and completeness. By seamlessly integrating fused line segments derived from structured scenes, MG-SLAM ensures robust tracking in textureless indoor areas. Moreover, The extracted lines and planar surface assumption allow strategic interpolation of new Gaussians in regions of missing geometry, enabling efficient scene completion. Extensive experiments conducted on both synthetic and real-world scenes demonstrate that these advancements enable our method to achieve state-of-the-art performance, marking a substantial improvement in the capabilities of Gaussian SLAM systems.


title: Promptus: Can Prompts Streaming Replace Video Streaming with Stable Diffusion

abstract: With the exponential growth of video traffic, traditional video streaming systems are approaching their limits in compression efficiency and communication capacity. To further reduce bitrate while maintaining quality, we propose Promptus, a disruptive novel system that streaming prompts instead of video content with Stable Diffusion, which converts video frames into a series of "prompts" for delivery. To ensure pixel alignment, a gradient descent-based prompt fitting framework is proposed. To achieve adaptive bitrate for prompts, a low-rank decomposition-based bitrate control algorithm is introduced. For inter-frame compression of prompts, a temporal smoothing-based prompt interpolation algorithm is proposed. Evaluations across various video domains and real network traces demonstrate Promptus can enhance the perceptual quality by 0.111 and 0.092 (in LPIPS) compared to VAE and H.265, respectively, and decreases the ratio of severely distorted frames by 89.3% and 91.7%. Moreover, Promptus achieves real-time video generation from prompts at over 150 FPS. To the best of our knowledge, Promptus is the first attempt to replace video codecs with prompt inversion and the first to use prompt streaming instead of video streaming. Our work opens up a new paradigm for efficient video communication beyond the Shannon limit.


title: Chemical Space-Informed Machine Learning Models for Rapid Predictions of X-ray Photoelectron Spectra of Organic Molecules

abstract: We present machine learning models based on kernel-ridge regression for predicting X-ray photoelectron spectra of organic molecules originating from the $K$-shell ionization energies of carbon (C), nitrogen (N), oxygen (O), and fluorine (F) atoms. We constructed the training dataset through high-throughput calculations of $K$-shell core-electron binding energies (CEBEs) for 12,880 small organic molecules in the bigQM7$\omega$ dataset, employing the $\Delta$-SCF formalism coupled with meta-GGA-DFT and a variationally converged basis set. The models are cost-effective, as they require the atomic coordinates of a molecule generated using universal force fields while estimating the target-level CEBEs corresponding to DFT-level equilibrium geometry. We explore transfer learning by utilizing the atomic environment feature vectors learned using a graph neural network framework in kernel-ridge regression. Additionally, we enhance accuracy within the $\Delta$-machine learning framework by leveraging inexpensive baseline spectra derived from Kohn--Sham eigenvalues. When applied to 208 combinatorially substituted uracil molecules larger than those in the training set, our analyses suggest that the models may not provide quantitatively accurate predictions of CEBEs but offer a strong linear correlation relevant for virtual high-throughput screening. We present the dataset and models as the Python module, ${\tt cebeconf}$, to facilitate further explorations.


title: Optimal Control of Bipartite Quantum Systems

abstract: Closed bipartite quantum systems subject to fast local unitary control are studied using quantum optimal control theory and a method of reduced control systems based on the Schmidt decomposition. Particular focus is given to the time-optimal generation of maximally entangled states and product states, as well as to the problem of stabilizing quantum states with a certain amount of entanglement. Explicit analytical solutions are given for general systems consisting of two qubits (as well as for bosonic and fermionic analogues) and also for a class of systems consisting of two coupled qutrits which is studied using the Pontryagin Maximum Principle.


title: A Larger Sample Confirms Small Planets Around Hot Stars Are Misaligned

abstract: The distribution of stellar obliquities provides critical insight into the formation and evolution pathways of exoplanets. In the past decade, it was found that hot stars hosting hot Jupiters are more likely to have high obliquities than cool stars, but it is not clear whether this trend exists only for hot Jupiters or holds for other types of planets. In this work, we extend the study of the obliquities of hot (6250-7000\,K) stars with transiting super-Earth and sub-Neptune-sized planets. We constrain the obliquity distribution based on measurements of the stars' projected rotation velocities. Our sample consists of 170 TESS and \textit{Kepler} planet-hosting stars and 180 control stars chosen to have indistinguishable spectroscopic characteristics. In our analysis, we find evidence suggesting that the planet hosts have a systematically higher $\langle \sin i \rangle$ compared to the control sample. This result implies that the planet hosts tend to have lower obliquities. However, the observed difference in $\langle \sin i \rangle$ is not significant enough to confirm spin-orbit alignment, as it is 3.8$\sigma$ away from perfect alignment. We also find evidence that within the planet-hosting stars there is a trend of higher obliquity (lower $\langle \sin i\rangle$) for the hotter stars ($\teff > 6250$ K) than for the cooler stars in the sample. This suggests that hot stars hosting smaller planets exhibit a broader obliquity distribution($\langle \sin i\rangle = 0.79 \pm 0.053$) than cooler planet-hosting stars, indicating that high obliquities are not exclusive to hot Jupiters and instead are more broadly tied to hot stars.


title: Chirp asymmetry in Zeeman electromagnetically induced transparency

abstract: The simplest three-level system exhibiting electromagnetically induced transparency (EIT) exhibits an effective conjugation symmetry as well as a permutation symmetry. Breaking conjugation symmetry leads to a distinct chirp asymmetry; the differential response to a frequency increase versus a frequency decrease. Hanle-Zeeman EIT resonance is an ideal platform for testing the theory of chirp asymmetry because so many optical parameters of the system can be changed experimentally. We describe the theory and compare it to an experiment using 87Rb in a buffer gas cell. In contrast with earlier multi-photon chirp asymmetry work this present effort explores the asymmetry at nearly one billionth the earlier chirp rate, yet displays its universal features. Chirp asymmetry may have metrological consequences for understanding systematic dependence on modulation/demodulation parameters.


title: Linguistic Landscape of Generative AI Perception: A Global Twitter Analysis Across 14 Languages

abstract: The advent of generative AI tools has had a profound impact on societies globally, transcending geographical boundaries. Understanding these tools' global reception and utilization is crucial for service providers and policymakers in shaping future policies. Therefore, to unravel the perceptions and engagements of individuals within diverse linguistic communities with regard to generative AI tools, we extensively analyzed over 6.8 million tweets in 14 different languages. Our findings reveal a global trend in the perception of generative AI, accompanied by language-specific nuances. While sentiments toward these tools vary significantly across languages, there is a prevalent positive inclination toward Image tools and a negative one toward Chat tools. Notably, the ban of ChatGPT in Italy led to a sentiment decline and initiated discussions across languages. Furthermore, we established a taxonomy for interactions with chatbots, creating a framework for social analysis underscoring variations in generative AI usage among linguistic communities. We find that the Chinese community predominantly employs chatbots as substitutes for search, while the Italian community tends to present more intricate prompts. Our research provides a robust foundation for further explorations of the social dynamics surrounding generative AI tools and offers invaluable insights for decision-makers in policy, technology, and education.


title: Deep Reinforcement Learning for Intrusion Detection in IoT: A Survey

abstract: The rise of new complex attacks scenarios in Internet of things (IoT) environments necessitate more advanced and intelligent cyber defense techniques such as various Intrusion Detection Systems (IDSs) which are responsible for detecting and mitigating malicious activities in IoT networks without human intervention. To address this issue, deep reinforcement learning (DRL) has been proposed in recent years, to automatically tackle intrusions/attacks. In this paper, a comprehensive survey of DRL-based IDS on IoT is presented. Furthermore, in this survey, the state-of-the-art DRL-based IDS methods have been classified into five categories including wireless sensor network (WSN), deep Q-network (DQN), healthcare, hybrid, and other techniques. In addition, the most crucial performance metrics, namely accuracy, recall, precision, false negative rate (FNR), false positive rate (FPR), and F-measure, are detailed, in order to evaluate the performance of each proposed method. The paper provides a summary of datasets utilized in the studies as well.


title: Task-Agnostic Machine Learning-Assisted Inference

abstract: Machine learning (ML) is playing an increasingly important role in scientific research. In conjunction with classical statistical approaches, ML-assisted analytical strategies have shown great promise in accelerating research findings. This has also opened up a whole new field of methodological research focusing on integrative approaches that leverage both ML and statistics to tackle data science challenges. One type of study that has quickly gained popularity employs ML to predict unobserved outcomes in massive samples and then uses the predicted outcomes in downstream statistical inference. However, existing methods designed to ensure the validity of this type of post-prediction inference are limited to very basic tasks such as linear regression analysis. This is because any extension of these approaches to new, more sophisticated statistical tasks requires task-specific algebraic derivations and software implementations, which ignores the massive library of existing software tools already developed for complex inference tasks and severely constrains the scope of post-prediction inference in real applications. To address this challenge, we propose a novel statistical framework for task-agnostic ML-assisted inference. It provides a post-prediction inference solution that can be easily plugged into almost any established data analysis routine. It delivers valid and efficient inference that is robust to arbitrary choices of ML models, while allowing nearly all existing analytical frameworks to be incorporated into the analysis of ML-predicted outcomes. Through extensive experiments, we showcase the validity, versatility, and superiority of our method compared to existing approaches.


title: Search for non-resonant Higgs boson pair production in final states with leptons, taus, and photons in $pp$ collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector

abstract: A search is presented for non-resonant Higgs boson pair production, targeting the $bbZZ$, 4$V$ ($V$ = $W$ or $Z$), $VV\tau\tau$, 4$\tau$, $\gamma\gamma VV$ and $\gamma\gamma\tau\tau$ decay channels. Events are categorised based on the multiplicity of light charged leptons (electrons or muons), hadronically decaying tau leptons, and photons. The search is based on a data sample of proton-proton collisions at $\sqrt{s}$ = 13 TeV recorded with the ATLAS detector during Run 2 of the Large Hadron Collider, corresponding to an integrated luminosity of 140 fb$^{-1}$. No evidence of the signal is found and the observed (expected) upper limit on the cross-section for non-resonant Higgs boson pair production is determined to be 17 (11) times the Standard Model predicted cross-section at 95% confidence level under the background-only hypothesis. The observed (expected) constraints on the $HHH$ coupling modifier, $\kappa_{\lambda}$, are determined to be $-6.2 < \kappa_{\lambda} < 11.6$ ($-4.5 < \kappa_{\lambda} < 9.6$) at 95% confidence level, assuming the Standard Model for the expected limits and that new physics would only affect $\kappa_{\lambda}$.


title: A simultaneous unbinned differential cross section measurement of twenty-four $Z$+jets kinematic observables with the ATLAS detector

abstract: $Z$ boson events at the Large Hadron Collider can be selected with high purity and are sensitive to a diverse range of QCD phenomena. As a result, these events are often used to probe the nature of the strong force, improve Monte Carlo event generators, and search for deviations from Standard Model predictions. All previous measurements of $Z$ boson production characterize the event properties using a small number of observables and present the results as differential cross sections in predetermined bins. In this analysis, a machine learning method called OmniFold is used to produce a simultaneous measurement of twenty-four $Z$+jets observables using $139$ fb$^{-1}$ of proton-proton collisions at $\sqrt{s}=13$ TeV collected with the ATLAS detector. Unlike any previous fiducial differential cross-section measurement, this result is presented unbinned as a dataset of particle-level events, allowing for flexible re-use in a variety of contexts and for new observables to be constructed from the twenty-four measured observables.


title: CycleFormer : TSP Solver Based on Language Modeling

abstract: We propose a new transformer model for the Traveling Salesman Problem (TSP) called CycleFormer. We identified distinctive characteristics that need to be considered when applying a conventional transformer model to TSP and aimed to fully incorporate these elements into the TSP-specific transformer. Unlike the token sets in typical language models, which are limited and static, the token (node) set in TSP is unlimited and dynamic. To exploit this fact to the fullest, we equated the encoder output with the decoder linear layer and directly connected the context vector of the encoder to the decoder encoding. Additionally, we added a positional encoding to the encoder tokens that reflects the two-dimensional nature of TSP, and devised a circular positional encoding for the decoder tokens that considers the cyclic properties of a tour. By incorporating these ideas, CycleFormer outperforms state-of-the-art (SOTA) transformer models for TSP from TSP-50 to TSP-500. Notably, on TSP-500, the optimality gap was reduced by approximately 2.8 times, from 3.09% to 1.10%, compared to the existing SOTA. The code will be made available at https://github.com/Giventicket/CycleFormer.


title: Lepton flavor violation with tau leptons

abstract: We review the status and importance of lepton flavor violation with tauons, focusing on overlooked flavor-breaking patterns as well as tau-flavor violation in nucleon decays.


title: A Point-Neighborhood Learning Framework for Nasal Endoscope Image Segmentation

abstract: The lesion segmentation on endoscopic images is challenging due to its complex and ambiguous features. Fully-supervised deep learning segmentation methods can receive good performance based on entirely pixel-level labeled dataset but greatly increase experts' labeling burden. Semi-supervised and weakly supervised methods can ease labeling burden, but heavily strengthen the learning difficulty. To alleviate this difficulty, weakly semi-supervised segmentation adopts a new annotation protocol of adding a large number of point annotation samples into a few pixel-level annotation samples. However, existing methods only mine points' limited information while ignoring reliable prior surrounding the point annotations. In this paper, we propose a weakly semi-supervised method called Point-Neighborhood Learning (PNL) framework. To mine the prior of the pixels surrounding the annotated point, we transform a single-point annotation into a circular area named a point-neighborhood. We propose point-neighborhood supervision loss and pseudo-label scoring mechanism to enhance training supervision. Point-neighborhoods are also used to augment the data diversity. Our method greatly improves performance without changing the structure of segmentation network. Comprehensive experiments show the superiority of our method over the other existing methods, demonstrating its effectiveness in point-annotated medical images. The project code will be available on: https://github.com/ParryJay/PNL.


title: Iterative Learning Control of Fast, Nonlinear, Oscillatory Dynamics (Preprint)

abstract: The sudden onset of deleterious and oscillatory dynamics (often called instabilities) is a known challenge in many fluid, plasma, and aerospace systems. These dynamics are difficult to address because they are nonlinear, chaotic, and are often too fast for active control schemes. In this work, we develop an alternative active controls system using an iterative, trajectory-optimization and parameter-tuning approach based on Iterative Learning Control (ILC), Time-Lagged Phase Portraits (TLPP) and Gaussian Process Regression (GPR). The novelty of this approach is that it can control a system's dynamics despite the controller being much slower than the dynamics. We demonstrate this controller on the Lorenz system of equations where it iteratively adjusts (tunes) the system's input parameters to successfully reproduce a desired oscillatory trajectory or state. Additionally, we investigate the system's dynamical sensitivity to its control parameters, identify continuous and bounded regions of desired dynamical trajectories, and demonstrate that the controller is robust to missing information and uncontrollable parameters as long as certain requirements are met. The controller presented in this work provides a framework for low-speed control for a variety of fast, nonlinear systems that may aid in instability suppression and mitigation.


title: Cross-Training with Multi-View Knowledge Fusion for Heterogenous Federated Learning

abstract: Federated learning benefits from cross-training strategies, which enables models to train on data from distinct sources to improve the generalization capability. However, the data heterogeneity between sources may lead models to gradually forget previously acquired knowledge when undergoing cross-training to adapt to new tasks or data sources. We argue that integrating personalized and global knowledge to gather information from multiple perspectives could potentially improve performance. To achieve this goal, this paper presents a novel approach that enhances federated learning through a cross-training scheme incorporating multi-view information. Specifically, the proposed method, termed FedCT, includes three main modules, where the consistency-aware knowledge broadcasting module aims to optimize model assignment strategies, which enhances collaborative advantages between clients and achieves an efficient federated learning process. The multi-view knowledge-guided representation learning module leverages fused prototypical knowledge from both global and local views to enhance the preservation of local knowledge before and after model exchange, as well as to ensure consistency between local and global knowledge. The mixup-based feature augmentation module aggregates rich information to further increase the diversity of feature spaces, which enables the model to better discriminate complex samples. Extensive experiments were conducted on four datasets in terms of performance comparison, ablation study, in-depth analysis and case study. The results demonstrated that FedCT alleviates knowledge forgetting from both local and global views, which enables it outperform state-of-the-art methods.


title: Schubert Subspace Codes

abstract: In this paper, we initiate the study of constant dimension subspace codes restricted to Schubert varieties, which we call Schubert subspace codes. These codes have a very natural geometric description, as objects that we call intersecting sets with respect to a fixed subspace. We provide a geometric construction of maximum size constant dimension subspace codes in some Schubert varieties with the largest possible value for the minimum subspace distance. Finally, we generalize the problem to different values of the minimum distance.


title: Mass Cycle and Dynamics of a Virtual Quiescent Prominence

abstract: The mass cycle of solar prominences or filaments is still not completely understood. Researchers agree that these dense structures form by coronal in-situ condensations and plasma siphoning from the underlying chromosphere. In the evaporation-condensation model siphoning arises due to evaporation of chromospheric plasma from localised footpoint heating but this is challenging to justify observationally. Here, we simulate the reconnection-condensation model at extreme-resolutions down to 20.8 km within a three-dimensional magnetohydrodynamic coronal volume. We form a draining, quiescent prominence and associated coronal rain simultaneously. We show that thermal instability --acting as a trigger for local condensation formation-- by itself drives siphoning flows from the low-corona without the need of any localised heating. In addition, for the first time we demonstrate through a statistical analysis along more than 1000 magnetic field lines that cold condensations give rise to siphoning flows within magnetic threads. This siphoning arises from the strong pressure gradient along field lines induced by thermal instability. No correlation is found between siphoning flows and the prominence mass, making thermal instability the main in-situ mass collection mechanism. Our simulated prominence drains by gliding along strongly sheared, asymmetric, dipped magnetic arcades, and develops natural vertical fine-structure in an otherwise horizontal magnetic field due to the magnetic Rayleigh-Taylor instability. By synthesising our data, our model shows remarkable agreement with observations of quiescent prominences such as its dark coronal cavity in extreme-ultraviolet emission channels, fine-scale vertical structure and reconnection outflows which, for the first time, have been self-consistently obtained as the prominence evolves.


title: Towards a characterization of the inverse systems of complete intersections

abstract: In this paper we give conditions on a homogeneous polynomial for which the associated graded Artin algebra is a complete intersection.


title: Stability of the second non trivial eigenvalue of the Neumann Laplacian

abstract: In this paper, building on the ideas of Brasco and Pratelli (Geom. Funct. Anal., 22 (2012), 107-135), we establish a stability estimate for Bucur and Henrot's inequality (Acta Math., 222 (2019), 337-361). Their inequality asserts that, among regular sets of given measure, the disjoint union of two balls with the same radius maximizes the second non trivial eigenvalue of the Neumann Laplacian.


title: Threshold-Independent Fair Matching through Score Calibration

abstract: Entity Matching (EM) is a critical task in numerous fields, such as healthcare, finance, and public administration, as it identifies records that refer to the same entity within or across different databases. EM faces considerable challenges, particularly with false positives and negatives. These are typically addressed by generating matching scores and apply thresholds to balance false positives and negatives in various contexts. However, adjusting these thresholds can affect the fairness of the outcomes, a critical factor that remains largely overlooked in current fair EM research. The existing body of research on fair EM tends to concentrate on static thresholds, neglecting their critical impact on fairness. To address this, we introduce a new approach in EM using recent metrics for evaluating biases in score based binary classification, particularly through the lens of distributional parity. This approach enables the application of various bias metrics like equalized odds, equal opportunity, and demographic parity without depending on threshold settings. Our experiments with leading matching methods reveal potential biases, and by applying a calibration technique for EM scores using Wasserstein barycenters, we not only mitigate these biases but also preserve accuracy across real world datasets. This paper contributes to the field of fairness in data cleaning, especially within EM, which is a central task in data cleaning, by promoting a method for generating matching scores that reduce biases across different thresholds.


title: Hardware-Efficient EMG Decoding for Next-Generation Hand Prostheses

abstract: Advancements in neural engineering have enabled the development of Robotic Prosthetic Hands (RPHs) aimed at restoring hand functionality. Current commercial RPHs offer limited control through basic on/off commands. Recent progresses in machine learning enable finger movement decoding with higher degrees of freedom, yet the high computational complexity of such models limits their application in portable devices. Future RPH designs must balance portability, low power consumption, and high decoding accuracy to be practical for individuals with disabilities. To this end, we introduce a novel attractor-based neural network to realize on-chip movement decoding for next-generation portable RPHs. The proposed architecture comprises an encoder, an attention layer, an attractor network, and a refinement regressor. We tested our model on four healthy subjects and achieved a decoding accuracy of 80.3%. Our proposed model is over 120 and 50 times more compact compared to state-of-the-art LSTM and CNN models, respectively, with comparable (or superior) decoding accuracy. Therefore, it exhibits minimal hardware complexity and can be effectively integrated as a System-on-Chip.


title: Would I Lie To You? Inference Time Alignment of Language Models using Direct Preference Heads

abstract: Pre-trained Language Models (LMs) exhibit strong zero-shot and in-context learning capabilities; however, their behaviors are often difficult to control. By utilizing Reinforcement Learning from Human Feedback (RLHF), it is possible to fine-tune unsupervised LMs to follow instructions and produce outputs that reflect human preferences. Despite its benefits, RLHF has been shown to potentially harm a language model's reasoning capabilities and introduce artifacts such as hallucinations where the model may fabricate facts. To address this issue we introduce Direct Preference Heads (DPH), a fine-tuning framework that enables LMs to learn human preference signals through an auxiliary reward head without directly affecting the output distribution of the language modeling head. We perform a theoretical analysis of our objective function and find strong ties to Conservative Direct Preference Optimization (cDPO). Finally we evaluate our models on GLUE, RACE, and the GPT4All evaluation suite and demonstrate that our method produces models which achieve higher scores than those fine-tuned with Supervised Fine-Tuning (SFT) or Direct Preference Optimization (DPO) alone.


title: A brief conversation about subtraction games

abstract: In this survey we revisit {\sc finite subtraction}, one-heap subtraction games on finite rulesets. The main purpose is to give a general overview of the development, and specifically to draw attention to Flammenkamp's thesis (1997), where he, contrary to other studies, experimentally observes exponential eventual period length of the outcomes, for a carefully selected subclass of games. In addition, we contribute an appendix on {\sc finite excluded subtraction} by Suetsugu.


title: Hypergraph-Aided Task-Resource Matching for Maximizing Value of Task Completion in Collaborative IoT Systems

abstract: With the growing scale and intrinsic heterogeneity of Internet of Things (IoT) systems, distributed device collaboration becomes essential for effective task completion by dynamically utilizing limited communication and computing resources. However, the separated design and situation-agnostic operation of computing, communication and application layers create a fundamental challenge for rapid task-resource matching, which further deteriorate the overall task completion effectiveness. To overcome this challenge, we utilize hypergraph as a new tool to vertically unify computing, communication, and task aspects of IoT systems for an effective matching by accurately capturing the relationships between tasks and communication and computing resources. Specifically, a state-of-the-art task-resource matching hypergraph (TRM-hypergraph) model is proposed in this paper, which is used to effectively transform the process of allocating complex heterogeneous resources to convoluted tasks into a hypergraph matching problem. Taking into account computational complexity and storage, a game-theoretic hypergraph matching algorithm is proposed via considering the hypergraph matching problem as a non-cooperative multi-player clustering game. Numerical results demonstrate that the proposed TRM-hypergraph model achieves superior performance in matching of tasks and resources compared with comparison algorithms.


title: Extremal spectral radius in h-extra r-component (edge)-connected graphs

abstract: For two integers $r\geq 2$ and $h\geq 0$, a subset $S\subseteq V$ is called an $h$-extra $r$-component cut of $G$ such that there are at least $r$ connected components in $G\!-\!S$ and each component has at least $h+1$ vertices. The minimum size of any $h$-extra $r$-component cut of $G$, if it exists, is the $h$-extra $r$-component connectivity of $G$, denoted as $\kappa^h_r(G)$. Denote by $\mathcal{G}_{n,\delta}^{\kappa_r^h}$ the set of $\kappa^h_r$-connected graphs of order $n$ with minimum degree $\delta$. What are the corresponding extremal graphs in $\mathcal{G}_{n,\delta}^{\kappa_r^h}$ with the maximum spectral radius for $r\geq 2$ and $h\geq 0$? Fan, Gu and Lin [$l$-connectivity, $l$-edge-connectivity and spectral radius of graphs, \emph{arXiv}:2309.05247] give the answer to $r\geq 2$ and $h=0$. In this paper, we provide a solution for $r\geq 2$ and $h\geq1$. Moreover, we also investigate analogous problems for the edge version. Our results can imply some previous results, specifically those of Lu and Lin [\emph{J. Discrete Algorithms} 31 (2015) 113--119] in connectivity, and for the work of Fan, Gu, and Lin[\emph{J. Graph Theory} (2023) 1--15], as well as Liu, Lu, and Tian[\emph{Linear Algebra Appl.} 389 (2004) 139--145], concerning edge connectivity.


title: A General Automata Model for First-Order Temporal Logics (Extended Version)

abstract: First-order linear temporal logic (FOLTL) is a flexible and expressive formalism capable of naturally describing complex behaviors and properties. Although the logic is in general highly undecidable, the idea of using it as a specification language for the verification of complex infinite-state systems is appealing. However, a missing piece, which has proved to be an invaluable tool in dealing with other temporal logics, is an automaton model capable of capturing the logic. In this paper we address this issue, by defining and studying such a model, which we call first-order automaton. We define this very general class of automata, and the corresponding notion of regular first-order language, showing their closure under most common language-theoretic operations. We show how they can capture any FOLTL formula over any signature and theory, and provide sufficient conditions for the semi-decidability of their non-emptiness problem. Then, to show the usefulness of the formalism, we prove the decidability of monodic FOLTL, a classic result known in the literature, with a simpler and direct proof.


title: Enhancing Plant Disease Detection: A Novel CNN-Based Approach with Tensor Subspace Learning and HOWSVD-MD

abstract: Machine learning has revolutionized the field of agricultural science, particularly in the early detection and management of plant diseases, which are crucial for maintaining crop health and productivity. Leveraging advanced algorithms and imaging technologies, researchers are now able to identify and classify plant diseases with unprecedented accuracy and speed. Effective management of tomato diseases is crucial for enhancing agricultural productivity. The development and application of tomato disease classification methods are central to this objective. This paper introduces a cutting-edge technique for the detection and classification of tomato leaf diseases, utilizing insights from the latest pre-trained Convolutional Neural Network (CNN) models. We propose a sophisticated approach within the domain of tensor subspace learning, known as Higher-Order Whitened Singular Value Decomposition (HOWSVD), designed to boost the discriminatory power of the system. Our approach to Tensor Subspace Learning is methodically executed in two phases, beginning with HOWSVD and culminating in Multilinear Discriminant Analysis (MDA). The efficacy of this innovative method was rigorously tested through comprehensive experiments on two distinct datasets, namely PlantVillage and the Taiwan dataset. The findings reveal that HOWSVD-MDA outperforms existing methods, underscoring its capability to markedly enhance the precision and dependability of diagnosing tomato leaf diseases. For instance, up to 98.36\% and 89.39\% accuracy scores have been achieved under PlantVillage and the Taiwan datasets, respectively.


title: Spectral Mapping of Singing Voices: U-Net-Assisted Vocal Segmentation

abstract: Separating vocal elements from musical tracks is a longstanding challenge in audio signal processing. This study tackles the distinct separation of vocal components from musical spectrograms. We employ the Short Time Fourier Transform (STFT) to extract audio waves into detailed frequency-time spectrograms, utilizing the benchmark MUSDB18 dataset for music separation. Subsequently, we implement a UNet neural network to segment the spectrogram image, aiming to delineate and extract singing voice components accurately. We achieved noteworthy results in audio source separation using of our U-Net-based models. The combination of frequency-axis normalization with Min/Max scaling and the Mean Absolute Error (MAE) loss function achieved the highest Source-to-Distortion Ratio (SDR) of 7.1 dB, indicating a high level of accuracy in preserving the quality of the original signal during separation. This setup also recorded impressive Source-to-Interference Ratio (SIR) and Source-to-Artifact Ratio (SAR) scores of 25.2 dB and 7.2 dB, respectively. These values significantly outperformed other configurations, particularly those using Quantile-based normalization or a Mean Squared Error (MSE) loss function. Our source code, model weights, and demo material can be found at the project's GitHub repository: https://github.com/mbrotos/SoundSeg


title: Detailed nuclear structure calculations for coherent elastic neutrino-nucleus scattering

abstract: Any discovery of `new physics' in the neutrino sector first requires a precise prediction of the expected Standard Model cross section. Currently, Coherent Elastic neutrino-Nucleus Scattering (CEvNS) experiments are statistics limited. However, as new and future experiments scale up, it will be necessary to improve the theoretical predictions. Here we review the calculation of the CEvNS cross section in a consistent theory of hadronic currents and compute the relevant nuclear form factors using the nuclear shell model. The uncertainty on the form factors is explored by repeating the calculation for various shell model interactions and with Skyme-Hartree-Fock evaluations of the Weak-charge radii. We then refine the Standard Model predictions for the recent experimental results of the COHERENT experiment. We find that our cross sections are in good agreement with previous predictions, but with significantly smaller uncertainties - by up to a factor of 10. Near-future CEvNS experiments will meaningfully benefit from improved predictions through an increased sensitivity to new-physics signals.


title: Search for dark mesons decaying to top and bottom quarks in proton-proton collisions at $\sqrt{s}=13$ TeV with the ATLAS detector

abstract: A search for dark mesons originating from strongly-coupled, SU(2) dark flavor symmetry conserving models and decaying gaugephobically to pure Standard Model final states containing top and bottom quarks is presented. The search targets fully hadronic final states and final states with exactly one electron or muon. The analyzed dataset corresponds to an integrated luminosity of 140 $fb^{-1}$ of proton-proton collisions collected at $\sqrt{s}=13$ TeV with the ATLAS detector at the Large Hadron Collider. No significant excess over the Standard Model background expectation is observed and the results are used to set the first direct constraints on this type of model. The two-dimensional signal space of dark pion masses $m_{\pi_D}$ and dark rho-meson masses $m_{\rho_D}$ is scanned. For $m_{\pi_D}/m_{\rho_D}=0.45$, dark pions with masses $m_{\pi_D}<943$ GeV are excluded, while for $m_{\pi_D}/m_{\rho_D}=0.45$ masses of $m_{\pi_D}<738$ GeV are excluded.


title: Can the accuracy bias by facial hairstyle be reduced through balancing the training data?

abstract: Appearance of a face can be greatly altered by growing a beard and mustache. The facial hairstyles in a pair of images can cause marked changes to the impostor distribution and the genuine distribution. Also, different distributions of facial hairstyle across demographics could cause a false impression of relative accuracy across demographics. We first show that, even though larger training sets boost the recognition accuracy on all facial hairstyles, accuracy variations caused by facial hairstyles persist regardless of the size of the training set. Then, we analyze the impact of having different fractions of the training data represent facial hairstyles. We created balanced training sets using a set of identities available in Webface42M that both have clean-shaven and facial hair images. We find that, even when a face recognition model is trained with a balanced clean-shaven / facial hair training set, accuracy variation on the test data does not diminish. Next, data augmentation is employed to further investigate the effect of facial hair distribution in training data by manipulating facial hair pixels with the help of facial landmark points and a facial hair segmentation model. Our results show facial hair causes an accuracy gap between clean-shaven and facial hair images, and this impact can be significantly different between African-Americans and Caucasians.


title: Feasibility of meteor surveying from a Venus orbiter

abstract: Meteor and bolide phenomena caused by the atmospheric ablation of incoming meteoroids are predicted to occur at the planet Venus. Their systematic observation would allow to measure and compare the sub-mm to m meteoroid flux at different locations in the solar system. Using a physical model of atmospheric ablation, we demonstrate that Venus meteors would be brighter, shorter-lived, and appear higher in the atmosphere than Earth meteors. To investigate the feasibility of meteor detection at Venus from an orbiter, we apply the SWARMS survey simulator tool to sets of plausible meteoroid population parameters, atmospheric models and instrument designs suited to the task, such as the Mini-EUSO camera operational on the ISS since 2019. We find that such instrumentation would detect meteors at Venus with a 1.5x to 2.5x higher rate than at Earth. The estimated Venus-Earth detection ratio remains insensitive to variations in the chosen observation orbit and detector characteristics, implying that a meteor survey from Venus orbit is feasible, though contingent on the availability of suitable algorithms and methods for efficient on-board processing and downlinking of the meteor data to Earth. We further show that a hypothetical camera onboard the upcoming EnVision mission to Venus similar to the ISS instrument should detect many times more meteors than needed for an initial characterisation of the large meteoroid population at 0.7 au from the Sun.


title: 1st Place Solution to Odyssey Emotion Recognition Challenge Task1: Tackling Class Imbalance Problem

abstract: Speech emotion recognition is a challenging classification task with natural emotional speech, especially when the distribution of emotion types is imbalanced in the training and test data. In this case, it is more difficult for a model to learn to separate minority classes, resulting in those sometimes being ignored or frequently misclassified. Previous work has utilised class weighted loss for training, but problems remain as it sometimes causes over-fitting for minor classes or under-fitting for major classes. This paper presents the system developed by a multi-site team for the participation in the Odyssey 2024 Emotion Recognition Challenge Track-1. The challenge data has the aforementioned properties and therefore the presented systems aimed to tackle these issues, by introducing focal loss in optimisation when applying class weighted loss. Specifically, the focal loss is further weighted by prior-based class weights. Experimental results show that combining these two approaches brings better overall performance, by sacrificing performance on major classes. The system further employs a majority voting strategy to combine the outputs of an ensemble of 7 models. The models are trained independently, using different acoustic features and loss functions - with the aim to have different properties for different data. Hence these models show different performance preferences on major classes and minor classes. The ensemble system output obtained the best performance in the challenge, ranking top-1 among 68 submissions. It also outperformed all single models in our set. On the Odyssey 2024 Emotion Recognition Challenge Task-1 data the system obtained a Macro-F1 score of 35.69% and an accuracy of 37.32%.


title: Variationally Correct Neural Residual Regression for Parametric PDEs: On the Viability of Controlled Accuracy

abstract: This paper is about learning the parameter-to-solution map for systems of partial differential equations (PDEs) that depend on a potentially large number of parameters covering all PDE types for which a stable variational formulation (SVF) can be found. A central constituent is the notion of variationally correct residual loss function meaning that its value is always uniformly proportional to the squared solution error in the norm determined by the SVF, hence facilitating rigorous a posteriori accuracy control. It is based on a single variational problem, associated with the family of parameter dependent fiber problems, employing the notion of direct integrals of Hilbert spaces. Since in its original form the loss function is given as a dual test norm of the residual a central objective is to develop equivalent computable expressions. A first critical role is played by hybrid hypothesis classes, whose elements are piecewise polynomial in (low-dimensional) spatio-temporal variables with parameter-dependent coefficients that can be represented, e.g. by neural networks. Second, working with first order SVFs, we distinguish two scenarios: (i) the test space can be chosen as an $L_2$-space (e.g. for elliptic or parabolic problems) so that residuals live in $L_2$ and can be evaluated directly; (ii) when trial and test spaces for the fiber problems (e.g. for transport equations) depend on the parameters, we use ultraweak formulations. In combination with Discontinuous Petrov Galerkin concepts the hybrid format is then instrumental to arrive at variationally correct computable residual loss functions. Our findings are illustrated by numerical experiments representing (i) and (ii), namely elliptic boundary value problems with piecewise constant diffusion coefficients and pure transport equations with parameter dependent convection field.


title: A theory of stratification learning

abstract: Given i.i.d. sample from a stratified mixture of immersed manifolds of different dimensions, we study the minimax estimation of the underlying stratified structure. We provide a constructive algorithm allowing to estimate each mixture component at its optimal dimension-specific rate adaptively. The method is based on an ascending hierarchical co-detection of points belonging to different layers, which also identifies the number of layers and their dimensions, assigns each data point to a layer accurately, and estimates tangent spaces optimally. These results hold regardless of any ambient assumption on the manifolds or on their intersection configurations. They open the way to a broad clustering framework, where each mixture component models a cluster emanating from a specific nonlinear correlation phenomenon.


title: N-Dimensional Gaussians for Fitting of High Dimensional Functions

abstract: In the wake of many new ML-inspired approaches for reconstructing and representing high-quality 3D content, recent hybrid and explicitly learned representations exhibit promising performance and quality characteristics. However, their scaling to higher dimensions is challenging, e.g. when accounting for dynamic content with respect to additional parameters such as material properties, illumination, or time. In this paper, we tackle these challenges for an explicit representations based on Gaussian mixture models. With our solutions, we arrive at efficient fitting of compact N-dimensional Gaussian mixtures and enable efficient evaluation at render time: For fast fitting and evaluation, we introduce a high-dimensional culling scheme that efficiently bounds N-D Gaussians, inspired by Locality Sensitive Hashing. For adaptive refinement yet compact representation, we introduce a loss-adaptive density control scheme that incrementally guides the use of additional capacity towards missing details. With these tools we can for the first time represent complex appearance that depends on many input dimensions beyond position or viewing angle within a compact, explicit representation optimized in minutes and rendered in milliseconds.


title: An Efficient Network with Novel Quantization Designed for Massive MIMO CSI Feedback

abstract: The efficacy of massive multiple-input multiple-output (MIMO) techniques heavily relies on the accuracy of channel state information (CSI) in frequency division duplexing (FDD) systems. Many works focus on CSI compression and quantization methods to enhance CSI reconstruction accuracy with lower feedback overhead. In this letter, we propose CsiConformer, a novel CSI feedback network that combines convolutional operations and self-attention mechanisms to improve CSI feedback accuracy. Additionally, a new quantization module is developed to improve encoding efficiency. Experiment results show that CsiConformer outperforms previous state-of-the-art networks, achieving an average accuracy improvement of 17.67\% with lower computational overhead.


title: Stacking-engineered ferroelectricity and multiferroic order in van der Waals magnets

abstract: Two-dimensional (2D) materials that exhibit spontaneous magnetization, polarization or strain (referred to as ferroics) have the potential to revolutionize nanotechnology by enhancing the multifunctionality of nanoscale devices. However, multiferroic order is difficult to achieve, requiring complicated coupling between electron and spin degrees of freedom. We propose a universal method to engineer multiferroics from van der Waals magnets by taking advantage of the fact that changing the stacking between 2D layers can break inversion symmetry, resulting in ferroelectricity and possibly magnetoelectric coupling. We illustrate this concept using first-principles calculations in bilayer NiI$_2$, which can be made ferroelectric upon rotating two adjacent layers by $180^{\circ}$ with respect to the bulk stacking. Furthermore, we discover a novel multiferroic order induced by interlayer charge transfer which couples the interlayer spin order and electronic polarization. Our approach is not only general but also systematic, and can enable the discovery of a wide variety of 2D multiferroics.


title: Pick-up and assembling of chemically sensitive van der Waals heterostructures using dry cryogenic exfoliation

abstract: Assembling atomic layers of van der Waals materials (vdW) combines the physics of two materials, offering opportunities for novel functional devices. Realization of this has been possible because of advancements in nanofabrication processes which often involve chemical processing of the materials under study; this can be detrimental to device performance. To address this issue, we have developed a modified micro-manipulator setup for cryogenic exfoliation, pick up, and transfer of vdW materials to assemble heterostructures. We use the glass transition of a polymer PDMS to cleave a flake into two, followed by its pick-up and drop to form pristine twisted junctions. To demonstrate the potential of the technique, we fabricated twisted heterostructure of Bi$_2$Sr$_2$CaCu$_2$O$_{8+x}$ (BSCCO), a van der Waals high-temperature cuprate superconductor. We also employed this method to re-exfoliate NbSe$_2$ and make twisted heterostructure. Transport measurements of the fabricated devices indicate the high quality of the artificial twisted interface. In addition, we extend this cryogenic exfoliation method for other vdW materials, offering an effective way of assembling heterostructures and twisted junctions with pristine interfaces.


title: A Staged Approach using Machine Learning and Uncertainty Quantification to Predict the Risk of Hip Fracture

abstract: Despite advancements in medical care, hip fractures impose a significant burden on individuals and healthcare systems. This paper focuses on the prediction of hip fracture risk in older and middle-aged adults, where falls and compromised bone quality are predominant factors. We propose a novel staged model that combines advanced imaging and clinical data to improve predictive performance. By using CNNs to extract features from hip DXA images, along with clinical variables, shape measurements, and texture features, our method provides a comprehensive framework for assessing fracture risk. A staged machine learning-based model was developed using two ensemble models: Ensemble 1 (clinical variables only) and Ensemble 2 (clinical variables and DXA imaging features). This staged approach used uncertainty quantification from Ensemble 1 to decide if DXA features are necessary for further prediction. Ensemble 2 exhibited the highest performance, achieving an AUC of 0.9541, an accuracy of 0.9195, a sensitivity of 0.8078, and a specificity of 0.9427. The staged model also performed well, with an AUC of 0.8486, an accuracy of 0.8611, a sensitivity of 0.5578, and a specificity of 0.9249, outperforming Ensemble 1, which had an AUC of 0.5549, an accuracy of 0.7239, a sensitivity of 0.1956, and a specificity of 0.8343. Furthermore, the staged model suggested that 54.49% of patients did not require DXA scanning. It effectively balanced accuracy and specificity, offering a robust solution when DXA data acquisition is not always feasible. Statistical tests confirmed significant differences between the models, highlighting the advantages of the advanced modeling strategies. Our staged approach could identify individuals at risk with a high accuracy but reduce the unnecessary DXA scanning. It has great promise to guide interventions to prevent hip fractures with reduced cost and radiation.


title: Faces of the Mind: Unveiling Mental Health States Through Facial Expressions in 11,427 Adolescents

abstract: Mood disorders, including depression and anxiety, often manifest through facial expressions. While previous research has explored the connection between facial features and emotions, machine learning algorithms for estimating mood disorder severity have been hindered by small datasets and limited real-world application. To address this gap, we analyzed facial videos of 11,427 participants, a dataset two orders of magnitude larger than previous studies. This comprehensive collection includes standardized facial expression videos from reading tasks, along with a detailed psychological scale that measures depression, anxiety, and stress. By examining the relationships among these emotional states and employing clustering analysis, we identified distinct subgroups embodying different emotional profiles. We then trained tree-based classifiers and deep learning models to estimate emotional states from facial features. Results indicate that models previously effective on small datasets experienced decreased performance when applied to our large dataset, highlighting the importance of data scale and mitigating overfitting in practical settings. Notably, our study identified subtle shifts in pupil dynamics and gaze orientation as potential markers of mood disorders, providing valuable information on the interaction between facial expressions and mental health. This research marks the first large-scale and comprehensive investigation of facial expressions in the context of mental health, laying the groundwork for future data-driven advancements in this field.


title: Power Allocation for Cell-Free Massive MIMO ISAC Systems with OTFS Signal

abstract: Applying integrated sensing and communication (ISAC) to a cell-free massive multiple-input multiple-output (CF mMIMO) architecture has attracted increasing attention. This approach equips CF mMIMO networks with sensing capabilities and resolves the problem of unreliable service at cell edges in conventional cellular networks. However, existing studies on CF-ISAC systems have focused on the application of traditional integrated signals. To address this limitation, this study explores the employment of the orthogonal time frequency space (OTFS) signal as a representative of innovative signals in the CF-ISAC system, and the system's overall performance is optimized and evaluated. A universal downlink spectral efficiency (SE) expression is derived regarding multi-antenna access points (APs) and optional sensing beams. To streamline the analysis and optimization of the CF-ISAC system with the OTFS signal, we introduce a lower bound on the achievable SE that is applicable to OTFS-signal-based systems. Based on this, a power allocation algorithm is proposed to maximize the minimum communication signal-to-interference-plus-noise ratio (SINR) of users while guaranteeing a specified sensing SINR value and meeting the per-AP power constraints. The results demonstrate the tightness of the proposed lower bound and the efficiency of the proposed algorithm. Finally, the superiority of using the OTFS signals is verified by a 13-fold expansion of the SE performance gap over the application of orthogonal frequency division multiplexing signals. These findings could guide the future deployment of the CF-ISAC systems, particularly in the field of millimeter waves with a large bandwidth.


title: Control in the Coefficients of an Obstacle Problem

abstract: In this work, we consider optimality conditions of an optimal control problem governed by an obstacle problem. Here, we focus on introducing a, matrix valued, control variable as the coefficients of the obstacle problem. As it is well known, obstacle problems can be formulated as a complementarity system and consequently the associated solution operator is not Gateaux differentiable. As a consequence, we utilize a regularization approach to obtain optimality conditions as the limit of optimality conditions of a family of regularized problems. Due to the coupling of the controlled coefficient with the gradients of the solution to the obstacle problem, weak convergence arguments can not be applied and we need to argue by $H$-convergence. We show, that, based on initial $H$-convergence, a bootstrapping argument can be utilized to prove strong $L^p$-convergence of the control and thus enable the passage to the limit in the optimality conditions.


title: On Low-Rank Multiplicity-Free Fusion Categories

abstract: This thesis explains the methods and algorithms we used to obtain explicit F symbols, R symbols, and pivotal coefficients of all multiplicity-free pivotal fusion categories up to rank 7. The thesis starts by introducing the concept of a unitary modular fusion system via two applications: modeling anyons for topological quantum computation and calculating braid group representations. Next, the notions of a pivotal, spherical, braided, ribbon, and modular fusion system are introduced. Unitarity and its implications on the pivotal structure are discussed as well. The next part of the thesis is devoted to algorithms for finding fusion systems and compatible structures. First, an algorithm to find low-rank fusion rings is explained, and its results are given. Special attention is given to the structure of non-commutative fusion rings and the construction of songs, which are generalizations of the Tambara-Yamagami and Haagerup Izumi fusion rings, is given. Then, the algorithms used to find fusion systems are discussed. Particular attention is given to how the individual steps for solving the consistency equations are done with Anyonica, a software package we developed for working with fusion systems. Gauge and automorphism equivalence are reviewed, and algorithms that put solutions in a unitary gauge and remove redundant solutions are given. Some results on the categorification of all multiplicity-free pivotal fusion rings up to rank 7 are presented. The final part of the thesis is devoted to building models of anyons on graphs and how their behavior differs from those in the plane. The appendices contain a minimal mathematical exposition on fusion categories with their relation to fusion systems, a list of all multiplicity-free fusion rings up to rank 9 with information on categorifiability, a list of all multiplicity-free fusion categories up to rank 7, and data on some graph-braid models.


title: Detection of extragalactic magnetic massive stars

abstract: Studies of the magnetic characteristics of massive stars have recently received significant attention because they are progenitors of highly magnetised compact objects. Stars initially more massive than about 8M_sun leave behind neutron stars and black holes by the end of their evolution. The merging of binary compact remnant systems produces astrophysical transients detectable by gravitational wave observatories. Studies of magnetic fields in massive stars with low metallicities are of particular interest because they provide important information on the role of magnetic fields in the star formation of the early Universe. While several detections of massive Galactic magnetic stars have been reported in the last few decades, the impact of a low-metallicity environment on the occurrence and strength of stellar magnetic fields has not yet been explored. Because of the similarity between Of?p stars in the Magellanic Clouds (MCs) and Galactic magnetic Of?p stars, which possess globally organised magnetic fields, we searched for magnetic fields in Of?p stars in the MCs. Additionally, we observed the massive contact binary Cl* NGC 346 SSN7 in the Small Magellanic Cloud to test the theoretical scenario that the origin of magnetic fields involves a merger event or a common envelope evolution. We obtained and analysed measurements of the magnetic field in four massive Of?p stars in the MCs and the binary Cl* NGC 346 SSN7 using the ESO/VLT FORS2 spectrograph in spectropolarimetric mode. We detected kilogauss-scale magnetic fields in two Of?p-type stars and in the contact binary Cl* NGC 346 SSN7. These results suggest that the impact of low metallicity on the occurrence and strength of magnetic fields in massive stars is low. However, because the explored stellar sample is very small, additional observations of massive stars in the MCs are necessary.


title: HIP 41378 observed by CHEOPS: Where is planet d?

abstract: HIP 41378 d is a long-period planet that has only been observed to transit twice, three years apart, with K2. According to stability considerations and a partial detection of the Rossiter-McLaughlin effect, $P_\mathrm{d} = 278.36$ d has been determined to be the most likely orbital period. We targeted HIP 41378 d with CHEOPS at the predicted transit timing based on $P_\mathrm{d}= 278.36$ d, but the observations show no transit. We find that large ($>22.4$ hours) transit timing variations (TTVs) could explain this non-detection during the CHEOPS observation window. We also investigated the possibility of an incorrect orbital solution, which would have major implications for our knowledge of this system. If $P_\mathrm{d} \neq 278.36$ d, the periods that minimize the eccentricity would be $101.22$ d and $371.14$ d. The shortest orbital period will be tested by TESS, which will observe HIP 41378 in Sector 88 starting in January 2025. Our study shows the importance of a mission like CHEOPS, which today is the only mission able to make long observations (i.e., from space) to track the ephemeris of long-period planets possibly affected by large TTVs.


title: NeRF View Synthesis: Subjective Quality Assessment and Objective Metrics Evaluation

abstract: Neural radiance fields (NeRF) are a groundbreaking computer vision technology that enables the generation of high-quality, immersive visual content from multiple viewpoints. This capability holds significant advantages for applications such as virtual/augmented reality, 3D modelling and content creation for the film and entertainment industry. However, the evaluation of NeRF methods poses several challenges, including a lack of comprehensive datasets, reliable assessment methodologies, and objective quality metrics. This paper addresses the problem of NeRF quality assessment thoroughly, by conducting a rigorous subjective quality assessment test that considers several scene classes and recently proposed NeRF view synthesis methods. Additionally, the performance of a wide range of state-of-the-art conventional and learning-based full-reference 2D image and video quality assessment metrics is evaluated against the subjective scores of the subjective study. The experimental results are analyzed in depth, providing a comparative evaluation of several NeRF methods and objective quality metrics, across different classes of visual scenes, including real and synthetic content for front-face and 360-degree camera trajectories.


title: Student Answer Forecasting: Transformer-Driven Answer Choice Prediction for Language Learning

abstract: Intelligent Tutoring Systems (ITS) enhance personalized learning by predicting student answers to provide immediate and customized instruction. However, recent research has primarily focused on the correctness of the answer rather than the student's performance on specific answer choices, limiting insights into students' thought processes and potential misconceptions. To address this gap, we present MCQStudentBert, an answer forecasting model that leverages the capabilities of Large Language Models (LLMs) to integrate contextual understanding of students' answering history along with the text of the questions and answers. By predicting the specific answer choices students are likely to make, practitioners can easily extend the model to new answer choices or remove answer choices for the same multiple-choice question (MCQ) without retraining the model. In particular, we compare MLP, LSTM, BERT, and Mistral 7B architectures to generate embeddings from students' past interactions, which are then incorporated into a finetuned BERT's answer-forecasting mechanism. We apply our pipeline to a dataset of language learning MCQ, gathered from an ITS with over 10,000 students to explore the predictive accuracy of MCQStudentBert, which incorporates student interaction patterns, in comparison to correct answer prediction and traditional mastery-learning feature-based approaches. This work opens the door to more personalized content, modularization, and granular support.


title: Higher-order incompatibility improves distinguishability of causal quantum networks

abstract: We show that incompatible ``higher-order quantum theoretic testing procedures", known as quantum testers, perform better in distinguishing causal quantum networks than its compatible counterparts. To demonstrate our finding, we consider a specific two-party quantum comb discrimination (QCD) game based on the task in which a receiver gets a black-box that implements a quantum comb and they attempt to determine which comb it implements based on prior information. We show that the receiver does better at winning the game when they have exclusive access to incompatible testers over compatible ones. Our investigation generalises the earlier finding that the incompatibility of POVMs is a {\em bona fide} resource in quantum state distinguishability. We also show that any quantum resource in testers is useful in comb exclusion tasks using the resource measure, {\em convex weight}.


title: NoiseBoost: Alleviating Hallucination with Noise Perturbation for Multimodal Large Language Models

abstract: Multimodal large language models (MLLMs) contribute a powerful mechanism to understanding visual information building on large language models. However, MLLMs are notorious for suffering from hallucinations, especially when generating lengthy, detailed descriptions for images. Our analysis reveals that hallucinations stem from the inherent summarization mechanism of large language models, leading to excessive dependence on linguistic tokens while neglecting vision information. In this paper, we propose NoiseBoost, a broadly applicable and simple method for alleviating hallucinations for MLLMs through the integration of noise feature perturbations. Noise perturbation acts as a regularizer, facilitating a balanced distribution of attention weights among visual and linguistic tokens. Despite its simplicity, NoiseBoost consistently enhances the performance of MLLMs across common training strategies, including supervised fine-tuning and reinforcement learning. Further, NoiseBoost pioneerly enables semi-supervised learning for MLLMs, unleashing the power of unlabeled data. Comprehensive experiments demonstrate that NoiseBoost improves dense caption accuracy by 8.1% with human evaluation and achieves comparable results with 50% of the data by mining unlabeled data. Code and models are available at https://kaiwu5.github.io/noiseboost.


title: Segment, Shuffle, and Stitch: A Simple Mechanism for Improving Time-Series Representations

abstract: Existing approaches for learning representations of time-series keep the temporal arrangement of the time-steps intact with the presumption that the original order is the most optimal for learning. However, non-adjacent sections of real-world time-series may have strong dependencies. Accordingly we raise the question: Is there an alternative arrangement for time-series which could enable more effective representation learning? To address this, we propose a simple plug-and-play mechanism called Segment, Shuffle, and Stitch (S3) designed to improve time-series representation learning of existing models. S3 works by creating non-overlapping segments from the original sequence and shuffling them in a learned manner that is the most optimal for the task at hand. It then re-attaches the shuffled segments back together and performs a learned weighted sum with the original input to capture both the newly shuffled sequence along with the original sequence. S3 is modular and can be stacked to create various degrees of granularity, and can be added to many forms of neural architectures including CNNs or Transformers with negligible computation overhead. Through extensive experiments on several datasets and state-of-the-art baselines, we show that incorporating S3 results in significant improvements for the tasks of time-series classification and forecasting, improving performance on certain datasets by up to 68\%. We also show that S3 makes the learning more stable with a smoother training loss curve and loss landscape compared to the original baseline. The code is available at https://github.com/shivam-grover/S3-TimeSeries .