title: GustosonicSense: Towards understanding the design of playful gustosonic eating experiences

abstract: The pleasure that often comes with eating can be further enhanced with intelligent technology, as the field of human-food interaction suggests. However, knowledge on how to design such pleasure-supporting eating systems is limited. To begin filling this knowledge gap, we designed "GustosonicSense", a novel gustosonic eating system that utilizes wireless earbuds for sensing different eating and drinking actions with a machine learning algorithm and trigger playful sounds as a way to facilitate pleasurable eating experiences. We present the findings from our design and a study that revealed how we can support the "stimulation", "hedonism", and "reflexivity" for playful human-food interactions. Ultimately, with our work, we aim to support interaction designers in facilitating playful experiences with food.


title: An ab-initio theory of inelastic electron tunneling spectrum of vibrating magnetic molecules adsorbed on superconductors

abstract: We present an efficient method of calculating the vibrational spectrum of a magnetic molecule adsorbed on a superconductor, directly related to the first derivative of the tunneling $IV$ curve. The work is motivated by a recent scanning-tunneling spectroscopy of lead phthalocyanine on superconducting Pb(100), showing a wealth of vibrational excitations, the number of which highly exceeds molecular vibrations typically encountered on normal metals. We design a minimal model which represents the inelastic transitions by the spectral function of a frontier orbital of the molecule in isolation. The model allows for an exact solution; otherwise the full correlated superconducting problem would be hard to treat. The model parameters are supplied from an ab-initio calculation, where the presence of the surface on the deformation of molecular geometry can be taken into account. The spectral function of the highest-occupied molecular orbital of the anionic PbPc$^{1-}$ shows the best agreement with the experimental reference among other molecular charge states and orbitals. The method allows to include multiple vibrational transitions straightforwardly.


title: Just Say the Name: Online Continual Learning with Category Names Only via Data Generation

abstract: In real-world scenarios, extensive manual annotation for continual learning is impractical due to prohibitive costs. Although prior arts, influenced by large-scale webly supervised training, suggest leveraging web-scraped data in continual learning, this poses challenges such as data imbalance, usage restrictions, and privacy concerns. Addressing the risks of continual webly supervised training, we present an online continual learning framework - Generative Name only Continual Learning (G-NoCL). The proposed G-NoCL uses a set of generators G along with the learner. When encountering new concepts (i.e., classes), G-NoCL employs the novel sample complexity-guided data ensembling technique DIverSity and COmplexity enhancing ensemBlER (DISCOBER) to optimally sample training data from generated data. Through extensive experimentation, we demonstrate superior performance of DISCOBER in G-NoCL online CL benchmarks, covering both In-Distribution (ID) and Out-of-Distribution (OOD) generalization evaluations, compared to naive generator-ensembling, web-supervised, and manually annotated data.


title: A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment

abstract: While Multimodal Large Language Models (MLLMs) have experienced significant advancement on visual understanding and reasoning, their potentials to serve as powerful, flexible, interpretable, and text-driven models for Image Quality Assessment (IQA) remains largely unexplored. In this paper, we conduct a comprehensive and systematic study of prompting MLLMs for IQA. Specifically, we first investigate nine prompting systems for MLLMs as the combinations of three standardized testing procedures in psychophysics (i.e., the single-stimulus, double-stimulus, and multiple-stimulus methods) and three popular prompting strategies in natural language processing (i.e., the standard, in-context, and chain-of-thought prompting). We then present a difficult sample selection procedure, taking into account sample diversity and uncertainty, to further challenge MLLMs equipped with the respective optimal prompting systems. We assess three open-source and one close-source MLLMs on several visual attributes of image quality (e.g., structural and textural distortions, color differences, and geometric transformations) in both full-reference and no-reference scenarios. Experimental results show that only the close-source GPT-4V provides a reasonable account for human perception of image quality, but is weak at discriminating fine-grained quality variations (e.g., color differences) and at comparing visual quality of multiple images, tasks humans can perform effortlessly.


title: Reinforcement Learning with Options and State Representation

abstract: The current thesis aims to explore the reinforcement learning field and build on existing methods to produce improved ones to tackle the problem of learning in high-dimensional and complex environments. It addresses such goals by decomposing learning tasks in a hierarchical fashion known as Hierarchical Reinforcement Learning. We start in the first chapter by getting familiar with the Markov Decision Process framework and presenting some of its recent techniques that the following chapters use. We then proceed to build our Hierarchical Policy learning as an answer to the limitations of a single primitive policy. The hierarchy is composed of a manager agent at the top and employee agents at the lower level. In the last chapter, which is the core of this thesis, we attempt to learn lower-level elements of the hierarchy independently of the manager level in what is known as the "Eigenoption". Based on the graph structure of the environment, Eigenoptions allow us to build agents that are aware of the geometric and dynamic properties of the environment. Their decision-making has a special property: it is invariant to symmetric transformations of the environment, allowing as a consequence to greatly reduce the complexity of the learning task.


title: Zero-shot Generative Linguistic Steganography

abstract: Generative linguistic steganography attempts to hide secret messages into covertext. Previous studies have generally focused on the statistical differences between the covertext and stegotext, however, ill-formed stegotext can readily be identified by humans. In this paper, we propose a novel zero-shot approach based on in-context learning for linguistic steganography to achieve better perceptual and statistical imperceptibility. We also design several new metrics and reproducible language evaluations to measure the imperceptibility of the stegotext. Our experimental results indicate that our method produces $1.926\times$ more innocent and intelligible stegotext than any other method.


title: Multiple Outflows around a Single Protostar IRAS 15398$-$3359

abstract: We present the results of our mosaic observations of a single Class 0 protostar IRAS 15398$-$3359 with Atacama Compact Array (ACA) in the CO $J=2\mbox{-}1$ line. The new observations covering a $\sim\!2'$ square region revealed elongated redshifted and blueshifted components, which are located at distances of $\sim\!30''\mbox{-}75''$ on the northern and southern sides of the protostar, respectively, in addition to the previously observed primary and secondary outflows. These elongated components exhibit Hubble-law like velocity structures, i.e., an increase of velocity with increasing distance from the protostar, suggesting that it is the third outflow associated with the protostar. Besides, a new redshifted component is detected at radii of $\sim\!40''\mbox{-}75''$ on the northwestern side of the protostar. This redshifted component also exhibits a Hubble-law like velocity profile, which could be the counterpart of the secondary outflow mostly detected at blueshifted velocities in a previous study. The three outflows are all misaligned by $\sim\!20\mbox{-}90^\circ$, and the dynamical timescale of the primary outflow is shorter than those of the other outflows approximately by an order of magnitude. These facts hint that the outflow launch direction has significantly changed with time. The outflow direction may change if the rotational axis and the magnetic field are misaligned, or if the dense core is turbulent. We favor the second scenario as the origin of the multiple outflows in IRAS 15398$-$3359 based on a comparison between the observational results and numerical simulations.


title: RetMIL: Retentive Multiple Instance Learning for Histopathological Whole Slide Image Classification

abstract: Histopathological whole slide image (WSI) analysis with deep learning has become a research focus in computational pathology. The current paradigm is mainly based on multiple instance learning (MIL), in which approaches with Transformer as the backbone are well discussed. These methods convert WSI tasks into sequence tasks by representing patches as tokens in the WSI sequence. However, the feature complexity brought by high heterogeneity and the ultra-long sequences brought by gigapixel size makes Transformer-based MIL suffer from the challenges of high memory consumption, slow inference speed, and lack of performance. To this end, we propose a retentive MIL method called RetMIL, which processes WSI sequences through hierarchical feature propagation structure. At the local level, the WSI sequence is divided into multiple subsequences. Tokens of each subsequence are updated through a parallel linear retention mechanism and aggregated utilizing an attention layer. At the global level, subsequences are fused into a global sequence, then updated through a serial retention mechanism, and finally the slide-level representation is obtained through a global attention pooling. We conduct experiments on two public CAMELYON and BRACS datasets and an public-internal LUNG dataset, confirming that RetMIL not only achieves state-of-the-art performance but also significantly reduces computational overhead. Our code will be accessed shortly.


title: Neural-Kernel Conditional Mean Embeddings

abstract: Kernel conditional mean embeddings (CMEs) offer a powerful framework for representing conditional distribution, but they often face scalability and expressiveness challenges. In this work, we propose a new method that effectively combines the strengths of deep learning with CMEs in order to address these challenges. Specifically, our approach leverages the end-to-end neural network (NN) optimization framework using a kernel-based objective. This design circumvents the computationally expensive Gram matrix inversion required by current CME methods. To further enhance performance, we provide efficient strategies to optimize the remaining kernel hyperparameters. In conditional density estimation tasks, our NN-CME hybrid achieves competitive performance and often surpasses existing deep learning-based methods. Lastly, we showcase its remarkable versatility by seamlessly integrating it into reinforcement learning (RL) contexts. Building on Q-learning, our approach naturally leads to a new variant of distributional RL methods, which demonstrates consistent effectiveness across different environments.


title: Efficient Domain Adaptation for Endoscopic Visual Odometry

abstract: Visual odometry plays a crucial role in endoscopic imaging, yet the scarcity of realistic images with ground truth poses poses a significant challenge. Therefore, domain adaptation offers a promising approach to bridge the pre-operative planning domain with the intra-operative real domain for learning odometry information. However, existing methodologies suffer from inefficiencies in the training time. In this work, an efficient neural style transfer framework for endoscopic visual odometry is proposed, which compresses the time from pre-operative planning to testing phase to less than five minutes. For efficient traing, this work focuses on training modules with only a limited number of real images and we exploit pre-operative prior information to dramatically reduce training duration. Moreover, during the testing phase, we propose a novel Test Time Adaptation (TTA) method to mitigate the gap in lighting conditions between training and testing datasets. Experimental evaluations conducted on two public endoscope datasets showcase that our method achieves state-of-the-art accuracy in visual odometry tasks while boasting the fastest training speeds. These results demonstrate significant promise for intra-operative surgery applications.


title: FedQNN: Federated Learning using Quantum Neural Networks

abstract: In this study, we explore the innovative domain of Quantum Federated Learning (QFL) as a framework for training Quantum Machine Learning (QML) models via distributed networks. Conventional machine learning models frequently grapple with issues about data privacy and the exposure of sensitive information. Our proposed Federated Quantum Neural Network (FedQNN) framework emerges as a cutting-edge solution, integrating the singular characteristics of QML with the principles of classical federated learning. This work thoroughly investigates QFL, underscoring its capability to secure data handling in a distributed environment and facilitate cooperative learning without direct data sharing. Our research corroborates the concept through experiments across varied datasets, including genomics and healthcare, thereby validating the versatility and efficacy of our FedQNN framework. The results consistently exceed 86% accuracy across three distinct datasets, proving its suitability for conducting various QML tasks. Our research not only identifies the limitations of classical paradigms but also presents a novel framework to propel the field of QML into a new era of secure and collaborative innovation.


title: Expansion of strongly interacting dipolar bosons in 1D optical lattices

abstract: We numerically study the expansion dynamics of initially localized dipolar bosons in a homogeneous 1D optical lattice for different initial states. Comparison is made to interacting bosons with contact interaction. For shallow lattices the expansion is unimodal and ballistic, while strong lattices suppress tunneling. However for intermediate lattice depths a strong interplay between dipolar interaction and lattice depth occurs. The expansion is found to be bimodal, the central cloud expansion can be distinguished from the outer halo structure. In the regime of strongly interactions dipolar bosons exhibit two time scales, with an initial diffusion and then arrested transport in the long time; while strongly interacting bosons in the fermionized limit exhibit ballistic expansion. Our study highlights how different lattice depths and initial states can be manipulated to control tunneling dynamics.


title: stMCDI: Masked Conditional Diffusion Model with Graph Neural Network for Spatial Transcriptomics Data Imputation

abstract: Spatially resolved transcriptomics represents a significant advancement in single-cell analysis by offering both gene expression data and their corresponding physical locations. However, this high degree of spatial resolution entails a drawback, as the resulting spatial transcriptomic data at the cellular level is notably plagued by a high incidence of missing values. Furthermore, most existing imputation methods either overlook the spatial information between spots or compromise the overall gene expression data distribution. To address these challenges, our primary focus is on effectively utilizing the spatial location information within spatial transcriptomic data to impute missing values, while preserving the overall data distribution. We introduce \textbf{stMCDI}, a novel conditional diffusion model for spatial transcriptomics data imputation, which employs a denoising network trained using randomly masked data portions as guidance, with the unmasked data serving as conditions. Additionally, it utilizes a GNN encoder to integrate the spatial position information, thereby enhancing model performance. The results obtained from spatial transcriptomics datasets elucidate the performance of our methods relative to existing approaches.


title: Multi-controlled Phase Gate Synthesis with ZX-calculus applied to Neutral Atom Hardware

abstract: Quantum circuit synthesis describes the process of converting arbitrary unitary operations into a gate sequence of a fixed universal gate set, usually defined by the operations native to a given hardware platform. Most current synthesis algorithms are designed to synthesize towards a set of single qubit rotations and an additional entangling two qubit gate, such as CX, CZ, or the Molmer Sorensen gate. However, with the emergence of neutral atom based hardware and their native support for gates with more than two qubits, synthesis approaches tailored to these new gate sets become necessary. In this work, we present an approach to synthesize multi controlled phase gates using ZX calculus. By representing quantum circuits as graph like ZX diagrams, one can utilize the distinct graph structure of diagonal gates to identify multi controlled phase gates inherently present in some quantum circuits even if none were explicitly defined in the original circuit. We evaluate the approach on a wide range of benchmark circuits and compare them to the standard Qiskit synthesis regarding its circuit execution time for neutral atom based hardware with native support of multi controlled gates. Our results show possible advantages for current state of the art hardware and represent the first exact synthesis algorithm supporting arbitrary sized multi controlled phase gates.


title: $H_0$-tension in the classical limit of Big Bang quantum cosmology

abstract: $\Lambda$CDM is challenged by observational tensions between late- and early-time cosmology, most dramatically in the Hubble constant $H_0$. $\Lambda$CDM hereby falls short as an effective infra-red (IR) limit of quantum cosmology. Consistency with general relativity in an effective dark energy $\Lambda=\alpha_p\Lambda_0\sim H^2/c^2$ obtains from an IR-coupling $\alpha_p\sim \hbar$ to the bare cosmological constant $\Lambda_0\sim 1/\hbar$, where $\hbar$ is the Planck constant. A path integral formulation with gauged total phase identifies $\Lambda$ with the trace of the Schouten tensor $J$. It predicts the scaling $H_0\simeq \sqrt{6/5}H_0^{\Lambda{\rm CDM}}$ inferred from the BAO, while preserving the age of the Universe. With no free parameters, this first principle model predicts a 9\% departure in $H_0$ between the Local Distance Ladder and the $\Lambda$CDM {\em Planck} measurements with no tension between late and early times. In galaxies, the same IR coupling predicts a sharp transition to anomalous rotation curves below the de Sitter acceleration $a_{dS}=cH$, where $c$ is the velocity of light. Excluded by galaxy models in $\Lambda$CDM, it points to ultra-light dark matter of mass $m_D\lesssim 3\times 10^{-21}$eV consistent with $m_D\gtrsim 10^{-22}$eV of wave-like $\psi$CDM.


title: Relatively prime pairs in the Piatetski-Shapiro sequences

abstract: In this paper, we prove an asymptotic formula for the number of relatively prime pairs in the Piatetski-Shapiro sequence of arbitrarily large order. This improves the result of Pimsert, Srichan and Tangsupphathawat (2023), the order of which was restricted to be $<\frac{3}{2}$. The key ingredients of the proof are a simple averaging trick and an extension of Deshouillers' result on the distribution of the Piatetski-Shapiro sequence in arithmetic progressions.


title: Giant exchange splitting in the electronic structure of A-type 2D antiferromagnet CrSBr

abstract: In the field of 2D magnetic semiconductors, CrSBr has been the focus of research due to its intriguing magnetic, transport and optical properties that have potential to underpin novel devices. Here we present the evolution of the electronic structure of CrSBr from its antiferromagnetic ground state to the paramagnetic phase. The ground state photoemission data, obtained using a novel method to overcome sample charging issues, is very well reproduced by $\mathbf{QSG\hat{W}}$ calculations, a self-consistent many-body perturbative approach that computes electronic eigenfunctions in presence of excitonic correlations. The electronic structure is complex at $\mathbf{\Gamma}$, but simplifies at the X points of the Brillouin zone where the non-symmorphic lattice symmetry enforces band degeneracies. In the vicinity of these X points, in the deeper-lying valence bands one can identify pairs of states with mainly Br- and S- character. The energy splitting between them is understood as an exchange splitting within the individual layers in which the spins all align, despite the absence of a net magnetic moment in the so-called A-type antiferromagnetic arrangement. By tracing band positions as a function of temperature, we identify that this exchange splitting disappears above $T_N$, alongside a significant increase in the spectral broadening in all states.


title: Approximation Ratio of the Min-Degree Greedy Algorithm for Maximum Independent Set on Interval and Chordal Graphs

abstract: In this article we prove that the minimum-degree greedy algorithm, with adversarial tie-breaking, is a $(2/3)$-approximation for the Maximum Independent Set problem on interval graphs. We show that this is tight, even on unit interval graphs of maximum degree 3. We show that on chordal graphs, the greedy algorithm is a $(1/2)$-approximation and that this is again tight. These results contrast with the known (tight) approximation ratio of $\frac{3}{\Delta+2}$ of the greedy algorithm for general graphs of maximum degree $\Delta$.


title: Firm-Dispatchable Power and its Requirement in a Power System based on Variable Generation

abstract: Many countries have commenced a transition from fossil fuel-based electricity generation systems to sustainable systems based on wind and solar generation. It is often noted that the least cost approach would involve a massive scale-up in the building of variable renewables, supported by battery storage and gas peaking plants. The required backup should be firm-dispatchable generation rather than peaking power. The wind and solar generation aspects for this system are clearly defined and understood, however, the term firm-dispatchable power is not defined and the specific requirements are poorly understood. This study seeks to define firm-dispatchable power in this context and its requirement in the sustainable generation system. The study compares 100% renewable generation scenarios from South Africa, Texas, and the UK to demonstrate the requirement for this firm-dispatchable generation. The results indicate that firm-dispatchable generation must be available to replace the renewable generation completely. The required installed capacity for this firm-dispatchable generation does not vary with the distinct demand profiles of the different locations or their comparative renewable generation profiles. It also does not change significantly with the use of energy storage. The usage for this firm-dispatchable generation will vary due to the comparative economics of its use, but the requirement for its installation does not change.


title: Nonadiabatic quantum Vlasov equation in spinor QED

abstract: The nonadiabatic quantum Vlasov equation in spinor QED is derived, and its relation to the well-known adiabatic one is established by three methods. One is by an explicitly analytical expression, the second is by the Dirac equation in the V gauge, and the last is by introducing a turn-off electric field. Wherein what the first two of them are given is an instantaneous relation. Moreover, the time evolution of the distribution function for a specific momentum and the momentum distribution of created particle pairs after turning off the electric field are calculated and compared with those in scalar QED. It is found that both the oscillation periods of the distribution functions in spinor and scalar QED equal pi divided by the total energy of a particle after the electric field is turned off. The momentum distributions in spinor and scalar QED show a novel oscillation and out-of-phase behavior that cannot be explained by the Stokes phenomenon. These findings will further deepen our understanding of the quantum Vlasov equation and its application in vacuum pair production.


title: Spectrum conversion and pattern preservation of Airy beams in fractional systems with a dynamical harmonic-oscillator potential

abstract: We investigate the dynamics of optical Airy beams in the one-dimensional fractional Schr\"odinger equation with a harmonic-oscillator (HO) potential subjected to modulation along the propagation distance. Deriving general solutions for propagating beams and particular solutions for Airy waves with/without chirp, we study analytically the spectrum conversion and pattern preservation for the chirp-free and chirped Airy beams in the fractional system including the HO potential with moir\'e-lattice, hyperbolic-secant, and delta-functional modulation formats. For the HO-moir\'e-lattice potential, it is found that the chirp-free Airy beam experiences multiple spectrum conversions between the Airy and Gaussian patterns in the momentum space, preserving the Airy pattern in the coordinate space. The chirp magnitude of the chirped Airy beam determines whether the spectrum conversion occurs in the momentum space, and the splitting and evolution direction of the beam in the coordinate space. For the HO-hyperbolic-secant potential, the chirp-free Airy beam undergoes spectrum conversion and tunneling, with the positions of the spectrum conversion and tunneling significantly depending on parameters of the hyperbolic-secant potential; however, the spectrum conversion and pattern preservation of the chirped Airy beam occurs only under a certain relation of the chirp and parameters of the potential. In the case of the HO-delta-functional potential, the chirp-free Airy beam experiences abrupt spectrum conversion and a two-step spectrum shift; however, for the chirped Airy beam, the spectrum conversion is affected by the relation between the chirp and height of the potential. Effects of the fractional L\'evy index on the spectrum conversion and pattern preservation of the Airy beams under the action of the three modulation patterns considered here are also explored in detail.


title: Integration of 5G and Motion Sensors for Vehicular Positioning: A Loosely-Coupled Approach

abstract: Autonomous vehicles (AVs) are poised to revolutionize the transportation industry by enhancing traffic efficiency and road safety. However, achieving optimal vehicular autonomy demands an uninterrupted and precise positioning solution, especially in deep urban environments. 5G mmWave holds immense potential to provide such a service due to its accurate range and angle measurements. Yet, as mmWave signals are prone to signal blockage, severe positioning errors will occur. Most of the 5G positioning literature relies on constant motion models to bridge such 5G outages, which do not capture the true dynamics of the vehicle. Few proposed methodologies rely on inertial measurement units (IMUs) to bridge such gaps, where they predominantly use tightly coupled (TC) integration schemes, introducing a nonlinear 5G measurement model. Such approaches, which rely on Kalman filtering, necessitate the linearization of the measurement model, leading to pronounced positioning errors. In this paper, however, we propose a loosely coupled (LC) sensor fusion scheme to integrate 5G, IMUs, and odometers to mitigate linearization errors. Additionally, we propose a novel method to design the process covariance matrix of the extended Kalman filter (EKF). Moreover, we propose enhancements to the mechanization of the IMU data to enhance the standalone IMU solution. The proposed methodologies were tested using a novel setup comprising 5G measurements from Siradel's S_5G simulation tool and real IMU and odometer measurements from an hour-long trajectory. The proposed method resulted in 14 cm of error for 95% of the time compared to 1 m provided by the traditional constant velocity model approach.


title: CSI Transfer From Sub-6G to mmWave: Reduced-Overhead Multi-User Hybrid Beamforming

abstract: Hybrid beamforming is vital in modern wireless systems, especially for massive MIMO and millimeter-wave deployments, offering efficient directional transmission with reduced hardware complexity. However, effective beamforming in multi-user scenarios relies heavily on accurate channel state information, the acquisition of which often incurs excessive pilot overhead, degrading system performance. To address this and inspired by the spatial congruence between sub-6GHz (sub-6G) and mmWave channels, we propose a Sub-6G information Aided Multi-User Hybrid Beamforming (SA-MUHBF) framework, avoiding excessive use of pilots. SA-MUHBF employs a convolutional neural network to predict mmWave beamspace from sub-6G channel estimate, followed by a novel multi-layer graph neural network for analog beam selection and a linear minimum mean-square error algorithm for digital beamforming. Numerical results demonstrate that SA-MUHBF efficiently predicts the mmWave beamspace representation and achieves superior spectrum efficiency over state-of-the-art benchmarks. Moreover, SA-MUHBF demonstrates robust performance across varied sub-6G system configurations and exhibits strong generalization to unseen scenarios.


title: Robotic Task Success Evaluation Under Multi-modal Non-Parametric Object Pose Uncertainty

abstract: Accurate 6D object pose estimation is essential for various robotic tasks. Uncertain pose estimates can lead to task failures; however, a certain degree of error in the pose estimates is often acceptable. Hence, by quantifying errors in the object pose estimate and acceptable errors for task success, robots can make informed decisions. This is a challenging problem as both the object pose uncertainty and acceptable error for the robotic task are often multi-modal and cannot be parameterized with commonly used uni-modal distributions. In this paper, we introduce a framework for evaluating robotic task success under object pose uncertainty, representing both the estimated error space of the object pose and the acceptable error space for task success using multi-modal non-parametric probability distributions. The proposed framework pre-computes the acceptable error space for task success using dynamic simulations and subsequently integrates the pre-computed acceptable error space over the estimated error space of the object pose to predict the likelihood of the task success. We evaluated the proposed framework on two mobile manipulation tasks. Our results show that by representing the estimated and the acceptable error space using multi-modal non-parametric distributions, we achieve higher task success rates and fewer failures.


title: Probabilistic World Modeling with Asymmetric Distance Measure

abstract: Representation learning is a fundamental task in machine learning, aiming at uncovering structures from data to facilitate subsequent tasks. However, what is a good representation for planning and reasoning in a stochastic world remains an open problem. In this work, we posit that learning a distance function is essential to allow planning and reasoning in the representation space. We show that a geometric abstraction of the probabilistic world dynamics can be embedded into the representation space through asymmetric contrastive learning. Unlike previous approaches that focus on learning mutual similarity or compatibility measures, we instead learn an asymmetric similarity function that reflects the state reachability and allows multi-way probabilistic inference. Moreover, by conditioning on a common reference state (e.g. the observer's current state), the learned representation space allows us to discover the geometrically salient states that only a handful of paths can lead through. These states can naturally serve as subgoals to break down long-horizon planning tasks. We evaluate our method in gridworld environments with various layouts and demonstrate its effectiveness in discovering the subgoals.


title: Kodaira vanishing theorems for Kahler Lie algebroids

abstract: A Lie algebroid is a generalization of Lie algebra that provides a general framework to describe the symmetries of a manifold. In this paper, we generalize the Kodaira vanishing theorem, which is a basic result in complex geometry, to Kahler Lie algebroids. The generalization of the Kodaira vanishing theorem states that the kernel of the Lie algebroid Laplace operator on Lie algebroid positive line bundle-valued (p,q)-forms vanishes when p+q is sufficiently large. The most difficult part of the proof of the generalized Kodaira vanishing theorem is the generalization of the Kahler identities to Lie algebroids. In this paper, we provide an approach by using local coordinate calculation.


title: Test of lepton universality and measurement of the form factors of $D^0\to K^{*}(892)^-\mu^+\nu_\mu$

abstract: We report a first study of the semileptonic decay $D^0\rightarrow K^-\pi^0\mu^{+}\nu_{\mu}$ by analyzing an $e^+e^-$ annihilation data sample of $7.9~\mathrm{fb}^{-1}$ collected at the center-of-mass energy of 3.773 GeV with the BESIII detector. The absolute branching fraction of $D^0\to K^-\pi^0\mu^{+}\nu_{\mu}$ is measured for the first time to be $(0.729 \pm 0.014_{\rm stat} \pm 0.011_{\rm syst})\%$. Based on an amplitude analysis, the $S\text{-}{\rm wave}$ contribution is determined to be $(5.76 \pm 0.35_{\rm stat} \pm 0.29_{\rm syst})\%$ of the total decay rate in addition to the dominated $K^{*}(892)^-$ component. The branching fraction of $D^0\to K^{*}(892)^-\mu^+\nu_\mu$ is given to be $(2.062 \pm 0.039_{\rm stat} \pm 0.032_{\rm syst})\%$, which improves the precision of the world average by a factor of 5. Combining with the world average of ${\mathcal B}(D^0\to K^{*}(892)^-e^+\nu_e)$, the ratio of the branching fractions obtained is $\frac{{\mathcal B}(D^0\to K^{*}(892)^-\mu^+\nu_\mu)}{{\mathcal B}(D^0\to K^{*}(892)^-e^+\nu_e)} = 0.96\pm0.08$, in agreement with lepton flavor universality. Furthermore, assuming single-pole dominance parameterization, the most precise hadronic form factor ratios for $D^0\to K^{*}(892)^{-} \mu^+\nu_\mu$ are extracted to be $r_{V}=V(0)/A_1(0)=1.37 \pm 0.09_{\rm stat} \pm 0.03_{\rm syst}$ and $r_{2}=A_2(0)/A_1(0)=0.76 \pm 0.06_{\rm stat} \pm 0.02_{\rm syst}$.


title: Cubature scheme for spatio-temporal Poisson point processes estimation

abstract: This work presents the cubature scheme for the fitting of spatio-temporal Poisson point processes. The methodology is implemented in the R Core Team (2024) package stopp (D'Angelo and Adelfio, 2023), published on the Comprehensive R Archive Network (CRAN) and available from https://CRAN.R-project.org/package=stopp. Since the number of dummy points should be sufficient for an accurate estimate of the likelihood, numerical experiments are currently under development to give guidelines on this aspect.


title: Characterizing the Solana NFT Ecosystem

abstract: Non-Fungible Tokens (NFTs) are digital assets recorded on the blockchain, providing cryptographic proof of ownership over digital or physical items. Although Solana has only begun to gain popularity in recent years, its NFT market has seen substantial transaction volumes. In this paper, we conduct the first systematic research on the characteristics of Solana NFTs from two perspectives: longitudinal measurement and wash trading security audit. We gathered 132,736 Solana NFT from Solscan and analyzed the sales data within these collections. Investigating users' economic activity and NFT owner information reveals that the top users in Solana NFT are skewed toward a higher distribution of purchases. Subsequently, we employ the Local Outlier Factor algorithm to conduct a wash trading audit on 2,175 popular Solana NFTs. We discovered that 138 NFT pools are involved in wash trading, with 8 of these NFTs having a wash trading rate exceeding 50%. Fortunately, none of these NFTs have been entirely washed out.


title: COVID-CT-H-UNet: a novel COVID-19 CT segmentation network based on attention mechanism and Bi-category Hybrid loss

abstract: Since 2019, the global COVID-19 outbreak has emerged as a crucial focus in healthcare research. Although RT-PCR stands as the primary method for COVID-19 detection, its extended detection time poses a significant challenge. Consequently, supplementing RT-PCR with the pathological study of COVID-19 through CT imaging has become imperative. The current segmentation approach based on TVLoss enhances the connectivity of afflicted areas. Nevertheless, it tends to misclassify normal pixels between certain adjacent diseased regions as diseased pixels. The typical Binary cross entropy(BCE) based U-shaped network only concentrates on the entire CT images without emphasizing on the affected regions, which results in hazy borders and low contrast in the projected output. In addition, the fraction of infected pixels in CT images is much less, which makes it a challenge for segmentation models to make accurate predictions. In this paper, we propose COVID-CT-H-UNet, a COVID-19 CT segmentation network to solve these problems. To recognize the unaffected pixels between neighbouring diseased regions, extra visual layer information is captured by combining the attention module on the skip connections with the proposed composite function Bi-category Hybrid Loss. The issue of hazy boundaries and poor contrast brought on by the BCE Loss in conventional techniques is resolved by utilizing the composite function Bi-category Hybrid Loss that concentrates on the pixels in the diseased area. The experiment shows when compared to the previous COVID-19 segmentation networks, the proposed COVID-CT-H-UNet's segmentation impact has greatly improved, and it may be used to identify and study clinical COVID-19.


title: Regularizing CNNs using Confusion Penalty Based Label Smoothing for Histopathology Images

abstract: Deep Learning, particularly Convolutional Neural Networks (CNN), has been successful in computer vision tasks and medical image analysis. However, modern CNNs can be overconfident, making them difficult to deploy in real-world scenarios. Researchers propose regularizing techniques, such as Label Smoothing (LS), which introduces soft labels for training data, making the classifier more regularized. LS captures disagreements or lack of confidence in the training phase, making the classifier more regularized. Although LS is quite simple and effective, traditional LS techniques utilize a weighted average between target distribution and a uniform distribution across the classes, which limits the objective of LS as well as the performance. This paper introduces a novel LS technique based on the confusion penalty, which treats model confusion for each class with more importance than others. We have performed extensive experiments with well-known CNN architectures with this technique on publicly available Colorectal Histology datasets and got satisfactory results. Also, we have compared our findings with the State-of-the-art and shown our method's efficacy with Reliability diagrams and t-distributed Stochastic Neighbor Embedding (t-SNE) plots of feature space.


title: Optimizing Language Augmentation for Multilingual Large Language Models: A Case Study on Korean

abstract: Large language models (LLMs) use pretraining to predict the subsequent word; however, their expansion requires significant computing resources. Numerous big tech companies and research institutes have developed multilingual LLMs (MLLMs) to meet current demands, overlooking less-resourced languages (LRLs). This study proposed three strategies to enhance the performance of LRLs based on the publicly available MLLMs. First, the MLLM vocabularies of LRLs were expanded to enhance expressiveness. Second, bilingual data were used for pretraining to align the high- and less-resourced languages. Third, a high-quality small-scale instruction dataset was constructed and instruction-tuning was performed to augment the LRL. The experiments employed the Llama2 model and Korean was used as the LRL, which was quantitatively evaluated against other developed LLMs across eight tasks. Furthermore, a qualitative assessment was performed based on human evaluation and GPT4. Experimental results showed that our proposed Bllossom model exhibited superior performance in qualitative analyses compared to previously proposed Korean monolingual models.


title: Improving Adversarial Transferability of Visual-Language Pre-training Models through Collaborative Multimodal Interaction

abstract: Despite the substantial advancements in Vision-Language Pre-training (VLP) models, their susceptibility to adversarial attacks poses a significant challenge. Existing work rarely studies the transferability of attacks on VLP models, resulting in a substantial performance gap from white-box attacks. We observe that prior work overlooks the interaction mechanisms between modalities, which plays a crucial role in understanding the intricacies of VLP models. In response, we propose a novel attack, called Collaborative Multimodal Interaction Attack (CMI-Attack), leveraging modality interaction through embedding guidance and interaction enhancement. Specifically, attacking text at the embedding level while preserving semantics, as well as utilizing interaction image gradients to enhance constraints on perturbations of texts and images. Significantly, in the image-text retrieval task on Flickr30K dataset, CMI-Attack raises the transfer success rates from ALBEF to TCL, $\text{CLIP}_{\text{ViT}}$ and $\text{CLIP}_{\text{CNN}}$ by 8.11%-16.75% over state-of-the-art methods. Moreover, CMI-Attack also demonstrates superior performance in cross-task generalization scenarios. Our work addresses the underexplored realm of transfer attacks on VLP models, shedding light on the importance of modality interaction for enhanced adversarial robustness.


title: Fuzzy Rank-based Late Fusion Technique for Cytology image Segmentation

abstract: Cytology image segmentation is quite challenging due to its complex cellular structure and multiple overlapping regions. On the other hand, for supervised machine learning techniques, we need a large amount of annotated data, which is costly. In recent years, late fusion techniques have given some promising performances in the field of image classification. In this paper, we have explored a fuzzy-based late fusion techniques for cytology image segmentation. This fusion rule integrates three traditional semantic segmentation models UNet, SegNet, and PSPNet. The technique is applied on two cytology image datasets, i.e., cervical cytology(HErlev) and breast cytology(JUCYT-v1) image datasets. We have achieved maximum MeanIoU score 84.27% and 83.79% on the HErlev dataset and JUCYT-v1 dataset after the proposed late fusion technique, respectively which are better than that of the traditional fusion rules such as average probability, geometric mean, Borda Count, etc. The codes of the proposed model are available on GitHub.


title: Could We Generate Cytology Images from Histopathology Images? An Empirical Study

abstract: Automation in medical imaging is quite challenging due to the unavailability of annotated datasets and the scarcity of domain experts. In recent years, deep learning techniques have solved some complex medical imaging tasks like disease classification, important object localization, segmentation, etc. However, most of the task requires a large amount of annotated data for their successful implementation. To mitigate the shortage of data, different generative models are proposed for data augmentation purposes which can boost the classification performances. For this, different synthetic medical image data generation models are developed to increase the dataset. Unpaired image-to-image translation models here shift the source domain to the target domain. In the breast malignancy identification domain, FNAC is one of the low-cost low-invasive modalities normally used by medical practitioners. But availability of public datasets in this domain is very poor. Whereas, for automation of cytology images, we need a large amount of annotated data. Therefore synthetic cytology images are generated by translating breast histopathology samples which are publicly available. In this study, we have explored traditional image-to-image transfer models like CycleGAN, and Neural Style Transfer. Further, it is observed that the generated cytology images are quite similar to real breast cytology samples by measuring FID and KID scores.


title: A non-surjective Wigner-type theorem in terms of equivalent pairs of subspaces

abstract: Let $H$ be an infinite-dimensional complex Hilbert space and let ${\mathcal G}_{\infty}(H)$ be the set of all closed subspaces of $H$ whose dimension and codimension both are infinite. We investigate (not necessarily surjective) transformations of ${\mathcal G}_{\infty}(H)$ sending every pair of subspaces to an equivalent pair of subspaces; two pairs of subspaces are equivalent if there is a linear isometry sending one of these pairs to the other. Let $f$ be such a transformation. We show that there is a unique up to a scalar multiple linear or conjugate linear isometry $L:H\to H$ such that for every $X\in {\mathcal G}_{\infty}(H)$ the image $f(X)$ is the sum of $L(X)$ and a certain closed subspace $O(X)$ orthogonal to the range of $L$. In the case when $H$ is separable, we give the following sufficient condition to assert that $f$ is induced by a linear or conjugate linear isometry: if $O(X)=0$ for a certain $X\in {\mathcal G}_{\infty}(H)$, then the same holds for all $X\in {\mathcal G}_{\infty}(H)$.


title: LuoJiaHOG: A Hierarchy Oriented Geo-aware Image Caption Dataset for Remote Sensing Image-Text Retrival

abstract: Image-text retrieval (ITR) plays a significant role in making informed decisions for various remote sensing (RS) applications. Nonetheless, creating ITR datasets containing vision and language modalities not only requires significant geo-spatial sampling area but also varing categories and detailed descriptions. To this end, we introduce an image caption dataset LuojiaHOG, which is geospatial-aware, label-extension-friendly and comprehensive-captioned. LuojiaHOG involves the hierarchical spatial sampling, extensible classification system to Open Geospatial Consortium (OGC) standards, and detailed caption generation. In addition, we propose a CLIP-based Image Semantic Enhancement Network (CISEN) to promote sophisticated ITR. CISEN consists of two components, namely dual-path knowledge transfer and progressive cross-modal feature fusion. Comprehensive statistics on LuojiaHOG reveal the richness in sampling diversity, labels quantity and descriptions granularity. The evaluation on LuojiaHOG is conducted across various state-of-the-art ITR models, including ALBEF, ALIGN, CLIP, FILIP, Wukong, GeoRSCLIP and CISEN. We use second- and third-level labels to evaluate these vision-language models through adapter-tuning and CISEN demonstrates superior performance. For instance, it achieves the highest scores with WMAP@5 of 88.47\% and 87.28\% on third-level ITR tasks, respectively. In particular, CISEN exhibits an improvement of approximately 1.3\% and 0.9\% in terms of WMAP@5 compared to its baseline. These findings highlight CISEN advancements accurately retrieving pertinent information across image and text. LuojiaHOG and CISEN can serve as a foundational resource for future RS image-text alignment research, facilitating a wide range of vision-language applications.


title: Resolving the W-Boson Mass in the Lepton Specific Two Higgs Doublet Model

abstract: In this study, the parameter space of the Lepton Specific Two Higgs Doublet Model (LS-2HDM) is investigated to align the W-boson mass reported by the CDF experiment with recent theoretical and experimental findings. The Lepton Specific Two Higgs Doublet Model, a distinguished category within Two Higgs Doublet Models, contains two CP-even, one CP-odd, and two charged scalar bosons, which play crucial role in estimating W boson mass. First, constraints from diverse experimental data, including ATLAS 13 TeV analyses, rare B-meson decays, and Lepton Flavor Universality in tau-lepton and Z-boson decays, are determined and imposed on the parameter space of the model. These constraints are subsequently applied to potential solutions generated through random scans using SARAH 4.13.0 and analyzed using SPheno 4.0.3. The analysis indicates the possibility of realizing the CDF-reported W-boson mass up to $1\sigma$ within the low $\tan\beta$ regime ($2.5 \lesssim \tan\beta \lesssim 8.0 $). Furthermore, it establishes mass limits for the additional scalar boson as $164 \lesssim m_{h_2} \lesssim 195 $ GeV, $330 \lesssim m_{A} \lesssim 575 $ GeV, and $345 \lesssim m_{H^\pm} \lesssim 685 $ GeV. Moreover, it is observed that instead of the masses, mass differences of the new scalars of the model are more constrained to assure the CDF reported value of the W boson. Finally, all potential solutions estimating the W-boson mass within a $1\sigma$ vicinity are rigorously tested using the HiggsTools package. Remarkably, only one solution remains valid, estimating $M_W=80.4103$ GeV within a $2.44\sigma$ vicinity of the CDF-reported value.


title: List Sample Compression and Uniform Convergence

abstract: List learning is a variant of supervised classification where the learner outputs multiple plausible labels for each instance rather than just one. We investigate classical principles related to generalization within the context of list learning. Our primary goal is to determine whether classical principles in the PAC setting retain their applicability in the domain of list PAC learning. We focus on uniform convergence (which is the basis of Empirical Risk Minimization) and on sample compression (which is a powerful manifestation of Occam's Razor). In classical PAC learning, both uniform convergence and sample compression satisfy a form of `completeness': whenever a class is learnable, it can also be learned by a learning rule that adheres to these principles. We ask whether the same completeness holds true in the list learning setting. We show that uniform convergence remains equivalent to learnability in the list PAC learning setting. In contrast, our findings reveal surprising results regarding sample compression: we prove that when the label space is $Y=\{0,1,2\}$, then there are 2-list-learnable classes that cannot be compressed. This refutes the list version of the sample compression conjecture by Littlestone and Warmuth (1986). We prove an even stronger impossibility result, showing that there are $2$-list-learnable classes that cannot be compressed even when the reconstructed function can work with lists of arbitrarily large size. We prove a similar result for (1-list) PAC learnable classes when the label space is unbounded. This generalizes a recent result by arXiv:2308.06424.


title: Elasto-visco-plastic flows in benchmark geometries: I. 4 to 1 Planar Contraction

abstract: We present predictions for the flow of elastoviscoplastic (EVP) fluids in the 4 to 1 planar contraction geometry. The Saramito-Herschel-Bulkley fluid model is solved via the finite-volume method with the OpenFOAM software. Both the constitutive model and the solution method require using transient simulations. In this benchmark geometry, whereas viscoelastic fluids may exhibit two vortices, referred to as lip and corner vortices, we find that EVP materials are unyielded in the concave corners. They are also unyielded along the mid-plane of both channels, but not around the contraction area where all stress components are larger. When the Bingham or the Weissenberg numbers are lower than critical values, and then, a steady state is reached. When these two dimensionless numbers increase while they remain below the respective critical values, which are interdependent, (a) the unyielded regions expand and shift in the flow direction, and (b) the maximum velocity increases at the entrance of the contraction. Increasing material elasticity collaborates with increasing the yield stress, which expands the unyielded areas, because it deforms the material more prior to yielding compared to stiffer materials. Above the critical Weissenberg number, transient variations appear for longer times in all variables, including the yield surface, instead of a monotonic approach to the steady state. They may lead to oscillations which are damped or of constant amplitude or approach a flow with rather smooth path lines but complex stress field without a plane of symmetry, under creeping conditions. These patterns arise near the entrance of the narrow channel, where the curvature of the path lines is highest and its coupling with the increased elasticity triggers a purely elastic instability. Similarly, a critical value of the yield stress exists above which such phenomena are predicted.


title: A simple and accurate method to determine fluid-crystal phase boundaries from direct coexistence simulations

abstract: One method for computationally determining phase boundaries is to explicitly simulate a direct coexistence between the two phases of interest. Although this approach works very well for fluid-fluid coexistences, it is often considered to be less useful for fluid-crystal transitions, as additional care must be taken to prevent the simulation boundaries from imposing unwanted strains on the crystal phase. Here, we present a simple adaptation to the direct coexistence method that nonetheless allows us to obtain highly accurate predictions of fluid-crystal coexistence conditions. We test our approach on hard spheres, the screened Coulomb potential, and a 2D patchy-particle model. In all cases, we find excellent agreement between the direct coexistence approach and (much more cumbersome) free-energy calculation methods. Moreover, the method is sufficiently accurate to resolve the (tiny) free-energy difference between the face-centered cubic and hexagonally close-packed crystal of hard spheres in the thermodynamic limit. The simplicity of this method also ensures that it can be trivially implemented in essentially any simulation method or package. Hence, this approach provides an excellent alternative to free-energy based methods for the precise determination of phase boundaries.


title: Mathematical study of a new coupled electro-thermo radiofrequency model of cardiac tissue

abstract: This paper presents a nonlinear reaction-diffusion-fluid system that simulates radiofrequency ablation within cardiac tissue. The model conveys the dynamic evolution of temperature and electric potential in both the fluid and solid regions, along with the evolution of velocity within the solid region. By formulating the system that describes the phenomena across the entire domain, encompassing both solid and fluid phases, we proceed to an analysis of well-posedness, considering a broad class of right-hand side terms. The system involves parameters such as heat conductivity, kinematic viscosity, and electrical conductivity, all of which exhibit nonlinearity contingent upon the temperature variable. The mathematical analysis extends to establishing the existence of a global solution, employing the Faedo-Galerkin method in a three-dimensional space. To enhance the practical applicability of our theoretical results, we complement our study with a series of numerical experiments. We implement the discrete system using the finite element method for spatial discretization and an Euler scheme for temporal discretization. Nonlinear parameters are linearized through decoupling systems, as introduced in our continuous analysis. These experiments are conducted to demonstrate and validate the theoretical findings we have established.


title: A Watermark-Conditioned Diffusion Model for IP Protection

abstract: The ethical need to protect AI-generated content has been a significant concern in recent years. While existing watermarking strategies have demonstrated success in detecting synthetic content (detection), there has been limited exploration in identifying the users responsible for generating these outputs from a single model (owner identification). In this paper, we focus on both practical scenarios and propose a unified watermarking framework for content copyright protection within the context of diffusion models. Specifically, we consider two parties: the model provider, who grants public access to a diffusion model via an API, and the users, who can solely query the model API and generate images in a black-box manner. Our task is to embed hidden information into the generated contents, which facilitates further detection and owner identification. To tackle this challenge, we propose a Watermark-conditioned Diffusion model called WaDiff, which manipulates the watermark as a conditioned input and incorporates fingerprinting into the generation process. All the generative outputs from our WaDiff carry user-specific information, which can be recovered by an image extractor and further facilitate forensic identification. Extensive experiments are conducted on two popular diffusion models, and we demonstrate that our method is effective and robust in both the detection and owner identification tasks. Meanwhile, our watermarking framework only exerts a negligible impact on the original generation and is more stealthy and efficient in comparison to existing watermarking strategies.


title: Towards Robustness and Diversity: Continual Learning in Dialog Generation with Text-Mixup and Batch Nuclear-Norm Maximization

abstract: In our dynamic world where data arrives in a continuous stream, continual learning enables us to incrementally add new tasks/domains without the need to retrain from scratch. A major challenge in continual learning of language model is catastrophic forgetting, the tendency of models to forget knowledge from previously trained tasks/domains when training on new ones. This paper studies dialog generation under the continual learning setting. We propose a novel method that 1) uses \textit{Text-Mixup} as data augmentation to avoid model overfitting on replay memory and 2) leverages Batch-Nuclear Norm Maximization (BNNM) to alleviate the problem of mode collapse. Experiments on a $37$-domain task-oriented dialog dataset and DailyDialog (a $10$-domain chitchat dataset) demonstrate that our proposed approach outperforms the state-of-the-art in continual learning.


title: A Search for Classical Subsystems in Quantum Worlds

abstract: Decoherence and einselection have been effective in explaining several features of an emergent classical world from an underlying quantum theory. However, the theory assumes a particular factorization of the global Hilbert space into constituent system and environment subsystems, as well as specially constructed Hamiltonians. In this work, we take a systematic approach to discover, given a fixed Hamiltonian, (potentially) several factorizations (or tensor product structures) of a global Hilbert space that admit a quasi-classical description of subsystems in the sense that certain states (the "pointer states") are robust to entanglement. We show that every Hamiltonian admits a pointer basis in the factorization where the energy eigenvectors are separable. Furthermore, we implement an algorithm that allows us to discover a multitude of factorizations that admit pointer states and use it to explore these quasi-classical "realms" for both random and structured Hamiltonians. We also derive several analytical forms that the Hamiltonian may take in such factorizations, each with its unique set of features. Our approach has several implications: it enables us to derive the division into quasi-classical subsystems, demonstrates that decohering subsystems do not necessarily align with our classical notion of locality, and challenges ideas expressed by some authors that the propensity of a system to exhibit classical dynamics relies on minimizing the interaction between subsystems. From a quantum foundations perspective, these results lead to interesting ramifications for relative-state interpretations. From a quantum engineering perspective, these results may be useful in characterizing decoherence free subspaces and other passive error avoidance protocols.


title: Solving the Multiobjective Quasi-Clique Problem

abstract: Given a simple undirected graph $G$, a quasi-clique is a subgraph of $G$ whose density is at least $\gamma$ $(0 < \gamma \leq 1)$. Finding a maximum quasi-clique has been addressed from two different perspectives: $i)$ maximizing vertex cardinality for a given edge density; and $ii)$ maximizing edge density for a given vertex cardinality. However, when no a priori preference information about cardinality and density is available, a more natural approach is to consider the problem from a multiobjective perspective. We introduce the Multiobjective Quasi-clique Problem (MOQC), which aims to find a quasi-clique by simultaneously maximizing both vertex cardinality and edge density. To efficiently address this problem, we explore the relationship among MOQC, its single-objective counterpart problems, and a biobjective optimization problem, along with several properties of the MOQC problem and quasi-cliques. We propose a baseline approach using $\varepsilon$-constraint scalarization and introduce a Two-phase strategy, which applies a dichotomic search based on weighted sum scalarization in the first phase and an $\varepsilon$-constraint methodology in the second phase. Additionally, we present a Three-phase strategy that combines the dichotomic search used in Two-phase with a vertex-degree-based local search employing novel sufficient conditions to assess quasi-clique efficiency, followed by an $\varepsilon$-constraint in a final stage. Experimental results on real-world sparse graphs indicate that the integrated use of dichotomic search and local search, together with mechanisms to assess quasi-clique efficiency, makes the Three-phase strategy an effective approach for solving the MOQC problem in terms of running time and ability to produce new efficient quasi-cliques.


title: Rethinking Multi-view Representation Learning via Distilled Disentangling

abstract: Multi-view representation learning aims to derive robust representations that are both view-consistent and view-specific from diverse data sources. This paper presents an in-depth analysis of existing approaches in this domain, highlighting a commonly overlooked aspect: the redundancy between view-consistent and view-specific representations. To this end, we propose an innovative framework for multi-view representation learning, which incorporates a technique we term 'distilled disentangling'. Our method introduces the concept of masked cross-view prediction, enabling the extraction of compact, high-quality view-consistent representations from various sources without incurring extra computational overhead. Additionally, we develop a distilled disentangling module that efficiently filters out consistency-related information from multi-view representations, resulting in purer view-specific representations. This approach significantly reduces redundancy between view-consistent and view-specific representations, enhancing the overall efficiency of the learning process. Our empirical evaluations reveal that higher mask ratios substantially improve the quality of view-consistent representations. Moreover, we find that reducing the dimensionality of view-consistent representations relative to that of view-specific representations further refines the quality of the combined representations. Our code is accessible at: https://github.com/Guanzhou-Ke/MRDD.


title: Role of Coulomb interaction in the valley photogalvanic effect

abstract: We develop a theory of Coulomb interaction-related contribution to the photogalvanic current of the carriers of charge in two-dimensional non-centrosymmetric Dirac materials possessing a nontrivial structure of valleys and exposed to an external electromagnetic field. The valley photogalvanic effect occurs here due to the trigonal warping of electrons and holes' dispersions in a given valley of the monolayer. We study the low-frequency limit of the external field: The field frequency is smaller than the temperature $T$, and the electron-electron and electron-hole scattering times are much larger than the electron-impurity and hole-impurity scattering times. In this regime, we employ the Boltzmann transport equations and show that electron-hole scattering dominates electron-electron scattering in intrinsic semiconductors. A Coulomb electron-hole interaction-related contribution to the valley photogalvanic current can reduce the value of the bare photogalvanic current as electron and hole currents flow in opposite directions.


title: Short research review: Applications of statistical physics investigating financial and other social systems

abstract: Physics research complements traditional approaches, such as mathematical (stochastic) finance and econometrics in quantitative economics and finance. In the early years of this millennium, we embarked on an interdisciplinary research endeavor in Lithuania, applying concepts from statistical physics to understand complex financial and social systems. Here, we provide a short review of investigations in Lithuania, spanning from 2008 to 2022, undertaken by our research group.


title: BEnQA: A Question Answering and Reasoning Benchmark for Bengali and English

abstract: In this study, we introduce BEnQA, a dataset comprising parallel Bengali and English exam questions for middle and high school levels in Bangladesh. Our dataset consists of approximately 5K questions covering several subjects in science with different types of questions, including factual, application, and reasoning-based questions. We benchmark several Large Language Models (LLMs) with our parallel dataset and observe a notable performance disparity between the models in Bengali and English. We also investigate some prompting methods, and find that Chain-of-Thought prompting is beneficial mostly on reasoning questions, but not so much on factual ones. We also find that appending English translation helps to answer questions in Bengali. Our findings point to promising future research directions for improving the performance of LLMs in Bengali and more generally in low-resource languages.


title: $Herschel$ investigation of cores and filamentary structures in L1251 located in the Cepheus flare

abstract: Context: Molecular clouds are the prime locations of star formation. These clouds contain filamentary structures and cores which are crucial in the formation of young stars. Aims: In this work, we aim to quantify the physical properties of structural characteristics within the molecular cloud L1251 to better understand the initial conditions for star formation. Methods: We applied the getsf algorithm to identify cores and filaments within the molecular cloud L1251 using the Herschel multiband dust continuum image, enabling us to measure their respective physical properties. Additionally, we utilized an enhanced differential term algorithm to produce high-resolution temperature maps and column density maps with a resolution of ${13.5}''$. Results: We identified 122 cores in the region. Out of them, 23 are protostellar cores, 13 are robust prestellar cores, 32 are candidate prestellar cores (including 13 robust prestellar cores and 19 strictly candidate prestellar cores), and 67 are unbound starless cores. getsf also found 147 filament structures in the region. Statistical analysis of the physical properties (mass (M), temperature (T), size, and core brightness (hereafter, we are using the word luminosity (L)) for the core brightness) of obtained cores shows a negative correlation between core mass and temperature and a positive correlation between (M/L) and (M/T). Analysis of the filaments gives a median width of 0.14 pc and no correlation between width and length. Out of those 122 cores, 92 are present in filaments (75.4%) and the remaining were outside them. Out of the cores present in filaments, 57 (62%) cores are present in supercritical filaments ($M_{\rm line}>16M_{\odot }/{\rm pc}$).


title: Geminga's pulsar halo: an X-ray view

abstract: Geminga is the first pulsar around which a remarkable TeV gamma-ray halo extending over a few degrees was discovered by MILAGRO, HAWC and later by H.E.S.S., and by Fermi-LAT in the GeV band. More middle-aged pulsars have exhibited gamma-ray halos, and they are now recognized as an emerging class of Galactic gamma-ray sources. The emission appears in the late evolution stage of pulsars, and is most plausibly explained by inverse Compton scattering of CMB and interstellar photons by relativistic electrons and positrons escaping from the pulsar wind nebulae. These observations pose a number of theoretical challenges. Tackling these questions requires constraining the ambient magnetic field properties, which can be achieved through X-ray observations. If the gamma-ray halos originate from a distribution of highly energetic electrons, synchrotron losses in the ambient magnetic fields of the same particles are expected to produce a diffuse X-ray emission with a similar spatial extension. We present the most comprehensive X-ray study of the Geminga pulsar halo to date, utilising archival data from XMM-Newton and NuSTAR. Our X-ray analysis covers a broad bandwidth ($0.5\rm{-}79$ keV) and large field of view ($\sim 4^\circ$) for the first time. This is achieved by accurately measuring the background over the entire field of view, and taking into account both focused and stray-light X-ray photons with NuSTAR. We find no significant emission and set robust constraints on the X-ray halo flux. These are translated to stringent constraints on the ambient magnetic field strength and the diffusion coefficient by using a physical model considering particle injection, diffusion and cooling over the pulsar's lifetime, which is tuned by fitting multi-wavelength data. Our novel methodology for modelling and searching for synchrotron X-ray halos can be applied to other pulsar halo candidates.


title: DTOR: Decision Tree Outlier Regressor to explain anomalies

abstract: Explaining outliers occurrence and mechanism of their occurrence can be extremely important in a variety of domains. Malfunctions, frauds, threats, in addition to being correctly identified, oftentimes need a valid explanation in order to effectively perform actionable counteracts. The ever more widespread use of sophisticated Machine Learning approach to identify anomalies make such explanations more challenging. We present the Decision Tree Outlier Regressor (DTOR), a technique for producing rule-based explanations for individual data points by estimating anomaly scores generated by an anomaly detection model. This is accomplished by first applying a Decision Tree Regressor, which computes the estimation score, and then extracting the relative path associated with the data point score. Our results demonstrate the robustness of DTOR even in datasets with a large number of features. Additionally, in contrast to other rule-based approaches, the generated rules are consistently satisfied by the points to be explained. Furthermore, our evaluation metrics indicate comparable performance to Anchors in outlier explanation tasks, with reduced execution time.


title: Urban Sound Propagation: a Benchmark for 1-Step Generative Modeling of Complex Physical Systems

abstract: Data-driven modeling of complex physical systems is receiving a growing amount of attention in the simulation and machine learning communities. Since most physical simulations are based on compute-intensive, iterative implementations of differential equation systems, a (partial) replacement with learned, 1-step inference models has the potential for significant speedups in a wide range of application areas. In this context, we present a novel benchmark for the evaluation of 1-step generative learning models in terms of speed and physical correctness. Our Urban Sound Propagation benchmark is based on the physically complex and practically relevant, yet intuitively easy to grasp task of modeling the 2d propagation of waves from a sound source in an urban environment. We provide a dataset with 100k samples, where each sample consists of pairs of real 2d building maps drawn from OpenStreetmap, a parameterized sound source, and a simulated ground truth sound propagation for the given scene. The dataset provides four different simulation tasks with increasing complexity regarding reflection, diffraction and source variance. A first baseline evaluation of common generative U-Net, GAN and Diffusion models shows, that while these models are very well capable of modeling sound propagations in simple cases, the approximation of sub-systems represented by higher order equations systematically fails. Information about the dataset, download instructions and source codes are provided on our website: https://www.urban-sound-data.org.


title: Computational Seismic Fracture Synthesis of Tidal Barrage using Enhanced Isotropic Plasticity Damage Mechanics and Coupled Lagrangian-Eulerian Multiphase Interaction

abstract: Mega-engineered hydraulic structures like dams and barrages are critically sensitive to strong ground motion if constructed within the vicinity of triggered fault lines. Collapse post excessive deformation leads to severe environmental impact. In this study, fracture corresponding to the response of a concrete tidal barrage to strong ground motion is analyzed along with behavioral effects due to reservoir-barrage dynamic interaction. An enhanced version of the plasticity damage mechanical model, which includes effects due to degradation of elastic stiffness of concrete as well as restoration of fracture energy losses is assigned as material behavior. The fluid-structure interaction is solved using an idealized Lagrangian-Eulerian formulation. The proposed improvised numerical formulations are validated against benchmark simulations performed on the Koyna dam situated in Maharashtra, India and the results captured are upto 94% accurate. Finite element simulation of a tidal barrage is performed using a computationally stable mesh with global grid to length ratio of 4.2. The yield surface captured is elliptical in nature and fracture is observed to be propagating from bottom of gate housing covering upto four nodal integration points.


title: HourglassNeRF: Casting an Hourglass as a Bundle of Rays for Few-shot Neural Rendering

abstract: Recent advancements in the Neural Radiance Field (NeRF) have bolstered its capabilities for novel view synthesis, yet its reliance on dense multi-view training images poses a practical challenge. Addressing this, we propose HourglassNeRF, an effective regularization-based approach with a novel hourglass casting strategy. Our proposed hourglass is conceptualized as a bundle of additional rays within the area between the original input ray and its corresponding reflection ray, by featurizing the conical frustum via Integrated Positional Encoding (IPE). This design expands the coverage of unseen views and enables an adaptive high-frequency regularization based on target pixel photo-consistency. Furthermore, we propose luminance consistency regularization based on the Lambertian assumption, which is known to be effective for training a set of augmented rays under the few-shot setting. Leveraging the inherent property of a Lambertian surface, which retains consistent luminance irrespective of the viewing angle, we assume our proposed hourglass as a collection of flipped diffuse reflection rays and enhance the luminance consistency between the original input ray and its corresponding hourglass, resulting in more physically grounded training framework and performance improvement. Our HourglassNeRF outperforms its baseline and achieves competitive results on multiple benchmarks with sharply rendered fine details. The code will be available.


title: Macroeconomic Spillovers of Weather Shocks across U.S. States

abstract: We estimate the short-run effects of severe weather shocks on local economic activity and cross-border spillovers operating through economic linkages between U.S. states. We measure weather shocks using emergency declarations triggered by natural disasters and estimate their impacts with a monthly Global Vector Autoregressive (GVAR) model for U.S. states. Impulse responses highlight country-wide effects of weather shocks hitting individual regions. Taking into account economic interconnections between states allows capturing much stronger spillovers than those associated with mere spatial adjacency. Also, geographical heterogeneity is critical for assessing country-wide effects of weather shocks, and network effects amplify the local impacts of shocks.


title: Femtosecond dynamics on the nanoscale of intense laser-induced grating plasma

abstract: The complex interaction dynamics of intense femtosecond (fs) pulses and their picosecond (ps)-long leading edge with nanostructured solids occur at both the nanometer and the femtosecond scales, making them extremely difficult to measure directly. Here, we present pump-probe-based measurements that capture the ultrafast evolution of relativistically intense laser-driven grating plasma on fs time and nanometer spatial scales. We measure the transient reflectivity and spectrum of the scattered or diffracted UV-probe pulses from the grating structures with 100s of fs resolution. Our measurements capture the initial onset of the solid-to-plasma transition and the subsequent grating plasma expansion, a few ps before the peak of the intense fs pulse. We measure the instantaneous position of the electron critical surface, its velocity, and its acceleration, which are very crucial for fundamental understanding and applications in ion/electron acceleration and high harmonic generation, while also providing valuable benchmarks for simulations. Particle-in-cell (PIC) simulations corroborate the observations well offering further insight into this process.


title: Impulsive Lorenz semiflows: Physical measures, statistical stability and entropy stability

abstract: We study semiflows generated via impulsive perturbations of Lorenz flows. We prove that such semiflows admit a finite number of physical measures. Moreover, if the impulsive perturbation is small enough, we show that the physical measures of the semiflows are close, in the weak* topology, to the unique physical measure of the Lorenz flow. A similar conclusion holds for the entropies associated with the physical measures.


title: Graph Regularized NMF with L20-norm for Unsupervised Feature Learning

abstract: Nonnegative Matrix Factorization (NMF) is a widely applied technique in the fields of machine learning and data mining. Graph Regularized Non-negative Matrix Factorization (GNMF) is an extension of NMF that incorporates graph regularization constraints. GNMF has demonstrated exceptional performance in clustering and dimensionality reduction, effectively discovering inherent low-dimensional structures embedded within high-dimensional spaces. However, the sensitivity of GNMF to noise limits its stability and robustness in practical applications. In order to enhance feature sparsity and mitigate the impact of noise while mining row sparsity patterns in the data for effective feature selection, we introduce the $\ell_{2,0}$-norm constraint as the sparsity constraints for GNMF. We propose an unsupervised feature learning framework based on GNMF\_$\ell_{20}$ and devise an algorithm based on PALM and its accelerated version to address this problem. Additionally, we establish the convergence of the proposed algorithms and validate the efficacy and superiority of our approach through experiments conducted on both simulated and real image data.


title: Efficient Diffusion-Driven Corruption Editor for Test-Time Adaptation

abstract: Test-time adaptation (TTA) addresses the unforeseen distribution shifts occurring during test time. In TTA, both performance and, memory and time consumption serve as crucial considerations. A recent diffusion-based TTA approach for restoring corrupted images involves image-level updates. However, using pixel space diffusion significantly increases resource requirements compared to conventional model updating TTA approaches, revealing limitations as a TTA method. To address this, we propose a novel TTA method by leveraging a latent diffusion model (LDM) based image editing model and fine-tuning it with our newly introduced corruption modeling scheme. This scheme enhances the robustness of the diffusion model against distribution shifts by creating (clean, corrupted) image pairs and fine-tuning the model to edit corrupted images into clean ones. Moreover, we introduce a distilled variant to accelerate the model for corruption editing using only 4 network function evaluations (NFEs). We extensively validated our method across various architectures and datasets including image and video domains. Our model achieves the best performance with a 100 times faster runtime than that of a diffusion-based baseline. Furthermore, it outpaces the speed of the model updating TTA method based on data augmentation threefold, rendering an image-level updating approach more practical.


title: Automatic location detection based on deep learning

abstract: The proliferation of digital images and the advancements in deep learning have paved the way for innovative solutions in various domains, especially in the field of image classification. Our project presents an in-depth study and implementation of an image classification system specifically tailored to identify and classify images of Indian cities. Drawing from an extensive dataset, our model classifies images into five major Indian cities: Ahmedabad, Delhi, Kerala, Kolkata, and Mumbai to recognize the distinct features and characteristics of each city/state. To achieve high precision and recall rates, we adopted two approaches. The first, a vanilla Convolutional Neural Network (CNN) and then we explored the power of transfer learning by leveraging the VGG16 model. The vanilla CNN achieved commendable accuracy and the VGG16 model achieved a test accuracy of 63.6%. Evaluations highlighted the strengths and potential areas of improvement, positioning our model as not only competitive but also scalable for broader applications. With an emphasis on open-source ethos, our work aims to contribute to the community, encouraging further development and diverse applications. Our findings demonstrate the potential applications in tourism, urban planning, and even real-time location identification systems, among others.


title: DEFA: Efficient Deformable Attention Acceleration via Pruning-Assisted Grid-Sampling and Multi-Scale Parallel Processing

abstract: Multi-scale deformable attention (MSDeformAttn) has emerged as a key mechanism in various vision tasks, demonstrating explicit superiority attributed to multi-scale grid-sampling. However, this newly introduced operator incurs irregular data access and enormous memory requirement, leading to severe PE underutilization. Meanwhile, existing approaches for attention acceleration cannot be directly applied to MSDeformAttn due to lack of support for this distinct procedure. Therefore, we propose a dedicated algorithm-architecture co-design dubbed DEFA, the first-of-its-kind method for MSDeformAttn acceleration. At the algorithm level, DEFA adopts frequency-weighted pruning and probability-aware pruning for feature maps and sampling points respectively, alleviating the memory footprint by over 80%. At the architecture level, it explores the multi-scale parallelism to boost the throughput significantly and further reduces the memory access via fine-grained layer fusion and feature map reusing. Extensively evaluated on representative benchmarks, DEFA achieves 10.1-31.9x speedup and 20.3-37.7x energy efficiency boost compared to powerful GPUs. It also rivals the related accelerators by 2.2-3.7x energy efficiency improvement while providing pioneering support for MSDeformAttn.


title: Semigroup of annuli in Liouville CFT

abstract: In conformal field theory, the semigroup of annuli with boundary parametrization plays a special role, in that it generates the whole algebra of local conformal symmetries, the so-called Virasoro algebra. The subgroup of elements $\mathbb{A}_f=\mathbb{D}\setminus f(\mathbb{D}^\circ)$ for contracting biholomorphisms $f:\mathbb{D}\to f(\mathbb{D})\subset \mathbb{D}^\circ$ with $f(0)=0$ is called the holomorphic semigroup of annuli. In this article, we construct a differentiable representation of the holomorphic semigroup into the space of bounded operators on the Hilbert space $\mathcal{H}$ of Liouville Conformal Field Theory and show it generates under differentiation the positive Virasoro elements ${\bf L}_n,\tilde{{\bf L}}_n$ for $n\geq 0$. We also construct a projective representation of the semigroup of annuli in the space of bounded operators on $\mathcal{H}$ in terms of Segal amplitudes and show that all Virasoro elements ${\bf L}_n,\tilde{{\bf L}}_n$ for $n\in \mathbb{Z}$ are generated by differentiation of these annuli amplitudes. Finally, we use this to show that the Segal amplitudes for Liouville theory are differentiable with respetc to their boundary parametrizations, and the differential is computed in terms of Virasoro generators. This paper will serve, in a forthcoming work, as a fundamental tool in the construction of the conformal blocks as globally defined holomorphic sections of a holomorphic line bundle on Teichmuller space and satisfying the Ward identities.


title: A necessary condition for the boundedness of the maximal operator on $L^{p(\cdot)}$ over reverse doubling spaces of homogeneous type

abstract: Let $(X,d,\mu)$ be a space of homogeneous type and $p(\cdot):X\to[1,\infty]$ be a variable exponent. We show that if the measure $\mu$ is Borel-semiregular and reverse doubling, then the condition ${\rm ess\,inf}_{x\in X}p(x)>1$ is necessary for the boundedness of the Hardy-Littlewood maximal operator $M$ on the variable Lebesgue space $L^{p(\cdot)}(X,d,\mu)$.


title: FishNet: Deep Neural Networks for Low-Cost Fish Stock Estimation

abstract: Fish stock assessment often involves manual fish counting by taxonomy specialists, which is both time-consuming and costly. We propose an automated computer vision system that performs both taxonomic classification and fish size estimation from images taken with a low-cost digital camera. The system first performs object detection and segmentation using a Mask R-CNN to identify individual fish from images containing multiple fish, possibly consisting of different species. Then each fish species is classified and the predicted length using separate machine learning models. These models are trained on a dataset of 50,000 hand-annotated images containing 163 different fish species, ranging in length from 10cm to 250cm. Evaluated on held-out test data, our system achieves a $92\%$ intersection over union on the fish segmentation task, a $89\%$ top-1 classification accuracy on single fish species classification, and a $2.3$~cm mean error on the fish length estimation task.


title: High order Well-Balanced Arbitrary-Lagrangian-Eulerian ADER discontinuous Galerkin schemes on general polygonal moving meshes

abstract: In this work, we present a novel family of high order accurate numerical schemes for the solution of hyperbolic partial differential equations (PDEs) which combines several geometrical and physical structure preserving properties. First, we settle our methods in the Lagrangian framework, where each element of the mesh evolves following as close as possible the local fluid flow, so to reduce the numerical dissipation at contact waves and moving interfaces and to satisfy the Galilean and rotational invariance properties of the studied PDEs system. In particular, we choose the direct Arbitrary-Lagrangian-Eulerian (ALE) approach which, in order to always guarantee the high quality of the moving mesh, allows to combine the Lagrangian motion with mesh optimization techniques. The employed polygonal tessellation is thus regenerated at each time step, the previous one is connected with the new one by space-time control volumes, including hole-like sliver elements in correspondence of topology changes, over which we integrate a space-time divergence form of the original PDEs through a high order accurate ADER discontinuous Galerkin (DG) scheme. Mass conservation and adherence to the GCL condition are guaranteed by construction thanks to the integration over closed control volumes, and robustness over shock discontinuities is ensured by the use of an a posteriori subcell finite volume (FV) limiting technique.


title: Computationally feasible bounds for the free energy of nonequilibrium steady states, applied to simple models of heat conduction

abstract: In this paper we study computationally feasible bounds for relative free energies between two many-particle systems. Specifically, we consider systems out of equilibrium that do not necessarily satisfy a fluctuation-dissipation relation, but that nevertheless admit a nonequilibrium steady state that is reached asymptotically in the long-time limit. The bounds that we suggest are based on the well-known Bogoliubov inequality and variants of Gibbs' and Donsker-Varadhan variational principles. As a general paradigm, we consider systems of oscillators coupled to heat baths at different temperatures. For such systems, we define the free energy of the system relative to any given reference system (that may or may not be in thermal equilibrium) in terms of the Kullback-Leibler divergence between steady states. By employing a two-sided Bogoliubov inequality and a mean-variance approximation of the free energy (or cumulant generating function, we can efficiently estimate the free energy cost needed in passing from the reference system to the system out of equilibrium (characterised by a temperature gradient). A specific test case to validate our bounds are harmonic oscillator chains with ends that are coupled to Langevin thermostats at different temperatures; such a system is simple enough to allow for analytic calculations and general enough to be used as a prototype to estimate, e.g., heat fluxes or interface effects in a larger class of nonequilibrium particle systems.


title: A Hypergraph-based Formalization of Hierarchical Reactive Modules and a Compositional Verification Method

abstract: The compositional approach is important for reasoning about large and complex systems. In this work, we address synchronous systems with hierarchical structures, which are often used to model cyber-physical systems. We revisit the theory of reactive modules and reformulate it based on hypergraphs to clarify the parallel composition and the hierarchical description of modules. Then, we propose an automatic verification method for hierarchical systems. Given a system description annotated with assume-guarantee contracts, the proposed method divides the system into modules and verifies them separately to show that the top-level system satisfies its contract. Our method allows an input to be a circular system in which submodules mutually depend on each other. Experimental result shows our method can be effectively implemented using an SMT-based model checker.


title: Batch-oriented Element-wise Approximate Activation for Privacy-Preserving Neural Networks

abstract: Privacy-Preserving Neural Networks (PPNN) are advanced to perform inference without breaching user privacy, which can serve as an essential tool for medical diagnosis to simultaneously achieve big data utility and privacy protection. As one of the key techniques to enable PPNN, Fully Homomorphic Encryption (FHE) is facing a great challenge that homomorphic operations cannot be easily adapted for non-linear activation calculations. In this paper, batch-oriented element-wise data packing and approximate activation are proposed, which train linear low-degree polynomials to approximate the non-linear activation function - ReLU. Compared with other approximate activation methods, the proposed fine-grained, trainable approximation scheme can effectively reduce the accuracy loss caused by approximation errors. Meanwhile, due to element-wise data packing, a large batch of images can be packed and inferred concurrently, leading to a much higher utility ratio of ciphertext slots. Therefore, although the total inference time increases sharply, the amortized time for each image actually decreases, especially when the batch size increases. Furthermore, knowledge distillation is adopted in the training process to further enhance the inference accuracy. Experiment results show that when ciphertext inference is performed on 4096 input images, compared with the current most efficient channel-wise method, the inference accuracy is improved by 1.65%, and the amortized inference time is reduced by 99.5%.


title: Simultaneously Transmitting and Reflecting Reconfigurable Intelligent Surfaces Empowered Cooperative Rate Splitting with User Relaying

abstract: In this work, we unveil the advantages of synergizing cooperative rate splitting (CRS) with user relaying and simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR RIS). Specifically, we propose a novel STAR RIS-assisted CRS transmission framework, featuring six unique transmission modes that leverage various combination of the relaying protocols (including full duplex-FD and half duplex-HD) and the STAR RIS configuration protocols (including energy splitting-ES, mode switching-MS, and time splitting-TS). With the objective of maximizing the minimum user rate, we then propose a unified successive convex approximation (SCA)-based alternative optimization (AO) algorithm to jointly optimize the transmit active beamforming, common rate allocation, STAR RIS passive beamforming, as well as time allocation (for HD or TS protocols) subject to the transmit power constraint at the base station (BS) and the law of energy conservation at the STAR RIS. To alleviate the computational burden, we further propose a low-complexity algorithm that incorporates a closed-form passive beamforming design. Numerical results show that our proposed framework significantly enhances user fairness compared with conventional CRS schemes without STAR RIS or other STAR RIS empowered multiple access schemes. Moreover, the proposed low-complexity algorithm dramatically reduces the computational complexity while achieving very close performance to the AO method.


title: Radiative transitions of $\chi_{_{cJ}}\to\psi\gamma$ and $\chi_{_{bJ}}\to\Upsilon\gamma$

abstract: In the framework of instantaneous Bethe-Salpeter equation, according to the $J ^ {PC}$ of quarkonia, we find that their wave functions all contain multiple partial waves, rather than pure waves. In the radiative electromagnetic transitions $\chi_{_{cJ}}$$\rightarrow$$\gamma\psi$ and $\chi_{_{bJ}}$$\rightarrow$$\gamma\Upsilon$ ($J=0,1,2$), the main wave of quarkonium gives the non-relativistic contribution, while other waves provide the relativistic corrections. Our results indicate that the relativistic effect of charmonium, especially highly excited states, is significant. Such as the relativistic effects of $\chi_{_{cJ}}(2P)\to\gamma\psi(1S)$ ($J=0,1,2$) are $\{49.7\%,~30.9\%,~37.5\%\}$, much larger than the corresponding $\{17.8\%,~7.08\%,~12.9\%\}$ of $\chi_{_{bJ}}(2P)\rightarrow\gamma\Upsilon(1S)$. The decay of $\chi_{_{cJ}}(2P)\to\gamma\psi$ can be used to distinguish between $\chi_{_{c0}}(3860)$ and $\chi_{_{c0}}(3915)$, which particle is the charmonium $\chi_{_{c0}}(2P)$. Although our result of $\chi_{_{c1}}(3872)$$\rightarrow$$\gamma\psi(2S)$ is consistent with data, but the one of $\chi_{_{c1}}(3872)$$\rightarrow$$\gamma\psi(1S)$ is much larger than data, so whether $\chi_{_{c1}}(3872)$ is the conventional $\chi_{_{c1}}(2P)$ remains an open question. The undiscovered $\Upsilon(1D)$ and $\Upsilon(2D)$ have large production rates in decays of $\chi_{_{b0}}(2P)\rightarrow\gamma\Upsilon(1D)$ and $\chi_{_{bJ}}(3P)\rightarrow\gamma\Upsilon(2D)$ ($J=0,1$), respectively. To search for $\chi_{_{bJ}}(3P)$ $(J=0,1,2)$, the most competitive channels are the decays $\chi_{_{bJ}}(3P)\rightarrow\gamma\Upsilon(3S)$. And the best way to find $\chi_{_{b2}}(1F)$ is to search for the decay of $\chi_{_{b2}}(1F)\rightarrow\gamma\Upsilon(1D)$.


title: Interpretable Machine Learning for TabPFN

abstract: The recently developed Prior-Data Fitted Networks (PFNs) have shown very promising results for applications in low-data regimes. The TabPFN model, a special case of PFNs for tabular data, is able to achieve state-of-the-art performance on a variety of classification tasks while producing posterior predictive distributions in mere seconds by in-context learning without the need for learning parameters or hyperparameter tuning. This makes TabPFN a very attractive option for a wide range of domain applications. However, a major drawback of the method is its lack of interpretability. Therefore, we propose several adaptations of popular interpretability methods that we specifically design for TabPFN. By taking advantage of the unique properties of the model, our adaptations allow for more efficient computations than existing implementations. In particular, we show how in-context learning facilitates the estimation of Shapley values by avoiding approximate retraining and enables the use of Leave-One-Covariate-Out (LOCO) even when working with large-scale Transformers. In addition, we demonstrate how data valuation methods can be used to address scalability challenges of TabPFN. Our proposed methods are implemented in a package tabpfn_iml and made available at https://github.com/david-rundel/tabpfn_iml.