title: Solving the flexible job-shop scheduling problem through an enhanced deep reinforcement learning approach

abstract: In scheduling problems common in the industry and various real-world scenarios, responding in real-time to disruptive events is essential. Recent methods propose the use of deep reinforcement learning (DRL) to learn policies capable of generating solutions under this constraint. The objective of this paper is to introduce a new DRL method for solving the flexible job-shop scheduling problem, particularly for large instances. The approach is based on the use of heterogeneous graph neural networks to a more informative graph representation of the problem. This novel modeling of the problem enhances the policy's ability to capture state information and improve its decision-making capacity. Additionally, we introduce two novel approaches to enhance the performance of the DRL approach: the first involves generating a diverse set of scheduling policies, while the second combines DRL with dispatching rules (DRs) constraining the action space. Experimental results on two public benchmarks show that our approach outperforms DRs and achieves superior results compared to three state-of-the-art DRL methods, particularly for large instances.


title: User Clustering for Coexistence between Near-field and Far-field Communications

abstract: This letter investigates the coexistence between near-field (NF) and far-field (FF) communications, where multiple FF users are clustered to be served on the beams of legacy NF users, via non-orthogonal multiple access (NOMA). Three different successive interference cancellation (SIC) decoding strategies are proposed and a sum rate maximization problem is formulated to optimize the assignment and decoding order. The beam allocation problem is further reformulated as an overlapping coalitional game, which facilitates the the design of the proposed clustering algorithm. The optimal decoding order in each cluster is also derived, which can be integrated into the proposed clustering. Simulation results demonstrate that the proposed clustering algorithm is able to significantly improve the sum rate of the considered system, and the developed strategies achieve different trade-offs between sum rate and fairness.


title: Tuning the topological character of half-Heusler systems: A comparative study on Y$T$Bi ($T$ = Pd, Pt)

abstract: Half-Heusler systems host a plethora of different ground states, especially with non-trivial topology. However, there is still a lack of spectroscopic insight into the corresponding band inversion in this family. In this work, we locally explore the half-Heuslers Y$T$Bi ($T =$ Pt and Pd) by means of scanning tunneling microscopy/spectroscopy. From our analysis of the (120) surface plane, we infer that the increase of the spin--orbit coupling upon going from Pd to Pt is the main player in tuning the surface states from trivial to topologically non-trivial. Our measurements unveil a ($2 \times 1$) reconstruction of the (120) surface of both systems. Using density functional theory calculations, we show that the observed different behavior of the local density of states near the Fermi level in these two materials is directly related to the presence of metallic surface states. Our work sheds new light on a well known tunable family of materials and opens new routes to explore the presence of topological states of matter in half-Heusler systems and its microscopic observation.


title: Causal Representation Learning Made Identifiable by Grouping of Observational Variables

abstract: A topic of great current interest is Causal Representation Learning (CRL), whose goal is to learn a causal model for hidden features in a data-driven manner. Unfortunately, CRL is severely ill-posed since it is a combination of the two notoriously ill-posed problems of representation learning and causal discovery. Yet, finding practical identifiability conditions that guarantee a unique solution is crucial for its practical applicability. Most approaches so far have been based on assumptions on the latent causal mechanisms, such as temporal causality, or existence of supervision or interventions; these can be too restrictive in actual applications. Here, we show identifiability based on novel, weak constraints, which requires no temporal structure, intervention, nor weak supervision. The approach is based on assuming the observational mixing exhibits a suitable grouping of the observational variables. We also propose a novel self-supervised estimation framework consistent with the model, prove its statistical consistency, and experimentally show its superior CRL performances compared to the state-of-the-art baselines. We further demonstrate its robustness against latent confounders and causal cycles.


title: Phase transition at 350 K in the Ti$_3$C$_2$T$_x$ MXene: possible sliding (moir\'e) ferroelectricity

abstract: A phase transition is found in Ti$_3$C$_2$T$_x$ MXene at 350 K, by measuring the complex Young's modulus of self-standing thick films. A step-like softening and increase of the mechanical losses is found below 350 K, indicative of a phase transition, where the square of the order parameter is coupled to strain. It is argued that it should be a ferroelectric transition, most likely of the sliding (moir\'e) type, due to charge transfer between facing flakes sliding with respect to each other. If the transition will be confirmed to be ferroelectric, Ti$_3$C$_2$T$_x$ will be added to the class of metallic ferroelectrics and open new perspectives of applications, in addition to the numerous already studied.


title: Efficient Online String Matching through Linked Weak Factors

abstract: Online string matching is a computational problem involving the search for patterns or substrings in a large text dataset, with the pattern and text being processed sequentially, without prior access to the entire text. Its relevance stems from applications in data compression, data mining, text editing, and bioinformatics, where rapid and efficient pattern matching is crucial. Various solutions have been proposed over the past few decades, employing diverse techniques. Recently, weak recognition approaches have attracted increasing attention. This paper presents Hash Chain, a new algorithm based on a robust weak factor recognition approach that connects adjacent factors through hashing. Despite its O(nm) complexity, the algorithm exhibits a sublinear behavior in practice and achieves superior performance compared to the most effective algorithms.


title: GNeSF: Generalizable Neural Semantic Fields

abstract: 3D scene segmentation based on neural implicit representation has emerged recently with the advantage of training only on 2D supervision. However, existing approaches still requires expensive per-scene optimization that prohibits generalization to novel scenes during inference. To circumvent this problem, we introduce a generalizable 3D segmentation framework based on implicit representation. Specifically, our framework takes in multi-view image features and semantic maps as the inputs instead of only spatial information to avoid overfitting to scene-specific geometric and semantic information. We propose a novel soft voting mechanism to aggregate the 2D semantic information from different views for each 3D point. In addition to the image features, view difference information is also encoded in our framework to predict the voting scores. Intuitively, this allows the semantic information from nearby views to contribute more compared to distant ones. Furthermore, a visibility module is also designed to detect and filter out detrimental information from occluded views. Due to the generalizability of our proposed method, we can synthesize semantic maps or conduct 3D semantic segmentation for novel scenes with solely 2D semantic supervision. Experimental results show that our approach achieves comparable performance with scene-specific approaches. More importantly, our approach can even outperform existing strong supervision-based approaches with only 2D annotations. Our source code is available at: https://github.com/HLinChen/GNeSF.


title: A Review of $\mu\to eee$, $\mu\to e\gamma$ and $\mu N\to eN$ Conversion

abstract: The observation of lepton flavour violation (LFV) in interactions involving charged leptons would be an unambiguous sign of physics beyond the Standard Model of particle physics. Given that muons can be produced at high intensities, searches for LFV with muons are particularly sensitive. In a global initiative, ongoing and upcoming experiments are aiming to discover physics beyond the Standard Model in the three golden muon LFV channels: $\mu\to e\gamma$, $\mu\to eee$ and $\mu$-to-$e$ conversion on nuclei. With innovative detector concepts and new muon beam lines, these experiments will be able to investigate muon LFV in the coming years with sensitivities improved by up to four orders of magnitude compared to past searches. The current status of muon LFV searches is discussed and the ongoing MEG II and DeeMe experiments as well as the upcoming Mu2e, COMET and Mu3e experiments are presented.


title: Recent highlights and prospects on (n,$\gamma$) measurements at the CERN n_TOF facility

abstract: Neutron capture cross-section measurements are fundamental in the study of the slow neutron capture (s-) process of nucleosynthesis and for the development of innovative nuclear technologies. One of the best suited methods to measure radiative neutron capture (n,$\gamma$) cross sections over the full stellar range of interest for all the applications is the time-of-flight (TOF) technique. Overcoming the current experimental limitations for TOF measurements, in particular on low mass unstable samples, requires the combination of facilities with high instantaneous flux, such as the CERN n_TOF facility, with detection systems with an enhanced detection sensitivity and high counting rate capabilities. This contribution presents a summary about the recent highlights in the field of (n,$\gamma$) measurements at n_TOF. The recent upgrades in the facility and in new detector concepts for (n,\g) measurements are described. Last, an overview is given on the existing limitations and prospects for TOF measurements involving unstable targets and the outlook for activation measurements at the brand new high-flux n_TOF-NEAR station.


title: Two-loop corrections to the Carroll-Field-Jackiw term in a CPT-odd Lorentz-violating scalar QED

abstract: In this study, we systematically calculate one-loop corrections to the Lorentz-violating vertices within the framework of CPT-odd Quantum Electrodynamics, encompassing scalar and photon fields in arbitrary gauge. Additionally, we ascertain the finite two-loop corrections to the Carroll-Field-Jackiw term. Furthermore, we analyze the UV divergent component of the two-loop Lorentz-violating correction in the self-energy of the scalar field.


title: Visible Lagrangians for Hitchin systems and pillowcase covers

abstract: We study complex Lagrangians in Hitchin systems that factor through a proper subvariety of the Hitchin base non-trivially intersecting the regular locus. This gives a general framework for several examples in the literature. We compute the fiber-wise Fourier-Mukai transform of flat line bundles on visible Lagrangians. This proposes a construction of mirror dual branes to visible Lagrangians. Finally, we study a new example of visible Lagrangians in detail. Such visible Lagrangian exists whenever the underlying Riemann surface is a pillowcase cover. The proposed mirror dual brane turns out to be closely related to Hausel's toy model.


title: Breakdown Performance of Guard Ring Designs for Pixel Detectors in $150~\mathrm{nm}$ CMOS Technology

abstract: Silicon pixel sensors manufactured using commercial CMOS processes are promising instruments for high-energy particle physics experiments due to their high yield and proven radiation hardness. As one of the essential factors for the operation of detectors, the breakdown performance of pixel sensors constitutes the upper limit of the operating voltage. Six types of passive CMOS test structures were fabricated on high-resistivity wafers. Each of them features a combination of different inter-pixel designs and sets of floating guard rings, which differ from each other in the geometrical layout, implantation type, and overhang structure. A comparative study based on leakage current measurements in the sensor substrate of unirradiated samples was carried out to identify correlations between guard ring designs and breakdown voltages. TCAD simulations using the design parameters of the test structures were performed to discuss the observations and, together with the measurements, ultimately provide design features targeting higher breakdown voltages.


title: A Phase-Field Discrete Element Method to study chemo-mechanical coupling in granular materials

abstract: This paper presents an extension of the discrete element method using a phase-field formulation to incorporate grain shape and its evolution. The introduction of a phase variable enables an effective representation of grain geometry and facilitates the application of physical laws, such as chemo-mechanical couplings, for modeling shape changes. These physical laws are solved numerically using the finite element method coupled in a staggered scheme to the discrete element model. The efficacy of the proposed Phase-Field Discrete Element Model (PFDEM) is demonstrated through its ability to accurately capture the real grain shape in a material subjected to dissolution only and compute the stress evolution. It is then applied to model the phenomenon of pressure solution involving dissolution and precipitation in granular materials at the microscale and enables to reproduce the creep response observed experimentally. This framework contributes to the enhanced understanding and simulation of complex behaviors in granular materials and sedimentary rocks for many geological processes like diagenesis or earthquake nucleation.


title: Recurrent Linear Transformers

abstract: The self-attention mechanism in the transformer architecture is capable of capturing long-range dependencies and it is the main reason behind its effectiveness in processing sequential data. Nevertheless, despite their success, transformers have two significant drawbacks that still limit their broader applicability: (1) In order to remember past information, the self-attention mechanism requires access to the whole history to be provided as context. (2) The inference cost in transformers is expensive. In this paper we introduce recurrent alternatives to the transformer self-attention mechanism that offer a context-independent inference cost, leverage long-range dependencies effectively, and perform well in practice. We evaluate our approaches in reinforcement learning problems where the aforementioned computational limitations make the application of transformers nearly infeasible. We quantify the impact of the different components of our architecture in a diagnostic environment and assess performance gains in 2D and 3D pixel-based partially-observable environments. When compared to a state-of-the-art architecture, GTrXL, inference in our approach is at least 40% cheaper while reducing memory use in more than 50%. Our approach either performs similarly or better than GTrXL, improving more than 37% upon GTrXL performance on harder tasks.


title: Ensemble of Task-Specific Language Models for Brain Encoding

abstract: Language models have been shown to be rich enough to encode fMRI activations of certain Regions of Interest in our Brains. Previous works have explored transfer learning from representations learned for popular natural language processing tasks for predicting brain responses. In our work, we improve the performance of such encoders by creating an ensemble model out of 10 popular Language Models (2 syntactic and 8 semantic). We beat the current baselines by 10% on average across all ROIs through our ensembling methods.


title: An interpolation between Special Linear and General Algebraic cobordism $\text{MSL}$ and $\text{MGL}$

abstract: We prove an interpolation between special linear algebraic cobordism $\text{MSL}$ and algebraic cobordism $\text{MGL}$ in stable motivic homotopy category over any Noetherian base scheme of finite Krull dimension. It generalizes a classical relation between special unitary and complex cobordism $\text{MSU}$ and $\text{MU}$ in classical stable homotopy theory.


title: Re-Temp: Relation-Aware Temporal Representation Learning for Temporal Knowledge Graph Completion

abstract: Temporal Knowledge Graph Completion (TKGC) under the extrapolation setting aims to predict the missing entity from a fact in the future, posing a challenge that aligns more closely with real-world prediction problems. Existing research mostly encodes entities and relations using sequential graph neural networks applied to recent snapshots. However, these approaches tend to overlook the ability to skip irrelevant snapshots according to entity-related relations in the query and disregard the importance of explicit temporal information. To address this, we propose our model, Re-Temp (Relation-Aware Temporal Representation Learning), which leverages explicit temporal embedding as input and incorporates skip information flow after each timestamp to skip unnecessary information for prediction. Additionally, we introduce a two-phase forward propagation method to prevent information leakage. Through the evaluation on six TKGC (extrapolation) datasets, we demonstrate that our model outperforms all eight recent state-of-the-art models by a significant margin.


title: Data Processing Engine (DPE): Data Analysis Tool for Particle Tracking and Mixed Radiation Field Characterization with Pixel Detectors Timepix

abstract: Hybrid semiconductor pixelated detectors from the Timepix family are advanced detectors for online particle tracking, offering energy measurement and precise time stamping capabilities for particles of various types and energies. This inherent capability makes them highly suitable for various applications, including imaging, medical fields such as radiotherapy and particle therapy, space-based applications aboard satellites and the International Space Station, and industrial applications. The data generated by these detectors is complex, necessitating the development and deployment of various analytical techniques to extract essential information. For this purpose, and to aid the Timepix user community, it was designed and developed the "Data Processing Engine" (DPE) as an advanced tool for data processing designed explicitly for Timepix detectors. The functionality of the DPE is structured into three distinct processing levels: i) Pre-processing: This phase involves clusterization and the application of necessary calibrations and corrections. ii) Processing: This stage includes particle classification, employing machine learning algorithms, and the recognition of radiation fields. iii) Post-processing: Involves various analyses, such as directional analysis, coincidence analysis, frame analysis, Compton directional analysis, and the generation of physics products, are performed. The core of the DPE is supported by an extensive experimental database containing calibrations and referential radiation fields of typical environments, including protons, ions, electrons, gamma rays and X-rays, as well as thermal and fast neutrons. To enhance accessibility, the DPE is implemented into various user interface platforms such as a command-line tool, an application programming interface, and as a graphical user interface in the form of a web portal.


title: Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules

abstract: Pre-trained language models (PLMs) have achieved remarkable results on NLP tasks but at the expense of huge parameter sizes and the consequent computational costs. In this paper, we propose Variator, a parameter-efficient acceleration method that enhances computational efficiency through plug-and-play compression plugins. Compression plugins are designed to reduce the sequence length via compressing multiple hidden vectors into one and trained with original PLMs frozen. Different from traditional model acceleration methods, which compress PLMs to smaller sizes, Variator offers two distinct advantages: (1) In real-world applications, the plug-and-play nature of our compression plugins enables dynamic selection of different compression plugins with varying acceleration ratios based on the current workload. (2) The compression plugin comprises a few compact neural network layers with minimal parameters, significantly saving storage and memory overhead, particularly in scenarios with a growing number of tasks. We validate the effectiveness of Variator on seven datasets. Experimental results show that Variator can save 53% computational costs using only 0.9% additional parameters with a performance drop of less than 2%. Moreover, when the model scales to billions of parameters, Variator matches the strong performance of uncompressed PLMs.


title: Ranking-based Adaptive Query Generation for DETRs in Crowded Pedestrian Detection

abstract: DEtection TRansformer (DETR) and its variants (DETRs) have been successfully applied to crowded pedestrian detection, which achieved promising performance. However, we find that, in different degrees of crowded scenes, the number of DETRs' queries must be adjusted manually, otherwise, the performance would degrade to varying degrees. In this paper, we first analyze the two current query generation methods and summarize four guidelines for designing the adaptive query generation method. Then, we propose Rank-based Adaptive Query Generation (RAQG) to alleviate the problem. Specifically, we design a rank prediction head that can predict the rank of the lowest confidence positive training sample produced by the encoder. Based on the predicted rank, we design an adaptive selection method that can adaptively select coarse detection results produced by the encoder to generate queries. Moreover, to train the rank prediction head better, we propose Soft Gradient L1 Loss. The gradient of Soft Gradient L1 Loss is continuous, which can describe the relationship between the loss value and the updated value of model parameters granularly. Our method is simple and effective, which can be plugged into any DETRs to make it query-adaptive in theory. The experimental results on Crowdhuman dataset and Citypersons dataset show that our method can adaptively generate queries for DETRs and achieve competitive results. Especially, our method achieves state-of-the-art 39.4% MR on Crowdhuman dataset.


title: Uniqueness of conservative solutions to the the modified Camassa-Holm equation via Characteristics

abstract: In this paper,for a given conservative solution, we introduce a set of auxiliary variables tailored to this particular solution, and prove that these variables satisfy a particular semilinear system having unique solutions. In turn, we get the uniqueness of the conservative solution in the original variables.


title: Towards Assume-Guarantee Verification of Strategic Ability

abstract: Formal verification of strategic abilities is a hard problem. We propose to use the methodology of assume-guarantee reasoning in order to facilitate model checking of alternating-time temporal logic with imperfect information and imperfect recall.


title: On the minimal model of kinetic cooperativity. The case of glucokinase

abstract: The minimal 3-state scheme of kinetic cooperativity of monomeric enzymes is subjected to detailed analysis. The rigorous criteria of positive cooperativity and its sigmoidal version are established in terms of the system parameters (rate constants). It is shown that the cooperativity extent is especially sensitive to the rates and direction of the exchange between conformational states of the free enzyme. However, no necessity of the "kinetic resonance" (or, moreover, its generality claimed recently) for enhancing cooperativity is revealed. Overall, while the minimal 3-state model serves well for qualitative understanding the origin of kinetic cooperativity, it is hardly suitable for quantitative describing reactions of real enzymes, as it is shown with the case of glucokinase.


title: Phenotype selection due to mutational robustness

abstract: Darwinian evolution gives rise not only to the adaptation to the environment but also to the enhancement of the robustness against mutation. Suppose more than one phenotypes share the same fitness value. We expect that some phenotypes are hardly selected as a consequence of the selection bias for mutational robustness. We investigated this phenotype selection for a model of gene regulatory networks (GRNs). We constructed the randomly generated set of GRNs using the multicanonical Monte Carlo method and compared it to the outcomes of evolutionary simulations. The results suggest that the mutationally least robust phenotype is suppressed in evolution.


title: A multiparametric Murnaghan-Nakayama rule for Macdonald polynomials

abstract: We introduce a new family of operators as multi-parameter deformation of the one-row Macdonald polynomials. The matrix coefficients of these operators acting on the space of symmetric functions with rational coefficients in two parameters $q,t$ (denoted by $\Lambda[q,t]$) are computed by assigning some values to skew Macdonald polynomials in $\lambda$-ring notation. The new rule is utilized to provide new iterative formulas and also recover various existing formulas in a unified manner. Specifically the following applications are discussed: (i) A $(q,t)$-Murnaghan-Nakayama rule for Macdonald functions is given as a generalization of the $q$-Murnaghan-Nakayama rule; (ii) An iterative formula for the $(q,t)$-Green polynomial is deduced; (iii) A simple proof of the Murnaghan-Nakayama rule for the Hecke algebra and the Hecke-Clifford algebra is offered; (iv) A combinatorial inversion of the Pieri rule for Hall-Littlewood functions is derived with the help of the vertex operator realization of the Hall-Littlewood functions; (v) Two iterative formulae for the $(q,t)$-Kostka polynomials $K_{\lambda\mu}(q,t)$ are obtained from the dual version of our multiparametric Murnaghan-Nakayama rule, one of which yields an explicit formula for arbitrary $\lambda$ and $\mu$ in terms of the generalized $(q, t)$-binomial coefficient introduced independently by Lassalle and Okounkov.


title: Euclid preparation. TBD. Forecast impact of super-sample covariance on 3x2pt analysis with Euclid

abstract: Deviations from Gaussianity in the distribution of the fields probed by large-scale structure surveys generate additional terms in the data covariance matrix, increasing the uncertainties in the measurement of the cosmological parameters. Super-sample covariance (SSC) is among the largest of these non-Gaussian contributions, with the potential to significantly degrade constraints on some of the parameters of the cosmological model under study -- especially for weak lensing cosmic shear. We compute and validate the impact of SSC on the forecast uncertainties on the cosmological parameters for the Euclid photometric survey, obtained with a Fisher matrix analysis, both considering the Gaussian covariance alone and adding the SSC term -- computed through the public code PySSC. The photometric probes are considered in isolation and combined in the `3$\times$2pt' analysis. We find the SSC impact to be non-negligible -- halving the Figure of Merit of the dark energy parameters ($w_0$, $w_a$) in the 3$\times$2pt case and substantially increasing the uncertainties on $\Omega_{{\rm m},0}, w_0$, and $\sigma_8$ for cosmic shear; photometric galaxy clustering, on the other hand, is less affected due to the lower probe response. The relative impact of SSC does not show significant changes under variations of the redshift binning scheme, while it is smaller for weak lensing when marginalising over the multiplicative shear bias nuisance parameters, which also leads to poorer constraints on the cosmological parameters. Finally, we explore how the use of prior information on the shear and galaxy bias changes the SSC impact. Improving shear bias priors does not have a significant impact, while galaxy bias must be calibrated to sub-percent level to increase the Figure of Merit by the large amount needed to achieve the value when SSC is not included.


title: Log prismatic Dieudonn\'e theory for log $p$-divisible groups over $\mathcal{O}_{K}$

abstract: Let $\mathcal{O}_{K}$ be a complete discrete valuation ring of mixed characteristic with perfect residue field, endowed with its canonical log-structure. We prove that log $p$-divisible groups over $\mathcal{O}_{K}$ correspond to Dieudonn\'e crystals on the absolute log-prismatic site of $\mathcal{O}_{K}$ endowed with the Kummer log-flat topology. The proof uses log-descent to reduce the problem to the classical prismatic correspondence, recently established by Ansch\"utz-Le Bras.


title: Supernova Ejecta with Crystalline Silicate Dust in the Supernova Remnant MSH 15-52

abstract: IRAS 15099-5856 in the young supernova remnant (SNR) MSH 15-52 is the first and only SNR-associated object with crystalline silicate dust detected so far, although its nature and the origin of the crystalline silicate are still unclear. In this paper, we present high-resolution mid-infrared (MIR) imaging observations of the bright central compact source IRS1 of IRAS 15099-5856 to study the spatial distributions of gas and dust and the analysis of its Spitzer MIR spectrum to explore the origin of IRS1. The MIR images obtained with the T-ReCS attached on the Gemini South telescope show a complicated, inhomogeneous morphology of IRS1 with bright clumps and diffuse emission in [Ne II] 12.81 $\mu$m and Qa 18.30 $\mu$m, which confirms that IRS1 is an extended source externally heated by the nearby O star Muzzio 10, a candidate for the binary companion of the progenitor star. The Spitzer MIR spectrum reveals several ionic emission lines including a strong [Ne II] 12.81 $\mu$m line, but no hydrogen line is detected. We model the spectrum using the photoionization code CLOUDY with varying elemental composition. The elemental abundance of IRS1 derived from the model is close to that of SN ejecta with depleted hydrogen and enhanced metals, particularly neon, argon, and iron. Our results imply that IRS1 originates from the SN ejecta and suggest the possibility of the formation of crystalline silicate in newly-formed SN dust.


title: Nanoscale transient polarization gratings

abstract: We present the generation of transient polarization gratings at the nanoscale, achieved using a tailored accelerator configuration of the FERMI free electron laser. We demonstrate the capabilities of such a transient polarization grating by comparing its induced dynamics with the ones triggered by a more conventional intensity grating on a thin film ferrimagnetic alloy. While the signal of the intensity grating is dominated by the thermoelastic response of the system, such a contribution is suppressed in the case of the polarization grating. This exposes helicity-dependent magnetization dynamics that have so-far remained hidden under the large thermally driven response. We anticipate nanoscale transient polarization gratings to become useful for the study of any physical, chemical and biological systems possessing chiral symmetry.


title: The Quantum Monadology

abstract: The modern theory of functional programming languages uses monads for encoding computational side-effects and side-contexts, beyond bare-bone program logic. Even though quantum computing is intrinsically side-effectful (as in quantum measurement) and context-dependent (as on mixed ancillary states), little of this monadic paradigm has previously been brought to bear on quantum programming languages. Here we systematically analyze the (co)monads on categories of parameterized module spectra which are induced by Grothendieck's "motivic yoga of operations" -- for the present purpose specialized to HC-modules and further to set-indexed complex vector spaces. Interpreting an indexed vector space as a collection of alternative possible quantum state spaces parameterized by quantum measurement results, as familiar from Proto-Quipper-semantics, we find that these (co)monads provide a comprehensive natural language for functional quantum programming with classical control and with "dynamic lifting" of quantum measurement results back into classical contexts. We close by indicating a domain-specific quantum programming language (QS) expressing these monadic quantum effects in transparent do-notation, embeddable into the recently constructed Linear Homotopy Type Theory (LHoTT) which interprets into parameterized module spectra. Once embedded into LHoTT, this should make for formally verifiable universal quantum programming with linear quantum types, classical control, dynamic lifting, and notably also with topological effects.

categories: quant-ph math-ph math.AT math.CT math.MP


title: Excitons and singlet fission at hybrid inorganic-organic semiconductor interfaces

abstract: Excitons in organic crystalline semiconductors play a crucial role in the operation of optoelectronic devices such as organic solar cells, light-emitting diodes, and photodetectors. The excitonic properties of materials are dramatically affected by the presence of surfaces and interfaces. In this work, we investigate the influence of a neutral hydrogen-passivated 1x2 reconstructed (100) silicon substrate on excitons within the crystalline tetracene layer deposited on the top of it. Our findings reveal that singlet excitons in the contact tetracene layer are situated within the continuum of unbound Wannier-Mott excitonic states in silicon, with noteworthy hybridization between these states. Consequently, in the contact tetracene layer, all singlet excitons exhibit a pronounced interlayer charge transfer character, while the triplet exciton remains confined to the tetracene layer. This makes the singlet fission effect highly improbable for the contact tetracene layer. Additionally, the presence of the silicon substrate results in a modification of the singlet-triplet gap by 144 meV. This change is solely attributed to the hybridization with excitons in silicon, which influences the exchange energy. Our results show that the dynamic dielectric screening caused by the substrate does not impact the singlet-triplet gap but alters the exciton binding energies.


abstract: Semantic communication, rather than on a bit-by-bit recovery of the transmitted messages, focuses on the meaning and the goal of the communication itself. In this paper, we propose a novel semantic image coding scheme that preserves the semantic content of an image, while ensuring a good trade-off between coding rate and image quality. The proposed Semantic-Preserving Image Coding based on Conditional Diffusion Models (SPIC) transmitter encodes a Semantic Segmentation Map (SSM) and a low-resolution version of the image to be transmitted. The receiver then reconstructs a high-resolution image using a Denoising Diffusion Probabilistic Models (DDPM) doubly conditioned to the SSM and the low-resolution image. As shown by the numerical examples, compared to state-of-the-art (SOTA) approaches, the proposed SPIC exhibits a better balance between the conventional rate-distortion trade-off and the preservation of semantically-relevant features. Code available at https://github.com/frapez1/SPIC


title: Wobbling kinks and shape mode interactions in a coupled two-component $\phi^4$ theory

abstract: The dynamics of a wobbling kink in a two-component coupled $\phi^4$ scalar field theory (with an excited orthogonal shape mode) is addressed. For this purpose, the vibration spectrum of the second order small kink fluctuation is studied in order to find the corresponding vibration modes associated to the first (longitudinal) and second (orthogonal) field components. By means of this analysis, it was found that the number of possible shape modes depends on the value of the coupling constant. It is notable that when one of the orthogonal field shape modes is initially triggered, the unique shape mode of the longitudinal field is also activated. This coupling causes the kink to emit radiation with twice the frequency of excited mode in the first field component. Meanwhile, in the orthogonal channel we find radiation with two different frequencies: one is three times the frequency of the orthogonal wobbling mode and another is the sum of the frequencies of the longitudinal shape mode and the triggered mode. All the analytical results obtained in this study have been successfully contrasted with those obtained through numerical simulations.


title: A counterexample to parabolic dichotomies in holomorphic iteration

abstract: We give an example of a parabolic holomorphic self-map $f$ of the unit ball $\mathbb B^2\subset \mathbb C^2$ whose canonical Kobayashi hyperbolic semi-model is given by an elliptic automorphism of the disc $\mathbb D\subset \mathbb C$, which can be chosen to be different from the identity. As a consequence, in contrast to the one dimensional case, this provides a first example of a holomorphic self-map of the unit ball which has points with zero hyperbolic step and points with nonzero hyperbolic step, solving an open question and showing that parabolic dynamics in the ball $\\mathbb B^2$ is radically different from parabolic dynamics in the disc. The example is obtained via a geometric method, embedding the ball $\mathbb B^2$ as a domain $\Omega$ in the bidisc $\\mathbb D\times \mathbb{H}$ that is forward invariant and absorbing for the map $(z,w)\mapsto (e^{i\theta}z,w+1)$, where $\mathbb H\subset \mathbb C$ denotes the right half-plane. We also show that a complete Kobayashi hyperbolic domain $\Omega$ with such properties cannot be Gromov hyperbolic w.r.t. the Kobayashi distance (hence, it cannot be biholomorphic to $\\mathbb B^2$) if an additional quantitative geometric condition is satisfied.


title: Non-Equilibrium Pathways for Excitation of Bulk and Surface Phonons through Anharmonic Coupling

abstract: Upon impulsive optical excitation of solid-state materials, the non-equilibrium flow of energy from the excited electronic system to the lattice degrees of freedom typically happens in a few picoseconds. Here we identified the surface of thin Bi films grown on Si(001) as an additional subsystem which is excited much slower on a 100 ps timescale that is caused by decoupling due to mismatched phonon dispersions relations of bulk and surface. Anharmonic coupling among the phonon systems provides pathways for excitations which exhibits a 1/T-dependence causing a speed-up of surface excitation at higher temperatures. A quantitative justification is provided by phonon Umklapp processes from lattice thermal conductivity of the Bi bulk. Three-temperature model simulations reveal a pronounced non-equilibrium situation up to nanoseconds: initially, the surface is colder than the bulk, that situation is then inverted during cooling and the surface feeds energy back into the bulk phonon system.


title: Interpretable Medical Image Classification using Prototype Learning and Privileged Information

abstract: Interpretability is often an essential requirement in medical imaging. Advanced deep learning methods are required to address this need for explainability and high performance. In this work, we investigate whether additional information available during the training process can be used to create an understandable and powerful model. We propose an innovative solution called Proto-Caps that leverages the benefits of capsule networks, prototype learning and the use of privileged information. Evaluating the proposed solution on the LIDC-IDRI dataset shows that it combines increased interpretability with above state-of-the-art prediction performance. Compared to the explainable baseline model, our method achieves more than 6 % higher accuracy in predicting both malignancy (93.0 %) and mean characteristic features of lung nodules. Simultaneously, the model provides case-based reasoning with prototype representations that allow visual validation of radiologist-defined attributes.


title: Improving Diffusion Models for ECG Imputation with an Augmented Template Prior

abstract: Pulsative signals such as the electrocardiogram (ECG) are extensively collected as part of routine clinical care. However, noisy and poor-quality recordings are a major issue for signals collected using mobile health systems, decreasing the signal quality, leading to missing values, and affecting automated downstream tasks. Recent studies have explored the imputation of missing values in ECG with probabilistic time-series models. Nevertheless, in comparison with the deterministic models, their performance is still limited, as the variations across subjects and heart-beat relationships are not explicitly considered in the training objective. In this work, to improve the imputation and forecasting accuracy for ECG with probabilistic models, we present a template-guided denoising diffusion probabilistic model (DDPM), PulseDiff, which is conditioned on an informative prior for a range of health conditions. Specifically, 1) we first extract a subject-level pulsative template from the observed values to use as an informative prior of the missing values, which personalises the prior; 2) we then add beat-level stochastic shift terms to augment the prior, which considers variations in the position and amplitude of the prior at each beat; 3) we finally design a confidence score to consider the health condition of the subject, which ensures our prior is provided safely. Experiments with the PTBXL dataset reveal that PulseDiff improves the performance of two strong DDPM baseline models, CSDI and SSSD$^{S4}$, verifying that our method guides the generation of DDPMs while managing the uncertainty. When combined with SSSD$^{S4}$, PulseDiff outperforms the leading deterministic model for short-interval missing data and is comparable for long-interval data loss.


title: RAPL: A Relation-Aware Prototype Learning Approach for Few-Shot Document-Level Relation Extraction

abstract: How to identify semantic relations among entities in a document when only a few labeled documents are available? Few-shot document-level relation extraction (FSDLRE) is crucial for addressing the pervasive data scarcity problem in real-world scenarios. Metric-based meta-learning is an effective framework widely adopted for FSDLRE, which constructs class prototypes for classification. However, existing works often struggle to obtain class prototypes with accurate relational semantics: 1) To build prototype for a target relation type, they aggregate the representations of all entity pairs holding that relation, while these entity pairs may also hold other relations, thus disturbing the prototype. 2) They use a set of generic NOTA (none-of-the-above) prototypes across all tasks, neglecting that the NOTA semantics differs in tasks with different target relation types. In this paper, we propose a relation-aware prototype learning method for FSDLRE to strengthen the relational semantics of prototype representations. By judiciously leveraging the relation descriptions and realistic NOTA instances as guidance, our method effectively refines the relation prototypes and generates task-specific NOTA prototypes. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches by average 2.61% $F_1$ across various settings of two FSDLRE benchmarks.


title: Analyzing Single Cell RNA Sequencing with Topological Nonnegative Matrix Factorization

abstract: Single-cell RNA sequencing (scRNA-seq) is a relatively new technology that has stimulated enormous interest in statistics, data science, and computational biology due to the high dimensionality, complexity, and large scale associated with scRNA-seq data. Nonnegative matrix factorization (NMF) offers a unique approach due to its meta-gene interpretation of resulting low-dimensional components. However, NMF approaches suffer from the lack of multiscale analysis. This work introduces two persistent Laplacian regularized NMF methods, namely, topological NMF (TNMF) and robust topological NMF (rTNMF). By employing a total of 12 datasets, we demonstrate that the proposed TNMF and rTNMF significantly outperform all other NMF-based methods. We have also utilized TNMF and rTNMF for the visualization of popular Uniform Manifold Approximation and Projection (UMAP) and t-distributed stochastic neighbor embedding (t-SNE).


title: Integrating Battery-Less Energy Harvesting Devices in Multi-hop Industrial Wireless Sensor Networks

abstract: Industrial wireless sensor networks enable real-time data collection, analysis, and control by interconnecting diverse industrial devices. In these industrial settings, power outlets are not always available, and reliance on battery power can be impractical due to the need for frequent battery replacement or stringent safety regulations. Battery-less energy harvesters present a suitable alternative for powering these devices. However, these energy harvesters, equipped with supercapacitors instead of batteries, suffer from intermittent on-off behavior due to their limited energy storage capacity. As a result, they struggle with extended or frequent energy-consuming phases of multi-hop network formation, such as network joining and synchronization. To address these challenges, our work proposes three strategies for integrating battery-less energy harvesting devices into industrial multi-hop wireless sensor networks. In contrast to other works, our work prioritizes the mitigation of intermittency-related issues, rather than focusing solely on average energy consumption, as is typically the case with battery-powered devices. For each of the proposed strategies, we provide an in-depth discussion of their suitability based on several critical factors, including the type of energy source, storage capacity, device mobility, latency, and reliability.


title: Failures Pave the Way: Enhancing Large Language Models through Tuning-free Rule Accumulation

abstract: Large Language Models (LLMs) have showcased impressive performance. However, due to their inability to capture relationships among samples, these frozen LLMs inevitably keep repeating similar mistakes. In this work, we propose our Tuning-free Rule Accumulation (TRAN) framework, which guides LLMs in improving their performance by learning from previous mistakes. Considering data arrives sequentially, LLMs gradually accumulate rules from incorrect cases, forming a rule collection. These rules are then utilized by the LLMs to avoid making similar mistakes when processing subsequent inputs. Moreover, the rules remain independent of the primary prompts, seamlessly complementing prompt design strategies. Experimentally, we show that TRAN improves over recent baselines by a large margin.


title: Large Language Models are Temporal and Causal Reasoners for Video Question Answering

abstract: Large Language Models (LLMs) have shown remarkable performances on a wide range of natural language understanding and generation tasks. We observe that the LLMs provide effective priors in exploiting $\textit{linguistic shortcuts}$ for temporal and causal reasoning in Video Question Answering (VideoQA). However, such priors often cause suboptimal results on VideoQA by leading the model to over-rely on questions, $\textit{i.e.}$, $\textit{linguistic bias}$, while ignoring visual content. This is also known as `ungrounded guesses' or `hallucinations'. To address this problem while leveraging LLMs' prior on VideoQA, we propose a novel framework, Flipped-VQA, encouraging the model to predict all the combinations of $\langle$V, Q, A$\rangle$ triplet by flipping the source pair and the target label to understand their complex relationships, $\textit{i.e.}$, predict A, Q, and V given a VQ, VA, and QA pairs, respectively. In this paper, we develop LLaMA-VQA by applying Flipped-VQA to LLaMA, and it outperforms both LLMs-based and non-LLMs-based models on five challenging VideoQA benchmarks. Furthermore, our Flipped-VQA is a general framework that is applicable to various LLMs (OPT and GPT-J) and consistently improves their performances. We empirically demonstrate that Flipped-VQA not only enhances the exploitation of linguistic shortcuts but also mitigates the linguistic bias, which causes incorrect answers over-relying on the question. Code is available at https://github.com/mlvlab/Flipped-VQA.


title: On the complement to a real caustic germ of type $E_6$

abstract: We prove that the complement to the caustic of a stable Lagrangian map germ of type $E_6^\pm$ has seven connected components, six of which are contractible and one is homotopy equivalent to a circle. The inverse image of the noncontractible component under this map has three connected components. The restriction of the map to one of them is a two-sheeted covering; the restriction to each of the other two is a diffeomorphism. The table of adjacency indexes of type $E_6^\pm$ monosingularity to multisingularities of a generic Lagrangian map is given.


title: Ill-posedness for the Cauchy problem of the modified Camassa-Holm equation in $B^0_{\infty,1}$

abstract: In this paper, we prove the norm inflation and get the ill-posedness for the modified Camassa-Holm equation in $B_{\infty,1}^0$. Therefore we completed all well-posedness and ill-posedness problem for the modified Camassa-Holm equation in all critical spaces $B_{p,1}^\frac{1}{p}$ with $p\in[1,\infty]$.


title: Neuromorphic Sampling of Sparse Signals

abstract: Neuromorphic sampling is a bioinspired and opportunistic analog-to-digital conversion technique, where the measurements are recorded only when there is a significant change in the signal amplitude. Neuromorphic sampling has paved the way for a new class of vision sensors called event cameras or dynamic vision sensors (DVS), which consume low power, accommodate a high-dynamic range, and provide sparse measurements with high temporal resolution making it convenient for downstream inference tasks. In this paper, we consider neuromorphic sensing of signals with a finite rate of innovation (FRI), including a stream of Dirac impulses, sum of weighted and time-shifted pulses, and piecewise-polynomial functions. We consider a sampling-theoretic approach and leverage the close connection between neuromorphic sensing and time-based sampling, where the measurements are encoded temporally. Using Fourier-domain analysis, we show that perfect signal reconstruction is possible via parameter estimation using high-resolution spectral estimation methods. We develop a kernel-based sampling approach, which allows for perfect reconstruction with a sample complexity equal to the rate of innovation of the signal. We provide sufficient conditions on the parameters of the neuromorphic encoder for perfect reconstruction. Furthermore, we extend the analysis to multichannel neuromorphic sampling of FRI signals, in the single-input multi-output (SIMO) and multi-input multi-output (MIMO) configurations. We show that the signal parameters can be jointly estimated using multichannel measurements. Experimental results are provided to substantiate the theoretical claims.


title: Gradient-Based Eigenvalue Optimization for Electromagnetic Cavities with Built-in Mode Matching

abstract: Shape optimization with respect to eigenvalues of a cavity plays an important role in the design of new resonators or in the optimization of existing ones. In our paper, we propose a gradient-based optimization scheme, which we enhance with closed-form shape derivatives of the system matrices. Based on these, we can compute accurate derivatives of eigenvalues, eigenmodes and the cost function with respect to the geometry, which significantly reduces the computational effort of the optimizer. We demonstrate our work by applying it to the 9-cell TESLA cavity, for which we tune the design parameters of the computational model to match the design criteria for devices in realistic use cases. Since eigenvalues may cross during the shape optimization of a cavity, we propose a new algorithm based on an eigenvalue matching procedure, to ensure the optimization of the desired mode in order to also enable successful matching along large shape variations.


title: Integrating Language Models into Direct Speech Translation: An Inference-Time Solution to Control Gender Inflection

abstract: When translating words referring to the speaker, speech translation (ST) systems should not resort to default masculine generics nor rely on potentially misleading vocal traits. Rather, they should assign gender according to the speakers' preference. The existing solutions to do so, though effective, are hardly feasible in practice as they involve dedicated model re-training on gender-labeled ST data. To overcome these limitations, we propose the first inference-time solution to control speaker-related gender inflections in ST. Our approach partially replaces the (biased) internal language model (LM) implicitly learned by the ST decoder with gender-specific external LMs. Experiments on en->es/fr/it show that our solution outperforms the base models and the best training-time mitigation strategy by up to 31.0 and 1.6 points in gender accuracy, respectively, for feminine forms. The gains are even larger (up to 32.0 and 3.4) in the challenging condition where speakers' vocal traits conflict with their gender.


title: Efficient CPU-Optimized Parameter Estimation for Modeling Fish Schooling Behavior in Large Particle Systems

abstract: The schooling behavior of fish can be studied through simulations involving a large number of interacting particles. In such systems, each individual particle is guided by behavior rules, which include aggregation towards a centroid, collision avoidance, and direction alignment. The movement vector of each particle may be expressed as a linear combination of behaviors, with unknown parameters that define a trade-off among several behavioral constraints. A fitness function for collective schooling behavior encompasses all individual particle parameters. For a large number of interacting particles in a complex environment, heuristic methods, such as evolutionary algorithms, are used to optimize the fitness function, ensuring that the resulting decision rule preserves collective behavior. However, these algorithms exhibit slow convergence, making them inefficient in terms of CPU time cost. This paper proposes a CPU-efficient iterative (Cluster, Partition, Refine -- CPR) algorithm for estimating decision rule parameters for a large number of interacting particles. In the first step, we employ the K-Means (unsupervised learning) algorithm to cluster candidate solutions. Then, we partition the search space using Voronoi tessellation over the defined clusters. We assess the quality of each cluster based on the fitness function, with the centroid of their Voronoi cells representing the clusters. Subsequently, we refine the search space by introducing new cells into a number of identified well-fitting Voronoi cells. This process is repeated until convergence. A comparison of the performance of the CPR algorithm with a standard Genetic Algorithm reveals that the former converges faster than the latter. We also demonstrate that the application of the CPR algorithm results in a schooling behavior consistent with empirical observations.


title: Linear MIM-width of the Square of Trees

abstract: Graph parameters measure the amount of structure (or lack thereof) in a graph that makes it amenable to being decomposed in a way that facilitates dynamic programming. Graph decompositions and their associated parameters are important both in practice (as a tool for designing robust algorithms for NP-hard problems) and in theory (relating large classes of problems to the graphs on which they are solvable in polynomial time). Linear MIM-width is a variant of the graph parameter MIM-width, introduced by Vatshelle. MIM-width is a parameter that is constant for many classes of graphs. Most graph classes which have been shown to have constant MIM-width also have constant linear MIM-width. However, computing the (linear) MIM-width of graphs, or showing that it is hard, has proven to be a huge challenge. To date, the only graph class with unbounded linear MIM-width, whose linear MIM-width can be computed in polynomial time, is the trees. In this follow-up, we show that for any tree $T$ with linear MIM-width $k$, the linear MIM-width of its square $T^2$ always lies between $k$ and $2k$, and that these bounds are tight for all $k$.


title: A necessary and sufficient condition for the existence of chaotic dynamics in an overlapping generations model

abstract: In this paper, we study economic dynamics in a standard overlapping generations model without production. In particular, using numerical methods, we obtain a necessary and sufficient condition for the existence of a topological chaos. This is a new application of a recent result characterising the existence of a topological chaos for a unimodal interval map by Deng, Khan, Mitra (2022).


title: On the Low-SNR Asymptotic Capacity of Two Types of Optical Wireless Channels under Average-Intensity Constraints

abstract: In this paper, we study two types of optical wireless channels under average-intensity constraints. One is called the Gaussian optical intensity channel, where the channel output models the converted electrical current corrupted by the additive white Gaussian noise. The other one is the Poisson optical intensity channel, where the channel output models the number of received photons corrupted by the positive dark current. When the average input intensity $\mathcal{E}$ is small, the capacity of the Gaussian optical intensity channel is shown to scale as $\mathcal{E}\sqrt{\frac{\log\frac{1}{\mathcal{E}}}{2}}$, and the capacity of the Poisson optical intensity channel as $\mathcal{E}\log\log\frac{1}{\mathcal{E}}$, which close the existing capacity gaps in these two channels.


title: Do Differences in Values Influence Disagreements in Online Discussions?

abstract: Disagreements are common in online discussions. Disagreement may foster collaboration and improve the quality of a discussion under some conditions. Although there exist methods for recognizing disagreement, a deeper understanding of factors that influence disagreement is lacking in the literature. We investigate a hypothesis that differences in personal values are indicative of disagreement in online discussions. We show how state-of-the-art models can be used for estimating values in online discussions and how the estimated values can be aggregated into value profiles. We evaluate the estimated value profiles based on human-annotated agreement labels. We find that the dissimilarity of value profiles correlates with disagreement in specific cases. We also find that including value information in agreement prediction improves performance.


title: Learning From Free-Text Human Feedback -- Collect New Datasets Or Extend Existing Ones?

abstract: Learning from free-text human feedback is essential for dialog systems, but annotated data is scarce and usually covers only a small fraction of error types known in conversational AI. Instead of collecting and annotating new datasets from scratch, recent advances in synthetic dialog generation could be used to augment existing dialog datasets with the necessary annotations. However, to assess the feasibility of such an effort, it is important to know the types and frequency of free-text human feedback included in these datasets. In this work, we investigate this question for a variety of commonly used dialog datasets, including MultiWoZ, SGD, BABI, PersonaChat, Wizards-of-Wikipedia, and the human-bot split of the Self-Feeding Chatbot. Using our observations, we derive new taxonomies for the annotation of free-text human feedback in dialogs and investigate the impact of including such data in response generation for three SOTA language generation models, including GPT-2, LLAMA, and Flan-T5. Our findings provide new insights into the composition of the datasets examined, including error types, user response types, and the relations between them.


title: 2D excitation information by MPS method on infinite helixes

abstract: Understanding the excitation spectrum in two-dimensional quantum many-body systems has long been a challenging task. We present an approach by introducing an excitation ansatz based on an infinite matrix product state (MPS) on a helix structure. With the canonical form of MPS states, we can accurately extract key properties such as energy, degeneracy, spectrum weight, and scaling behavior of low-energy excited states simultaneously. To validate the effectiveness of this method, we begin by applying it to the critical point of the transverse-field Ising model. The extracted scaling exponent of the energy gap closely aligns with the conformal bootstrap results. Subsequently, we apply this approach to the $J_1$-$J_2$ Heisenberg model on a square lattice. We discover that the degeneracy of lowest-energy excitations serves as a reliable metric for distinguishing different phases. The phase boundary identified by our method is consistent with some of the previous findings. The present method provides a promising avenue for studying the excitation spectrum of two-dimensional quantum many-body systems.


title: Improved action for contact effective field theory

abstract: We present an improved action for renormalizable effective field theories (EFTs) of systems near the two-body unitarity limit. The ordering of EFT interactions is constrained, but not entirely fixed, by the renormalization group. The remaining freedom can be used to improve the theory's convergence, to simplify its applications, and to connect it to phenomenological models. We exemplify the method on a contact theory applied to systems of up to five $^4$He atoms. We solve the EFT at leading order including a subleading interaction that accounts for part of the two-body effective range. We show that the effects of such fake range can be compensated in perturbation theory at next-to-leading order, as long as the fake range is smaller or comparable to the experimental effective range. These results open the possibility of using similar improved actions for other many-body systems.

categories: physics.atm-clus cond-mat.quant-gas nucl-th physics.atom-ph


title: Agent-based models of social behaviour and communication in evacuations: A systematic review

abstract: Most modern agent-based evacuation models involve interactions between evacuees. However, the assumed reasons for interactions and portrayal of them may be overly simple. Research from social psychology suggests that people interact and communicate with one another when evacuating and evacuee response is impacted by the way information is communicated. Thus, we conducted a systematic review of agent-based evacuation models to identify 1) how social interactions and communication approaches between agents are simulated, and 2) what key variables related to evacuation are addressed in these models. We searched Web of Science and ScienceDirect to identify articles that simulated information exchange between agents during evacuations, and social behaviour during evacuations. From the final 70 included articles, we categorised eight types of social interaction that increased in social complexity from collision avoidance to social influence based on strength of social connections with other agents. In the 17 models which simulated communication, we categorised four ways that agents communicate information: spatially through information trails or radii around agents, via social networks and via external communication. Finally, the variables either manipulated or measured in the models were categorised into the following groups: environmental condition, personal attributes of the agents, procedure, and source of information. We discuss promising directions for agent-based evacuation models to capture the effects of communication and group dynamics on evacuee behaviour. Moreover, we demonstrate how communication and group dynamics may impact the variables commonly used in agent-based evacuation models.


title: SharkGraph: A Time Series Distributed Graph System

abstract: Current graph systems can easily process billions of data, however when increased to exceed hundred billions, the performance decreases dramatically, time series data always be very huge, consequently computation on time series graphs still remains challenging nowadays. In current piece of work, we introduces SharkGraph, a (distributed file system) DFS-based time series graph system, used a novel storage structure (Time Series Graph Data File) TGF, By reading file stream to iterate graph computation, SharkGraph is able to execute batch graph query, simulation, data mining, or clustering algorithm on exceed hundred billions edge size industry graph. Through well defined experiments that shows SharkGraph performs well on large-scale graph processing, also can support time traversal for graphs, and recover state at any position in the timeline. By repeating experiments reported for existing distributed systems like GraphX, we demonstrate that SharkGraph can easily handle hundreds billions of data, rather than GraphX which met many problems such as memory issues and skewed distribution on graph traversal. Compared with other graph systems SharkGraph uses less memory and more efficiently to process the same graph.


title: Nonequilibrium thermodynamics perspectives for the monotonicity of the renormalization group flow

abstract: We investigate the monotonicity of the renormalization group (RG) flow from the perspectives of nonequilibrium thermodynamics. Applying the Martin-Siggia-Rose formalism to the Wilsonian RG transformation, we incorporate the RG flow equations manifestly in an effective action, where all coupling functions are dynamically promoted. As a result, we obtain an emergent holographic dual effective field theory, where an extra dimension appears from the Wilsonian RG transformation. We observe that Becchi-Rouet-Stora-Tyutin (BRST)-type transformations play an important role in the bulk effective action, which give rise to novel Ward identities for correlation functions between the renormalized coupling fields. As generalized fluctuation-dissipation theorems in the semiclassical nonequilibrium dynamics can be understood from the Ward identities of such BRST symmetries, we find essentially the same principle for the RG flow in the holographic dual effective field theory. Furthermore, we discuss how these ``nonequilibrium work identities" can be related to the monotonicity of the RG flow, for example, the $c-theorem$. In particular, we introduce an entropy functional for the dynamical coupling field and show that the production rate of the total entropy functional is always positive, indicating the irreversibility of the RG flow.


title: Debiasing, calibrating, and improving Semi-supervised Learning performance via simple Ensemble Projector

abstract: Recent studies on semi-supervised learning (SSL) have achieved great success. Despite their promising performance, current state-of-the-art methods tend toward increasingly complex designs at the cost of introducing more network components and additional training procedures. In this paper, we propose a simple method named Ensemble Projectors Aided for Semi-supervised Learning (EPASS), which focuses mainly on improving the learned embeddings to boost the performance of the existing contrastive joint-training semi-supervised learning frameworks. Unlike standard methods, where the learned embeddings from one projector are stored in memory banks to be used with contrastive learning, EPASS stores the ensemble embeddings from multiple projectors in memory banks. As a result, EPASS improves generalization, strengthens feature representation, and boosts performance. For instance, EPASS improves strong baselines for semi-supervised learning by 39.47\%/31.39\%/24.70\% top-1 error rate, while using only 100k/1\%/10\% of labeled data for SimMatch, and achieves 40.24\%/32.64\%/25.90\% top-1 error rate for CoMatch on the ImageNet dataset. These improvements are consistent across methods, network architectures, and datasets, proving the general effectiveness of the proposed methods. Code is available at https://github.com/beandkay/EPASS.


title: SAXO+ upgrade : second stage AO system end-to-end numerical simulations

abstract: SAXO+ is a proposed upgrade to SAXO, the AO system of the SPHERE instrument on the ESO Very Large Telescope. It will improve the capabilities of the instrument for the detection and characterization of young giant planets. It includes a second stage adaptive optics system composed of a dedicated near-infrared wavefront sensor and a deformable mirror. This second stage will remove the residual wavefront errors left by the current primary AO loop (SAXO). This paper focuses on the numerical simulations of the second stage (SAXO+) and concludes on the impact of the main AO parameters used to build the design strategy. Using an end-to-end AO simulation tool (COMPASS), we investigate the impact of several parameters on the performance of the AO system. We measure the performance in minimizing the star residuals in the coronagraphic image. The parameters that we study are : the second stage frequency, the photon flux on each WFS, the first stage gain and the DM number of actuators of the second stage. We show that the performance is improved by a factor 10 with respect to the current AO system (SAXO). The optimal second stage frequency is between 1 and 2 kHz under good observing conditions. In a red star case, the best SAXO+ performance is achieved with a low first stage gain of 0.05, which reduces the first stage rejection.


title: Robust Learning via Conditional Prevalence Adjustment

abstract: Healthcare data often come from multiple sites in which the correlations between confounding variables can vary widely. If deep learning models exploit these unstable correlations, they might fail catastrophically in unseen sites. Although many methods have been proposed to tackle unstable correlations, each has its limitations. For example, adversarial training forces models to completely ignore unstable correlations, but doing so may lead to poor predictive performance. Other methods (e.g. Invariant risk minimization [4]) try to learn domain-invariant representations that rely only on stable associations by assuming a causal data-generating process (input X causes class label Y ). Thus, they may be ineffective for anti-causal tasks (Y causes X), which are common in computer vision. We propose a method called CoPA (Conditional Prevalence-Adjustment) for anti-causal tasks. CoPA assumes that (1) generation mechanism is stable, i.e. label Y and confounding variable(s) Z generate X, and (2) the unstable conditional prevalence in each site E fully accounts for the unstable correlations between X and Y . Our crucial observation is that confounding variables are routinely recorded in healthcare settings and the prevalence can be readily estimated, for example, from a set of (Y, Z) samples (no need for corresponding samples of X). CoPA can work even if there is a single training site, a scenario which is often overlooked by existing methods. Our experiments on synthetic and real data show CoPA beating competitive baselines.


title: Unpaired MRI Super Resolution with Contrastive Learning

abstract: Magnetic resonance imaging (MRI) is crucial for enhancing diagnostic accuracy in clinical settings. However, the inherent long scan time of MRI restricts its widespread applicability. Deep learning-based image super-resolution (SR) methods exhibit promise in improving MRI resolution without additional cost. Due to lacking of aligned high-resolution (HR) and low-resolution (LR) MRI image pairs, unsupervised approaches are widely adopted for SR reconstruction with unpaired MRI images. However, these methods still require a substantial number of HR MRI images for training, which can be difficult to acquire. To this end, we propose an unpaired MRI SR approach that employs contrastive learning to enhance SR performance with limited HR training data. Empirical results presented in this study underscore significant enhancements in the peak signal-to-noise ratio and structural similarity index, even when a paucity of HR images is available. These findings accentuate the potential of our approach in addressing the challenge of limited HR training data, thereby contributing to the advancement of MRI in clinical applications.


title: Message-Cognizant Assistance and Feedback for the Gaussian Channel

abstract: A formula is derived for the capacity of the Gaussian channel with a benevolent message-cognizant rate-limited helper that provides a noncausal description of the noise to the encoder and decoder. This capacity is strictly larger than when the helper is message oblivious, with the difference being particularly pronounced at low signal-to-noise ratios. It is shown that in this setup, a feedback link from the receiver to the encoder does not increase capacity. However, in the presence of such a link, said capacity can be achieved even if the helper is oblivious to the transmitted message.


title: Local-ECM: An empirical cubature hyper-reduction method adapted to local reduced order models

abstract: We present the Local Empirical Cubature Method (Local-ECM), a novel algorithm tailored for creating efficient integration rules, particularly addressing clusters of intrinsically distinct functions, as observed in local reduced-order models. Local-ECM seeks to enhance existing empirical cubature methodologies by harnessing the locality of the functions to yield the sparsest outcome, while incurring virtually no implementation overheads. Our approach straightforwardly poses a local cubature optimization problem for the first time, out of which we also propose alternative Linear Programming (LP) strategies for its resolution. Through examination across three academic examples, we demonstrate the capability of our method to identify the sparsest cubature rules for a given tolerance, outperforming alternate methods outlined, including the LP and other global strategies. We have made our code freely available through the GitHub repository at https://github.com/Rbravo555/localECM


title: Dynamical and finite-size effects on the signal of first-order phase transition

abstract: We study the dynamical behaviors of the criterion identifying the first-order phase transition in the matter generated by the relativistic heavy-ion collisions, by explicitly involving the dynamical effects based on the Fokker-Plank framework. The perspectives we taken into account range from phase transition scenarios, initial temperatures, volume effect, relaxation rates, and evolution trajectories. Our numerical calculations show that the dynamical signal of the first-order phase transition can be reserved in certain conditions. Besides the delaying effects due to a finite relaxation time, a larger initial temperature, a smaller volume, a larger relaxation rate, or bending of the trajectory will lead to reduction of the signal. Our discussions on the criterion offer valuable reference information for the experimental detection of the first-order phase transition signal.


title: Control problems on infinite horizon subject to time-dependent pure state constraints

abstract: In the last decades, control problems with infinite horizons and discount factors have become increasingly central not only for economics but also for applications in artificial intelligence and machine learning. The strong links between reinforcement learning and control theory have led to major efforts towards the development of algorithms to learn how to solve constrained control problems. In particular, discount plays a role in addressing the challenges that come with models that have unbounded disturbances. Although algorithms have been extensively explored, few results take into account time-dependent state constraints, which are imposed in most real-world control applications. For this purpose, here we investigate feasibility and sufficient conditions for Lipschitz regularity of the value function for a class of discounted infinite horizon optimal control problems subject to time-dependent constraints. We focus on problems with data that allow nonautonomous dynamics, and Lagrangian and state constraints that can be unbounded with possibly nonsmooth boundaries.


title: Causal Understanding of Why Users Share Hate Speech on Social Media

abstract: Hate speech on social media threatens the mental and physical well-being of individuals and is further responsible for real-world violence. An important driver behind the spread of hate speech and thus why hateful posts can go viral are reshares, yet little is known about why users reshare hate speech. In this paper, we present a comprehensive, causal analysis of the user attributes that make users reshare hate speech. However, causal inference from observational social media data is challenging, because such data likely suffer from selection bias, and there is further confounding due to differences in the vulnerability of users to hate speech. We develop a novel, three-step causal framework: (1) We debias the observational social media data by applying inverse propensity scoring. (2) We use the debiased propensity scores to model the latent vulnerability of users to hate speech as a latent embedding. (3) We model the causal effects of user attributes on users' probability of sharing hate speech, while controlling for the latent vulnerability of users to hate speech. Compared to existing baselines, a particular strength of our framework is that it models causal effects that are non-linear, yet still explainable. We find that users with fewer followers, fewer friends, and fewer posts share more hate speech. Younger accounts, in return, share less hate speech. Overall, understanding the factors that drive users to share hate speech is crucial for detecting individuals at risk of engaging in harmful behavior and for designing effective mitigation strategies.


title: BLESS: Benchmarking Large Language Models on Sentence Simplification

abstract: We present BLESS, a comprehensive performance benchmark of the most recent state-of-the-art large language models (LLMs) on the task of text simplification (TS). We examine how well off-the-shelf LLMs can solve this challenging task, assessing a total of 44 models, differing in size, architecture, pre-training methods, and accessibility, on three test sets from different domains (Wikipedia, news, and medical) under a few-shot setting. Our analysis considers a suite of automatic metrics as well as a large-scale quantitative investigation into the types of common edit operations performed by the different models. Furthermore, we perform a manual qualitative analysis on a subset of model outputs to better gauge the quality of the generated simplifications. Our evaluation indicates that the best LLMs, despite not being trained on TS, perform comparably with state-of-the-art TS baselines. Additionally, we find that certain LLMs demonstrate a greater range and diversity of edit operations. Our performance benchmark will be available as a resource for the development of future TS methods and evaluation metrics.


title: navlie: A Python Package for State Estimation on Lie Groups

abstract: The ability to rapidly test a variety of algorithms for an arbitrary state estimation task is valuable in the prototyping phase of navigation systems. Lie group theory is now mainstream in the robotics community, and hence estimation prototyping tools should allow state definitions that belong to manifolds. A new package, called navlie, provides a framework that allows a user to model a large class of problems by implementing a set of classes complying with a generic interface. Once accomplished, navlie provides a variety of on-manifold estimation algorithms that can run directly on these classes. The package also provides a built-in library of common models, as well as many useful utilities. The open-source project can be found at https://github.com/decargroup/navlie.


title: Observation of Damped Oscillations in Chemical-Quantum-Magnetic Interactions

abstract: Fundamental interactions are the basis of the most diverse phenomena in science that allow the dazzling of possible applications. In this work, we report a new interaction, which we call chemical-quantum-magnetic interaction. This interaction arises due to the difference in valence that the Fe3O4/PANI nanostructure acquires under certain conditions. In this study, PANI activates the chemical part of the oscillations, leaving the quantum and magnetic part for the double valence effect and consequently for changing the number of spins of the nanostructure sites. We also observed using interaction measurements that chemical-quantum-magnetic interactions oscillate in a subcritical regime satisfying the behavior of a damped harmonic oscillator.

categories: cond-mat.mes-hall eess.SP physics.app-ph physics.chem-ph


title: CP$^{\infty}$ and beyond: 2-categorical dilation theory

abstract: The problem of extending the insights and techniques of categorical quantum mechanics to infinite-dimensional systems was considered in (Coecke and Heunen, 2016). In that work the $\mathrm{CP}^{\infty}$-construction, which recovers the category of Hilbert spaces and quantum operations from the category of Hilbert spaces and bounded linear maps, was defined. Here we show that by a `horizontal categorification' of the $\mathrm{CP}^{\infty}$-construction, one can recover the category of all von Neumann algebras and channels (normal unital completely positive maps) from the 2-category $[W^*]$ of von Neumann algebras, bimodules and intertwiners. As an application, we extend Choi's characterisation of extremal channels between finite-dimensional matrix algebras to a characterisation of extremal channels between arbitrary von Neumann algebras.


title: MindLLM: Pre-training Lightweight Large Language Model from Scratch, Evaluations and Domain Applications

abstract: Large Language Models (LLMs) have demonstrated remarkable performance across various natural language tasks, marking significant strides towards general artificial intelligence. While general artificial intelligence is leveraged by developing increasingly large-scale models, there could be another branch to develop lightweight custom models that better serve certain domains, taking into account the high cost of training and deploying LLMs and the scarcity of resources. In this paper, we present MindLLM, a novel series of bilingual lightweight large language models, trained from scratch, alleviating such burdens by offering models with 1.3 billion and 3 billion parameters. A thorough account of experiences accrued during large model development is given, covering every step of the process, including data construction, model architecture, evaluation, and applications. Such insights are hopefully valuable for fellow academics and developers. MindLLM consistently matches or surpasses the performance of other open-source larger models on some public benchmarks. We also introduce an innovative instruction tuning framework tailored for smaller models to enhance their capabilities efficiently. Moreover, we explore the application of MindLLM in specific vertical domains such as law and finance, underscoring the agility and adaptability of our lightweight models.


title: Privacy Protection in MRI Scans Using 3D Masked Autoencoders

abstract: MRI scans provide valuable medical information, however they also contain sensitive and personally identifiable information that needs to be protected. Whereas MRI metadata is easily sanitized, MRI image data is a privacy risk because it contains information to render highly-realistic 3D visualizations of a patient's head, enabling malicious actors to possibly identify the subject by cross-referencing a database. Data anonymization and de-identification is concerned with ensuring the privacy and confidentiality of individuals' personal information. Traditional MRI de-identification methods remove privacy-sensitive parts (e.g. eyes, nose etc.) from a given scan. This comes at the expense of introducing a domain shift that can throw off downstream analyses. In this work, we propose CP-MAE, a model that de-identifies the face by remodeling it (e.g. changing the face) rather than by removing parts using masked autoencoders. CP-MAE outperforms all previous approaches in terms of downstream task performance as well as de-identification. With our method we are able to synthesize high-fidelity scans of resolution up to $256^3$ -- compared to $128^3$ with previous approaches -- which constitutes an eight-fold increase in the number of voxels.


title: Analysis of proteins in the light of mutations

abstract: Proteins have evolved through mutations, amino acid substitutions, since life appeared on Earth, some 109 years ago. The study of these phenomena has been of particular significance because of their impact on protein stability, function, and structure. Three of the most recent findings in these areas deserve to be highlighted. First, an innovative method has made it feasible to massively determine the impact of mutations on protein stability. Second, a theoretical analysis showed how mutations impact the evolution of protein folding rates. Lastly, it has been shown that native-state structural changes brought on by mutations can be explained in detail by the amide hydrogen exchange protection factors. This study offers a new perspective on how those findings can be used to analyze proteins in the light of mutations. The preliminary results indicate that: (i) mutations can be viewed as sensitive probes to identify "typos" in the amino-acid sequence and also to assess the resistance of naturally occurring proteins to unwanted sequence alterations; (ii) the presence of "typos" in the amino acid sequence, rather than being an evolutionary obstacle, could promote faster evolvability and, in turn, increase the likelihood of higher protein stability; (iii) the mutation site is far more important than the substituted amino acid in terms of the protein's marginal stability changes, and (iv) the protein evolution unpredictability at the molecular level by mutations exists even in the absence of epistasis effects. Finally, the study results support the Darwinian concept of evolution as "descent with modification" by demonstrating that some regions of any protein sequence are susceptible to mutations while others are not.


title: Make LLM a Testing Expert: Bringing Human-like Interaction to Mobile GUI Testing via Functionality-aware Decisions

abstract: Automated Graphical User Interface (GUI) testing plays a crucial role in ensuring app quality, especially as mobile applications have become an integral part of our daily lives. Despite the growing popularity of learning-based techniques in automated GUI testing due to their ability to generate human-like interactions, they still suffer from several limitations, such as low testing coverage, inadequate generalization capabilities, and heavy reliance on training data. Inspired by the success of Large Language Models (LLMs) like ChatGPT in natural language understanding and question answering, we formulate the mobile GUI testing problem as a Q&A task. We propose GPTDroid, asking LLM to chat with the mobile apps by passing the GUI page information to LLM to elicit testing scripts, and executing them to keep passing the app feedback to LLM, iterating the whole process. Within this framework, we have also introduced a functionality-aware memory prompting mechanism that equips the LLM with the ability to retain testing knowledge of the whole process and conduct long-term, functionality-based reasoning to guide exploration. We evaluate it on 93 apps from Google Play and demonstrate that it outperforms the best baseline by 32% in activity coverage, and detects 31% more bugs at a faster rate. Moreover, GPTDroid identify 53 new bugs on Google Play, of which 35 have been confirmed and fixed.


title: Internal structure of hairy rotating black holes in three dimensions

abstract: We construct hairy rotating black hole solutions in three dimensional Einstein gravity coupled to a complex scalar field. When we turn on a real and uniform source on the dual CFT, the black hole is stationary with two Killing vectors and we show that there is no inner horizon for the black hole and the system evolves smoothly into a Kasner universe. When we turn on a complex and periodic driving source on the dual CFT with a phase velocity equal to the angular velocity of the black hole, we have a time-dependent black hole with only one Killing vector. We show that inside the black hole, after a rapid collapse of the Einstein-Rosen bridge, oscillations of the scalar field follow. Then the system evolves into the Kasner epoch with possible Kasner inversion, which occurs in most of the parameter regimes. In both cases, one of the metric fields obeys a simple relation between its value at the horizon and in the Kasner epoch.


title: Convective characteristics of Fe I lines across the solar disc

abstract: Solar convection is visible as a net blueshift of absorption lines, which becomes apparent when observing quiet Sun granulation. This blueshift exhibits variations from the disc centre to the solar limb due to differing projection angles onto the solar atmosphere. Our goal is to investigate convective Doppler velocities based on observations from the disc centre to the solar limb. Consequently, we aim to improve our understanding of atmospheric hydrodynamics and contribute to the improvement of solar and stellar atmospheric models. We used resolved quiet-Sun spectra to investigate the convective velocity shifts of more than 1000\,\ion{Fe}{I} lines across multiple centre-to-limb positions on the solar disc. We determined the Doppler velocities with respect to the line depth. Additionally, we calculated the formation temperature and investigated its correlation with Doppler velocities. The general behaviour of convective line shifts shows a decreasing blueshift as the lines become deeper for all observing positions from the centre to limb. For spectra obtained at the solar limb, even deeper lines exhibit redshifts. We observe a velocity trend for the different observation angles, with a less pronounced convective blueshift towards the solar limb. Convective velocities show a wavelength dependence for each observing angle when analysing on the basis of line depths. We observe a decreasing convective blueshift as the formation temperatures of the lines decrease. The velocity change over temperature ranges proceeds slower towards the solar limb. When investigating Doppler velocities with respect to formation temperature, the disc centre does not exhibit the strongest blueshift.


title: Local Chern Marker for Periodic Systems

abstract: Topological invariants are global properties of the ground-state wave function, typically defined as winding numbers in reciprocal space. Over the years, a number of topological markers in real space have been introduced, allowing to map topological order in heterogeneous crystalline and disordered systems. Notably, even if these formulations can be expressed in terms of lattice-periodic quantities, they can actually be deployed in open boundary conditions only, as in practice they require computing the position operator $\mathbf{r}$ in a form that is ill-defined in periodic boundary conditions. Here we derive a local Chern marker for infinite two-dimensional systems with periodic boundary conditions in the large supercell limit, where the electronic structure is sampled with one single point in reciprocal space. We validate our approach with tight-binding numerical simulations on the Haldane model, including trivial/topological superlattices made of pristine and disordered Chern insulators. The strategy introduced here is very general and could be applied to other topological invariants and quantum-geometrical quantities in any dimension.


title: An Impact and Risk Assessment Framework for National Electronic Identity (eID) Systems

abstract: Electronic identification (eID) systems allow citizens to assert and authenticate their identities for various purposes, such as accessing government services or conducting financial transactions. These systems improve user access to rights, services, and the formal economy. As eID systems become an essential facet of national development, any failure, compromise, or misuse can be costly and damaging to the government, users, and society. Therefore, an effective risk assessment is vital for identifying emerging risks to the system and assessing their impact. However, developing a comprehensive risk assessment for these systems must extend far beyond focusing on technical security and privacy impacts and must be conducted with a contextual understanding of stakeholders and the communities these systems serve. In this study, we posit that current risk assessments do not address risk factors for all key stakeholders and explore how potential compromise could impact them each in turn. In the examination of the broader impact of risks and the potentially significant consequences for stakeholders, we propose a framework that considers a wide range of factors, including the social, economic, and political contexts in which these systems were implemented. This provides a holistic platform for a better assessment of risk to the eID system.


title: Violent mass ejection by the progenitors of the brightest planetary nebulae: supernova progenitors

abstract: I examine the morphologies of the brightest planetary nebulae (PNe) in the Milky Way Galaxy and conclude that violent binary interaction processes eject the main nebulae of the brightest PNe. The typical morphologies of the brightest PNe are multipolar, namely have been shaped by two or more major jet-launching episodes at varying directions, and possess small to medium departures from pure point symmetry. I discuss some scenarios, including a rapid onset of a common envelope interaction and the merger of the companion, mainly a white dwarf, with the asymptotic giant branch core at the termination of the common envelope. Some of these might be progenitors of type Ia supernovae (SNe Ia), as I suggest for SNR G1.9+0.3, the youngest SN Ia in the Galaxy.


title: Amortised Inference in Neural Networks for Small-Scale Probabilistic Meta-Learning

abstract: The global inducing point variational approximation for BNNs is based on using a set of inducing inputs to construct a series of conditional distributions that accurately approximate the conditionals of the true posterior distribution. Our key insight is that these inducing inputs can be replaced by the actual data, such that the variational distribution consists of a set of approximate likelihoods for each datapoint. This structure lends itself to amortised inference, in which the parameters of each approximate likelihood are obtained by passing each datapoint through a meta-model known as the inference network. By training this inference network across related datasets, we can meta-learn Bayesian inference over task-specific BNNs.


title: SequenceMatch: Revisiting the design of weak-strong augmentations for Semi-supervised learning

abstract: Semi-supervised learning (SSL) has become popular in recent years because it allows the training of a model using a large amount of unlabeled data. However, one issue that many SSL methods face is the confirmation bias, which occurs when the model is overfitted to the small labeled training dataset and produces overconfident, incorrect predictions. To address this issue, we propose SequenceMatch, an efficient SSL method that utilizes multiple data augmentations. The key element of SequenceMatch is the inclusion of a medium augmentation for unlabeled data. By taking advantage of different augmentations and the consistency constraints between each pair of augmented examples, SequenceMatch helps reduce the divergence between the prediction distribution of the model for weakly and strongly augmented examples. In addition, SequenceMatch defines two different consistency constraints for high and low-confidence predictions. As a result, SequenceMatch is more data-efficient than ReMixMatch, and more time-efficient than both ReMixMatch ($\times4$) and CoMatch ($\times2$) while having higher accuracy. Despite its simplicity, SequenceMatch consistently outperforms prior methods on standard benchmarks, such as CIFAR-10/100, SVHN, and STL-10. It also surpasses prior state-of-the-art methods by a large margin on large-scale datasets such as ImageNet, with a 38.46\% error rate. Code is available at https://github.com/beandkay/SequenceMatch.


title: qPOTS: Efficient batch multiobjective Bayesian optimization via Pareto optimal Thompson sampling

abstract: Classical evolutionary approaches for multiobjective optimization are quite effective but incur a lot of queries to the objectives; this can be prohibitive when objectives are expensive oracles. A sample-efficient approach to solving multiobjective optimization is via Gaussian process (GP) surrogates and Bayesian optimization (BO). Multiobjective Bayesian optimization (MOBO) involves the construction of an acquisition function which is optimized to acquire new observation candidates. This ``inner'' optimization can be hard due to various reasons: acquisition functions being nonconvex, nondifferentiable and/or unavailable in analytical form; the success of MOBO heavily relies on this inner optimization. We do away with this hard acquisition function optimization step and propose a simple, but effective, Thompson sampling based approach ($q\texttt{POTS}$) where new candidate(s) are chosen from the Pareto frontier of random GP posterior sample paths obtained by solving a much cheaper multiobjective optimization problem. To further improve computational tractability in higher dimensions we propose an automated active set of candidates selection combined with a Nystr\"{o}m approximation. Our approach applies to arbitrary GP prior assumptions and demonstrates strong empirical performance over the state of the art, both in terms of accuracy and computational efficiency, on synthetic as well as real-world experiments.