title: Hiring and firing -- a signaling game

abstract: We study a signaling game between an employer and a potential employee, where the employee has private information regarding their production capacity. At the initial stage, the employee communicates a salary claim, after which the true production capacity is gradually revealed to the employer as the unknown drift of a Brownian motion representing the revenues generated by the employee. Subsequently, the employer has the possibility to choose a time to fire the employee in case the estimated production capacity falls short of the salary. In this set-up, we use filtering and optimal stopping theory to derive an equilibrium in which the employee provides a randomized salary claim and the employer uses a threshold strategy in terms of the conditional probability for the high production capacity. The analysis is robust in the sense that various extensions of the basic model can be solved using the same methodology, including cases with positive firing costs, incomplete information about one's own type, as well as an additional interview phase.


title: Forget but Recall: Incremental Latent Rectification in Continual Learning

abstract: Intrinsic capability to continuously learn a changing data stream is a desideratum of deep neural networks (DNNs). However, current DNNs suffer from catastrophic forgetting, which hinders remembering past knowledge. To mitigate this issue, existing Continual Learning (CL) approaches either retain exemplars for replay, regularize learning, or allocate dedicated capacity for new tasks. This paper investigates an unexplored CL direction for incremental learning called Incremental Latent Rectification or ILR. In a nutshell, ILR learns to propagate with correction (or rectify) the representation from the current trained DNN backward to the representation space of the old task, where performing predictive decisions is easier. This rectification process only employs a chain of small representation mapping networks, called rectifier units. Empirical experiments on several continual learning benchmarks, including CIFAR10, CIFAR100, and Tiny ImageNet, demonstrate the effectiveness and potential of this novel CL direction compared to existing representative CL methods.


title: Automatic infant 2D pose estimation from videos: comparing seven deep neural network methods

abstract: Automatic markerless estimation of infant posture and motion from ordinary videos carries great potential for movement studies "in the wild", facilitating understanding of motor development and massively increasing the chances of early diagnosis of disorders. There is rapid development of human pose estimation methods in computer vision thanks to advances in deep learning and machine learning. However, these methods are trained on datasets featuring adults in different contexts. This work tests and compares seven popular methods (AlphaPose, DeepLabCut/DeeperCut, Detectron2, HRNet, MediaPipe/BlazePose, OpenPose, and ViTPose) on videos of infants in supine position. Surprisingly, all methods except DeepLabCut and MediaPipe have competitive performance without additional finetuning, with ViTPose performing best. Next to standard performance metrics (object keypoint similarity, average precision and recall), we introduce errors expressed in the neck-mid-hip ratio and additionally study missed and redundant detections and the reliability of the internal confidence ratings of the different methods, which are relevant for downstream tasks. Among the networks with competitive performance, only AlphaPose could run close to real time (27 fps) on our machine. We provide documented Docker containers or instructions for all the methods we used, our analysis scripts, and processed data at https://hub.docker.com/u/humanoidsctu and https://osf.io/x465b/.


title: Hybrid Classical-Quantum Simulation of MaxCut using QAOA-in-QAOA

abstract: The Quantum approximate optimization algorithm (QAOA) is a leading hybrid classical-quantum algorithm for solving complex combinatorial optimization problems. QAOA-in-QAOA (QAOA^2) uses a divide-and-conquer heuristic to solve large-scale Maximum Cut (MaxCut) problems, where many subgraph problems can be solved in parallel. In this work, an implementation of the QAOA2 method for the scalable solution of the MaxCut problem is presented, based on the Classiq platform. The framework is executed on an HPE-Cray EX supercomputer by means of the Message Passing Interface (MPI) and the SLURM workload manager. The limits of the Goemans-Williamson (GW) algorithm as a purely classical alternative to QAOA are investigated to understand if QAOA^2 could benefit from solving certain sub-graphs classically. Results from large-scale simulations of up to 33 qubits are presented, showing the advantage of QAOA in certain cases and the efficiency of the implementation, as well as the adequacy of the workflow in the preparation of real quantum devices. For the considered graphs, the best choice for the sub-graphs does not significantly improve results and is still outperformed by GW.


title: Comparative Analysis of Jet and Underlying Event Properties Across Various Models as a Function of Charged Particle Multiplicity at 7 TeV

abstract: In this study, a comprehensive analysis of jets and underlying events as a function of charged particle multiplicity in proton-proton (pp) collisions at a center-of-mass energy of $\sqrt{s} = 7$ TeV is presented. Various Monte Carlo (MC) event generators, including Pythia8.308, EPOS1.99, EPOSLHC, EPOS4$_{Hydro}$, and EPOS4$_{noHydro}$, are employed to predict particle production. The predictions from these models are compared with experimental data from the CMS collaboration. The charged particles are categorized into those associated with underlying events and those linked to jets. The analysis is restricted to charged particles with $|\eta| < 2.4$ and $p_{T} > 0.25$ GeV/c. Upon comparing the MC predictions with CMS data, it is observed that EPOS$4_{Hydro}$, EPOSLHC, and Pythia8 consistently reproduce the experimental results for all charged particles, underlying events, intrajet, and leading charged particles. For charged jet rates with $p_{T}^{ch.jet} > 5$ GeV/c, EPOS4$_{Hydro}$ and Pythia8 perform exceptionally well. In the case of charged jet rates with $p_{T}^{ch.jet} > 30$ GeV/c, EPOSLHC reproduces satisfactorily good results, while EPOS4$_{Hydro}$ exhibits good agreement with the data at higher charged particle multiplicities as compared to the other models. This can be attributed to the conversion of energy into flow when "Hydro=on," leading to an increase in multiplicity. EPOSLHC model described the data well due to the new collective flow effects, correlated flow treatment, and parametrization as compared to the EPOS1.99. However, the examination of the jet $p_{T}$ spectrum and normalized charged $p_{T}$ density reveals that EPOS4$_{Hydro}$, EPOS4$_{noHydro}$, and EPOSLHC exhibit good agreement with the experimental results, while Pythia8 and EPOS1.99 do not perform as well due to the lack of correlated flow treatment.


title: Native Design Bias: Studying the Impact of English Nativeness on Language Model Performance

abstract: Large Language Models (LLMs) excel at providing information acquired during pretraining on large-scale corpora and following instructions through user prompts. This study investigates whether the quality of LLM responses varies depending on the demographic profile of users. Considering English as the global lingua franca, along with the diversity of its dialects among speakers of different native languages, we explore whether non-native English speakers receive lower-quality or even factually incorrect responses from LLMs more frequently. Our results show that performance discrepancies occur when LLMs are prompted by native versus non-native English speakers and persist when comparing native speakers from Western countries with others. Additionally, we find a strong anchoring effect when the model recognizes or is made aware of the user's nativeness, which further degrades the response quality when interacting with non-native speakers. Our analysis is based on a newly collected dataset with over 12,000 unique annotations from 124 annotators, including information on their native language and English proficiency.


title: Double Momentum Method for Lower-Level Constrained Bilevel Optimization

abstract: Bilevel optimization (BO) has recently gained prominence in many machine learning applications due to its ability to capture the nested structure inherent in these problems. Recently, many hypergradient methods have been proposed as effective solutions for solving large-scale problems. However, current hypergradient methods for the lower-level constrained bilevel optimization (LCBO) problems need very restrictive assumptions, namely, where optimality conditions satisfy the differentiability and invertibility conditions and lack a solid analysis of the convergence rate. What's worse, existing methods require either double-loop updates, which are sometimes less efficient. To solve this problem, in this paper, we propose a new hypergradient of LCBO leveraging the theory of nonsmooth implicit function theorem instead of using the restrive assumptions. In addition, we propose a \textit{single-loop single-timescale} algorithm based on the double-momentum method and adaptive step size method and prove it can return a $(\delta, \epsilon)$-stationary point with $\tilde{\mathcal{O}}(d_2^2\epsilon^{-4})$ iterations. Experiments on two applications demonstrate the effectiveness of our proposed method.


title: Inequalities for a new hyperbolic type metric

abstract: We study a new hyperbolic type metric recently introduced by Song and Wang. We present formulas for it in the upper half-space and the unit ball domains and find its sharp inequalities with the hyperbolic metric and the triangular ratio metric. We also improve existing ball inclusion results and give bounds for the distortion of this new metric under conformal and quasiregular mappings.


title: Two-dimensional (bi-)scalar gravities from four-dimensional Horndeski

abstract: We develop a classical two-dimensional bi-scalar gravity based on the Kaluza-Klein reduction applied to the four-dimensional Horndeski theory. One of the scalar fields arises from the original four-dimensional theory, while the extra scalar emerges from the reduction process. We also introduce a two-dimensional bi-scalar identity that allows for a more concise and elegant reformulation of the resulting bi-scalar Lagrangian. Additionally, we study the linear perturbations around a static background to demonstrate that the bi-scalar theory may support a single healthy propagating mode. Furthermore, by restricting the scalar fields, we investigate a general single scalar theory that is identical to the two-dimensional Horndeski theory up to a boundary term. Our results provide a framework to map a generic two-dimensional dilaton gravity into four-dimensional Horndeski theory.


title: Symmetry Origin and Microscopic Mechanism of Electrical Magnetochiral Anisotropy in Tellurium

abstract: Non-linear transport effects in response to external magnetic fields, i.e. electrical magnetochiral anisotropy (eMChA), have attracted much attention for their importance to study quantum and spin-related phenomena. Indeed, they have permitted the exploration of topological surface states and charge-to-spin conversion processes in low-symmetry systems. Nevertheless, despite the inherent correlation between the symmetry of the material under examination and its non-linear transport characteristics, there is a lack of experimental demonstration to delve into this relationship and to unveil their microscopic mechanisms. Here, we study eMChA in chiral elemental Tellurium (Te) along different crystallographic directions, establishing the connection between the different eMChA components and the crystal symmetry of Te. We observed different longitudinal eMChA components with collinear current and magnetic field, demonstrating experimentally the radial angular momentum texture of Te. We also measured a transverse non-linear resistance which, as the longitudinal counterpart, scales bilinearly with current and magnetic fields, illustrating that they are different manifestations of the same effect. Finally, we study the scaling law of the eMChA, evidencing that extrinsic scattering from dynamic sources is the dominant microscopic mechanism. These findings underscore the efficacy of symmetry-based investigations in understanding and predicting non-linear transport phenomena, with potential applications in spintronics and energy harvesting.


title: Tame sparse exponential random graphs

abstract: In this paper, we obtain a precise estimate of the probability that the sparse binomial random graph contains a large number of vertices in a triangle. The estimate of log of this probability is correct up to second order, and enables us to propose an exponential random graph model based on the number of vertices in a triangle. Specifically, by tuning a single parameter, we can with high probability induce any given fraction of vertices in a triangle. Moreover, in the proposed exponential random graph model we derive the large deviation principle for the number of edges. As a byproduct, we propose a consistent estimator of the tuning parameter.


title: Comparing fingers and gestures for bci control using an optimized classical machine learning decoder

abstract: Severe impairment of the central motor network can result in loss of motor function, clinically recognized as Locked-in Syndrome. Advances in Brain-Computer Interfaces offer a promising avenue for partially restoring compromised communicative abilities by decoding different types of hand movements from the sensorimotor cortex. In this study, we collected ECoG recordings from 8 epilepsy patients and compared the decodability of individual finger flexion and hand gestures with the resting state, as a proxy for a one-dimensional brain-click. The results show that all individual finger flexion and hand gestures are equally decodable across multiple models and subjects (>98.0\%). In particular, hand movements, involving index finger flexion, emerged as promising candidates for brain-clicks. When decoding among multiple hand movements, finger flexion appears to outperform hand gestures (96.2\% and 92.5\% respectively) and exhibit greater robustness against misclassification errors when all hand movements are included. These findings highlight that optimized classical machine learning models with feature engineering are viable decoder designs for communication-assistive systems.


title: Tropical curves of unibranch points and hypertangency

abstract: We study integral plane curves meeting at a single unibranch point and show that such curves must satisfy two equivalent conditions. A numeric condition: the local invariants of the curves at the contact point must be arithmetically related. A geometric condition: the tropical curves that we associate to the contact point must be isomorphic. Moreover, we prove closed formulas for the delta-invariant of a unibranch singularity, and for the dimension of the loci of curves with an assigned unibranch point. Our work is motivated by interest in the Lang exceptional set.


title: Timely and Painless Breakups: Off-the-grid Blind Message Recovery and Users' Demixing

abstract: In the near future, the Internet of Things will interconnect billions of devices, forming a vast network where users sporadically transmit short messages through multi-path wireless channels. These channels are characterized by the superposition of a small number of scaled and delayed copies of Dirac spikes. At the receiver, the observed signal is a sum of these convolved signals, and the task is to find the amplitudes, continuous-indexed delays, and transmitted messages from a single signal. This task is inherently ill-posed without additional assumptions on the channel or messages. In this work, we assume the channel exhibits sparsity in the delay domain and that i.i.d. random linear encoding is applied to the messages at the devices. Leveraging these assumptions, we propose a semidefinite programming optimization capable of simultaneously recovering both messages and the delay parameters of the channels from only a single received signal. Our theoretical analysis establishes that the required number of samples at the receiver scales proportionally to the sum-product of sparsity and message length of all users, aligning with the degrees of freedom in the proposed convex optimization framework. Numerical experiments confirm the efficacy of the proposed method in accurately estimating closely-spaced delay parameters and recovering messages.


title: Moments of the charge distribution observed through electron scattering in H3 and He3

abstract: The moments of the charge distributions obtained by the analysis of electron-scattering data are examined in $^3$H and $^3$He. It is shown that the experimental form-factors are well explained, but the values of the moments of the charge distributions are not determined uniquly by the present analyses.


title: The coherent rank of a graph with three eigenvalues

abstract: We characterise graphs that have three distinct eigenvalues and coherent ranks 8 and 9, linking the former to certain symmetric 2-designs and the latter to specific quasi-symmetric 2-designs. This characterisation leads to the discovery of a new biregular graph with three distinct eigenvalues. Additionally, we demonstrate that the coherent rank of a triregular graph with three distinct eigenvalues is at least 14. Finally, we introduce a conjecturally infinite family of biregular graphs with three distinct eigenvalues, obtained by switching the block graphs of orthogonal arrays.


title: SyncNoise: Geometrically Consistent Noise Prediction for Text-based 3D Scene Editing

abstract: Text-based 2D diffusion models have demonstrated impressive capabilities in image generation and editing. Meanwhile, the 2D diffusion models also exhibit substantial potentials for 3D editing tasks. However, how to achieve consistent edits across multiple viewpoints remains a challenge. While the iterative dataset update method is capable of achieving global consistency, it suffers from slow convergence and over-smoothed textures. We propose SyncNoise, a novel geometry-guided multi-view consistent noise editing approach for high-fidelity 3D scene editing. SyncNoise synchronously edits multiple views with 2D diffusion models while enforcing multi-view noise predictions to be geometrically consistent, which ensures global consistency in both semantic structure and low-frequency appearance. To further enhance local consistency in high-frequency details, we set a group of anchor views and propagate them to their neighboring frames through cross-view reprojection. To improve the reliability of multi-view correspondences, we introduce depth supervision during training to enhance the reconstruction of precise geometries. Our method achieves high-quality 3D editing results respecting the textual instructions, especially in scenes with complex textures, by enhancing geometric consistency at the noise and pixel levels.


title: Gravitational waves from mergers of Population III binary black holes: roles played by two evolution channels

abstract: The gravitational wave (GW) signal from binary black hole (BBH) mergers is a promising probe of Population III (Pop III) stars. To fully unleash the power of the GW probe, one important step is to understand the relative importance and features of different BBH evolution channels. We model two channels, isolated binary stellar evolution (IBSE) and nuclear star cluster-dynamical hardening (NSC-DH), in one theoretical framework based on the semi-analytical code A-SLOTH, under various assumptions on Pop III initial mass function (IMF), initial binary statistics and high-$z$ nuclear star clusters (NSCs). The NSC-DH channel contributes $\sim 8-95\%$ of Pop III BBH mergers across cosmic history, with higher contributions achieved by initially wider binary stars, more top-heavy IMFs, and more abundant high-$z$ NSCs. The dimensionless stochastic GW background (SGWB) produced by Pop III BBH mergers has peak values $\Omega^{\rm peak}_{\rm GW}\sim 10^{-11}-8\times 10^{-11}$ around observer-frame frequencies $\nu\sim 10-100\ \rm Hz$. The Pop III contribution can be a non-negligible ($\sim 2-32\%$) component in the total SGWB at $\nu\lesssim 10\ \rm Hz$. The estimated detection rates of Pop III BBH mergers by the Einstein Telescope are $\sim 6-230\ \rm yr^{-1}$ and $\sim 30-1230\ \rm yr^{-1}$ for the NSC-DH and IBSE channels, respectively. Pop III BBH mergers in NSCs are more massive than those from IBSE, so they dominate the Pop III SGWB below $20$ Hz in most cases. Besides, the detection rate of Pop III BBH mergers involving at least one intermediate-mass BH above $100\ \rm M_\odot$ by the Einstein Telescope is $\sim 0.5-200\ \rm yr^{-1}$ in NSCs but remains below $0.1\ \rm yr^{-1}$ for IBSE.


title: Operating envelopes for the grid-constrained use of distributed flexibility in balancing markets

abstract: The increasing share of distributed energy sources enhances the participation potential of distributed flexibility in the provision of system services. However, this participation can endanger the grid-safety of the distribution networks (DNs) from which this flexibility originates. In this paper, the use of operating envelopes (OE) to enable the grid-safe procurement of distributed flexibility in centralized balancing markets is proposed. Two classes of approaches for calculating OEs (one-step and two-step methods) are compared in terms of the level of distribution grid safety they can provide, the impact they can have on the market efficiency, and the volume of discarded flexibility they can yield. A case study considering different system scenarios, based on Monte Carlo simulations, highlights a trade-off between the market efficiency, DN flexibility resource utilization, and the grid safety delivered by the different OE methods. The results showcase that the use of the two-step OE approach results in a more grid-secure albeit less-efficient use of distributed flexibility.


title: GradCheck: Analyzing classifier guidance gradients for conditional diffusion sampling

abstract: To sample from an unconditionally trained Denoising Diffusion Probabilistic Model (DDPM), classifier guidance adds conditional information during sampling, but the gradients from classifiers, especially those not trained on noisy images, are often unstable. This study conducts a gradient analysis comparing robust and non-robust classifiers, as well as multiple gradient stabilization techniques. Experimental results demonstrate that these techniques significantly improve the quality of class-conditional samples for non-robust classifiers by providing more stable and informative classifier guidance gradients. The findings highlight the importance of gradient stability in enhancing the performance of classifier guidance, especially on non-robust classifiers.


title: Optimal Design of Broadband, Low-Directivity Graded Index Acoustic Lenses for Underwater Applications

abstract: Manipulating underwater pressure waves is crucial for marine exploration, as electromagnetic signals are strongly absorbed in water. However, the multi-path phenomenon complicates the accurate capture of acoustic waves by receivers. Although graded index lenses, based on metamaterials with smoothly varying properties, successfully focus pressure waves, they tend to have high directivity, which hinders practical application. This work introduces three 2D acoustic lenses made from a metamaterial composed of solid inclusions in water. We propose an optimization scheme where the pressure dynamics is governed by Helmholtz's equation, with control parameters affecting each lens cell's density and bulk modulus. Through an appropriate cost function, the optimization encourages a broadband, low-directivity lens. The large-scale optimization is solved using the Lagrangian approach, which provides an analytical expression for the cost gradient. This scheme avoids the need for a separate discretization step, allowing the design to transition directly from the desired smooth refractive index to a practical lattice structure. As a result, the optimized lens closely aligns with real-world behavior. The homogenized numerical model is validated against finite elements, which considers acoustic-elastic coupling at the microstructure level. When homogenization holds, this approach proves to be an effective design tool for achieving broadband, low-directivity acoustic lenses.


title: Magnetic symmetries of terbium tetraboride (TbB4) revealed by resonant x-ray Bragg diffraction

abstract: A recent experimental study of TbB4 at a low temperature using resonant x-ray Bragg diffraction implies a magnetic symmetry not found in any other rare-earth tetraboride. The evidence for this assertion is a change in the intensity of a TbB4 Bragg spot on reversing the handedness (chirality) of the primary x-ray beam [Misawa et al., Phys. Rev. B 108, 134433 (2023)]. It reveals a magnetic chiral signature in TbB4 that is forbidden in phases of rare-earth tetraborides known to date. For, the previous magnetic symmetries are parity-time (PT)-symmetric with anti-inversion present in the magnetic crystal class. Misawa et al. appeal to a (PT)-symmetric diffraction pattern to interpret their interesting experimental results. In addition to the use of symmetry that does not permit a chiral signature, calculated patterns impose cylindrical symmetry on Tb sites with no justification. We review magnetic symmetries for TbB4 consistent with a published neutron powder diffraction pattern and susceptibility measurements. The investigated symmetry templates are non-centrosymmetric, non-collinear antiferromagnetic constructions with propagation vector k = (0, 0, 0). An inferred chiral signature for a parity-even absorption event has an interesting composition. There is the anticipated product of Tb axial dipoles and charge-like quadrupoles (from Templeton-Templeton scattering). Beyond this contribution, though, symmetry allows a product of dipoles in the chiral signature. A predicted change in the intensity of a Bragg spot with rotation of the crystal about the reflection vector (an azimuthal angle scan) can be tested in future experiments. Likewise, contributions to Bragg diffraction patterns from Tb anapoles and higher-order Dirac multipoles.


title: Quantum gravitomagnetic interaction

abstract: In the framework of linearized quantum gravity, we study the quantum gravitational interaction between two nonpointlike objects induced by fluctuating gravitomagnetic fields in vacuum. We find that, in addition to the quantum gravitational interaction induced by fluctuating gravitoelectric fields previously studied, there exists a quantum gravitomagnetic interaction. This interaction originates from the interaction between the instantaneous localized mass currents in nonpointlike objects induced by the fluctuating gravitomagnetic fields. Using fourth-order perturbation theory, we derive the explicit form of the quantum gravitomagnetic interaction energy, which shows an $r^{-10}$ dependence in the near regime and an $r^{-11}$ dependence in the far regime, where $r$ is the distance between the two objects. This interaction energy is expected to be significant when the gravitomagnetic polarizability of the objects is large.


title: A comparison of formulations for aircraft deconfliction

abstract: In this work, we aim to compare different methods and formulations to solve a problem in air traffic management to global optimality. In particular, we focus on the aircraft deconfliction problem, where we are given n aircraft, their position at time 0, and their (straight) trajectories. We wish to identify and solve potential pairwise conflict by temporarily modifying the aircraft's trajectory. A pair of aircraft is in conflict when they do not respect a minimum, predefined safety distance. In general, conflicts could be solved both varying the aircraft's speed or trajectory, but in this paper we only consider the latter, more precisely heading-angle deviations. The problem has been formulated as a mixed integer nonlinear program (MINLP). We compare this formulation, solved by open-source MINLP solvers for global optimization, against a reformulation that shows a larger number of variables and constraints but only separable nonconvexities. We solve such a separable formulation with the same MINLP solvers or the Sequential Convex Mixed Integer Nonlinear Programming method. The separable formulation, despite being larger, facilitates some solvers in finding good-quality solutions.


title: Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training

abstract: Existing speculative decoding methods typically require additional model structure and training processes to assist the model for draft token generation. This makes the migration of acceleration methods to the new model more costly and more demanding on device memory. To address this problem, we propose the Make Some Noise (MSN) training framework as a replacement for the supervised fine-tuning stage of the large language model. The training method simply introduces some noise at the input for the model to learn the denoising task. It significantly enhances the parallel decoding capability of the model without affecting the original task capability. In addition, we propose a tree-based retrieval-augmented Jacobi (TR-Jacobi) decoding strategy to further improve the inference speed of MSN models. Experiments in both the general and code domains have shown that MSN can improve inference speed by 2.3-2.7x times without compromising model performance. The MSN model also achieves comparable acceleration ratios to the SOTA model with additional model structure on Spec-Bench.


title: Less can be more: representational vs. stereotypical gender bias in facial expression recognition

abstract: Machine learning models can inherit biases from their training data, leading to discriminatory or inaccurate predictions. This is particularly concerning with the increasing use of large, unsupervised datasets for training foundational models. Traditionally, demographic biases within these datasets have not been well-understood, limiting our ability to understand how they propagate to the models themselves. To address this issue, this paper investigates the propagation of demographic biases from datasets into machine learning models. We focus on the gender demographic component, analyzing two types of bias: representational and stereotypical. For our analysis, we consider the domain of facial expression recognition (FER), a field known to exhibit biases in most popular datasets. We use Affectnet, one of the largest FER datasets, as our baseline for carefully designing and generating subsets that incorporate varying strengths of both representational and stereotypical bias. Subsequently, we train several models on these biased subsets, evaluating their performance on a common test set to assess the propagation of bias into the models' predictions. Our results show that representational bias has a weaker impact than expected. Models exhibit a good generalization ability even in the absence of one gender in the training dataset. Conversely, stereotypical bias has a significantly stronger impact, primarily concentrated on the biased class, although it can also influence predictions for unbiased classes. These results highlight the need for a bias analysis that differentiates between types of bias, which is crucial for the development of effective bias mitigation strategies.


title: Qualitative/quantitative homogenization of some non-Newtonian flows in perforated domains

abstract: In this paper, we consider the homogenization of stationary and evolutionary incompressible viscous non-Newtonian flows of Carreau-Yasuda type in domains perforated with a large number of periodically distributed small holes in $\mathbb{R}^{3}$, where the mutual distance between the holes is measured by a small parameter $\varepsilon>0$ and the size of the holes is $\varepsilon^{\alpha}$ with $\alpha \in (1, \frac 32)$. The Darcy's law is recovered in the limit, thus generalizing the results from [\url{https://doi.org/10.1016/0362-546X(94)00285-P}] and [\url{https://doi.org/10.48550/arXiv.2310.05121}] for $\alpha=1$. Instead of using their restriction operator to derive the estimates of the pressure extension by duality, we use the Bogovski\u{\i} type operator in perforated domains (constructed in [\url{https://doi.org/10.1051/cocv/2016016}]) to deduce the uniform estimates of the pressure directly. Moreover, quantitative convergence rates are given.


title: Nonclassical Light in a Three-Waveguide Coupler with Second-Order Nonlinearity

abstract: Possible squeezed states generated in a three-waveguide nonlinear coupler operating with second harmonic generation is discussed. This study is carried out using two well-known techniques; the phase space method (based on positive P-representation) and the Heisenberg-based analytical perturbative method. The effect of the key design parameters is analyzed for both codirectional and contra-directional propagation. The optimal degree of feasible squeezing is identified. Also, the performance and capacities of both methods are critically evaluated. For low levels of key design parameters and in the early stages of evolution, a high level of agreement between the two methods is noticed. In the new era of quantum-based technology, the proposed system opens a new avenue for utilising nonlinear couplers in nonclassical light generation.


title: Higher Gaussian maps on the hyperelliptic locus and second fundamental form

abstract: In this paper we study higher even Gaussian maps of the canonical bundle on hyperelliptic curves and we determine their rank, giving explicit descriptions of their kernels. Then we use this descriptions to investigate the hyperelliptic Torelli map $j_h$ and its second fundamental form. We study isotropic subspaces of the tangent space $T_{{\mathcal H}_g, [C]}$ to the moduli space ${\mathcal H}_g$ of hyperelliptic curves of genus $g$ at a point $[C]$, with respect to the second fundamental form $\rho_{HE}$ of $j_h$. In particular, for any Weierstrass point $p \in C$, we construct a subspace $V_p$ of dimension $\lfloor\frac{g}{2} \rfloor$ of $T_{{\mathcal H}_g, [C]}$ generated by higher Schiffer variations at $p$, such that the only isotropic tangent direction $\zeta \in V_p$ for the image of $\rho_{HE}$ is the standard Schiffer variation $\xi_p$ at the Weierstrass point $p \in C$.


title: The Dehn function for Palindromic Sub-Group of $Aut(F_n)$

abstract: In this paper, we prove that the Dehn function of the palindromic automorphism group $\Pi A(F_n)$ is exponential.


title: Traveling waves in reaction-diffusion-convection equations with combustion nonlinearity

abstract: This paper concerns the existence and properties of traveling wave solutions to reaction-diffusion-convection equations on the real line. We consider a general diffusion term involving the $p$-Laplacian and combustion-type reaction term. We extend and generalize the results established for $p=2$ to the case of singular and degenerate diffusion. Our approach allows for non-Lipschitz reaction as well. We also discuss the shape of the traveling wave profile near equilibria, assuming power-type behavior of the reaction and diffusion terms.


title: Logarithmic and power-law entropies from convexity

abstract: In an attempt to understand the origin and robustness of the Boltzmann/Gibbs/Shannon entropic functional, we adopt a geometric approach and discuss the implications of the Johnson-Lindenstrauss lemma and of Dvoretzky's theorem on convex bodies for the choice of this functional form. We contrast these results with a more recent result on flowers of balls, which may be interpreted as suggesting the use of power-law entropies for some systems.

categories: cond-mat.stat-mech hep-th math-ph math.MP math.PR physics.hist-ph


title: The optical spectropolarimetric behaviour of a selection of high-energy blazars

abstract: At optical/ultraviolet energies, blazars display an underlying thermal (unpolarized) contribution from the accretion disc, torus and line emitting regions, diluting the polarized emission from the jet-component. Optical polarimetry can be used to disentangle the thermal and non-thermal components, and place constraints on the particle populations and acceleration mechanisms responsible for the non-thermal emission. We present the results of a linear optical spectropolarimetric observing campaign of 18 blazars (6 BLLs and 12 FSRQs) undertaken with the Southern African Large Telescope between 2016 and 2022. This was done to observe these systems during flaring states, as well as long term monitoring of PKS1510-089, AP Lib and PKS 1034-293. The observations traced the frequency dependence of the degree and angle of polarization, as well as changes in the spectral line strengths. We investigated possible correlations between the polarization and other observed characteristics for the sources. While an indication of correlation was found between the frequency dependence and the average level of polarization for some sources, a correlation was not found for the population as a whole. These results highlight that continuous observations and in-depth modelling of polarization and its frequency dependence is required to obtain a more holistic view of TeV blazars.


title: Depth-Guided Semi-Supervised Instance Segmentation

abstract: Semi-Supervised Instance Segmentation (SSIS) aims to leverage an amount of unlabeled data during training. Previous frameworks primarily utilized the RGB information of unlabeled images to generate pseudo-labels. However, such a mechanism often introduces unstable noise, as a single instance can display multiple RGB values. To overcome this limitation, we introduce a Depth-Guided (DG) SSIS framework. This framework uses depth maps extracted from input images, which represent individual instances with closely associated distance values, offering precise contours for distinct instances. Unlike RGB data, depth maps provide a unique perspective, making their integration into the SSIS process complex. To this end, we propose Depth Feature Fusion, which integrates features extracted from depth estimation. This integration allows the model to understand depth information better and ensure its effective utilization. Additionally, to manage the variability of depth images during training, we introduce the Depth Controller. This component enables adaptive adjustments of the depth map, enhancing convergence speed and dynamically balancing the loss weights between RGB and depth maps. Extensive experiments conducted on the COCO and Cityscapes datasets validate the efficacy of our proposed method. Our approach establishes a new benchmark for SSIS, outperforming previous methods. Specifically, our DG achieves 22.29%, 31.47%, and 35.14% mAP for 1%, 5%, and 10% labeled data on the COCO dataset, respectively.


title: Consensus Learning with Deep Sets for Essential Matrix Estimation

abstract: Robust estimation of the essential matrix, which encodes the relative position and orientation of two cameras, is a fundamental step in structure from motion pipelines. Recent deep-based methods achieved accurate estimation by using complex network architectures that involve graphs, attention layers, and hard pruning steps. Here, we propose a simpler network architecture based on Deep Sets. Given a collection of point matches extracted from two images, our method identifies outlier point matches and models the displacement noise in inlier matches. A weighted DLT module uses these predictions to regress the essential matrix. Our network achieves accurate recovery that is superior to existing networks with significantly more complex architectures.


title: Layer-Wise Quantization: A Pragmatic and Effective Method for Quantizing LLMs Beyond Integer Bit-Levels

abstract: We present a simple variable quantization approach that quantizes different layers of a large language model (LLM) at different bit levels. Specifically, we quantize the most important layers to higher bit precision and less important layers to lower bits to achieve floating point quantization levels. We propose two effective strategies to measure the importance of layers within LLMs: the first measures the importance of a layer based on how different its output embeddings are from the input embeddings (the higher the better); the second estimates the importance of a layer using the number of layer weights that are much larger than average (the smaller the better). We show that quantizing different layers at varying bits according to our importance scores results in minimal performance drop with a far more compressed model size. Finally, we present several practical key takeaways from our variable layer-wise quantization experiments: (a) LLM performance under variable quantization remains close to the original model until 25-50% of layers are moved in lower quantization using our proposed ordering but only until 5-10% if moved using no specific ordering; (b) Quantizing LLMs to lower bits performs substantially better than pruning unless extreme quantization (2-bit) is used; and (c) Layer-wise quantization to lower bits works better in the case of larger LLMs with more layers compared to smaller LLMs with fewer layers. The code used to run the experiments is available at: https://github.com/RazvanDu/LayerwiseQuant.


title: Legendrian Structures in Derived Geometry

abstract: This is the third installment in a series of papers on the subject of derived contact structures. In this paper, we formally introduce Legendrians in the derived context and give a natural example. We then present affine models and prove a Legendrian-Darboux-type theorem for the Legendrians in contact derived schemes.


title: Is the Valence Bond Solid state in $J_1$-$J_2$ Square Lattice Heisenberg Model Plaquette or Columnar?

abstract: We utilize Density Matrix Renormalization Group (DMRG) and Fully Augmented Matrix Product States (FAMPS) methods to investigate the Valence Bond Solid (VBS) phase in the $J_1$-$J_2$ square lattice Heisenberg model. To differentiate between the Columnar Valence Bond Solid (CVBS) and Plaquette Valence Bond Solid (PVBS) phases, we introduce an anisotropy $\Delta_y$ in the nearest neighboring coupling in the $y$-direction, aiming at detecting the possible spontaneous rotational symmetry breaking in the VBS phase. In the calculations, we push the bond dimension to as large as $D = 25000$ in FAMPS, simulating systems at a maximum size of $14 \times 14$. With a careful extrapolation of the truncation errors and appropriate finite-size scaling, followed by finite $\Delta_y$ scaling analysis of the VBS dimer order parameters, we identify the VBS phase as a PVBS type, meaning there is no spontaneous rotational symmetry breaking in the VBS phase. This study not only resolves the long-standing issue of the characterization of the VBS order in the $J_1$-$J_2$ square lattice Heisenberg model but also highlights the capabilities of FAMPS in the study of two-dimensional quantum many-body systems.


title: SE-VGAE: Unsupervised Disentangled Representation Learning for Interpretable Architectural Layout Design Graph Generation

abstract: Despite the suitability of graphs for capturing the relational structures inherent in architectural layout designs, there is a notable dearth of research on interpreting architectural design space using graph-based representation learning and exploring architectural design graph generation. Concurrently, disentangled representation learning in graph generation faces challenges such as node permutation invariance and representation expressiveness. To address these challenges, we introduce an unsupervised disentangled representation learning framework, Style-based Edge-augmented Variational Graph Auto-Encoder (SE-VGAE), aiming to generate architectural layout in the form of attributed adjacency multi-graphs while prioritizing representation disentanglement. The framework is designed with three alternative pipelines, each integrating a transformer-based edge-augmented encoder, a latent space disentanglement module, and a style-based decoder. These components collectively facilitate the decomposition of latent factors influencing architectural layout graph generation, enhancing generation fidelity and diversity. We also provide insights into optimizing the framework by systematically exploring graph feature augmentation schemes and evaluating their effectiveness for disentangling architectural layout representation through extensive experiments. Additionally, we contribute a new benchmark large-scale architectural layout graph dataset extracted from real-world floor plan images to facilitate the exploration of graph data-based architectural design representation space interpretation. This study pioneered disentangled representation learning for the architectural layout graph generation. The code and dataset of this study will be open-sourced.


title: Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA

abstract: Long-context modeling capabilities have garnered widespread attention, leading to the emergence of Large Language Models (LLMs) with ultra-context windows. Meanwhile, benchmarks for evaluating long-context LLMs are gradually catching up. However, existing benchmarks employ irrelevant noise texts to artificially extend the length of test cases, diverging from the real-world scenarios of long-context applications. To bridge this gap, we propose a novel long-context benchmark, Loong, aligning with realistic scenarios through extended multi-document question answering (QA). Unlike typical document QA, in Loong's test cases, each document is relevant to the final answer, ignoring any document will lead to the failure of the answer. Furthermore, Loong introduces four types of tasks with a range of context lengths: Spotlight Locating, Comparison, Clustering, and Chain of Reasoning, to facilitate a more realistic and comprehensive evaluation of long-context understanding. Extensive experiments indicate that existing long-context language models still exhibit considerable potential for enhancement. Retrieval augmented generation (RAG) achieves poor performance, demonstrating that Loong can reliably assess the model's long-context modeling capabilities.


title: Real-Time Remote Control via VR over Limited Wireless Connectivity

abstract: This work introduces a solution to enhance human-robot interaction over limited wireless connectivity. The goal is toenable remote control of a robot through a virtual reality (VR)interface, ensuring a smooth transition to autonomous mode in the event of connectivity loss. The VR interface provides accessto a dynamic 3D virtual map that undergoes continuous updatesusing real-time sensor data collected and transmitted by therobot. Furthermore, the robot monitors wireless connectivity and automatically switches to a autonomous mode in scenarios with limited connectivity. By integrating four key functionalities: real-time mapping, remote control through glasses VR, continuous monitoring of wireless connectivity, and autonomous navigation during limited connectivity, we achieve seamless end-to-end operation.


title: Phonon Heat Transport and Anisotropic Tuning of Quantum Fluctuations in a Frustrated Honeycomb Magnet

abstract: Honeycomb cobalt oxides containing 3$\it{d}$ Co$^{2+}$ ions might realize frustrated magnetism and novel quantum phases. Among candidate materials, Na$_{3}$Co$_{2}$SbO$_{6}$ stands out for its distorted honeycomb lattice and significant in-plane anisotropy, motivating vector-field tuning inside the honeycomb plane. Here we use thermal transport down to the mK regime to study twin-free crystals of Na$_{3}$Co$_{2}$SbO$_{6}$ subject to in-plane vector fields. We find that the thermal conductivity $\kappa$ never exceeds the heat-transport capability of phonons, rendering its suppression primarily due to phonon scattering off magnetic excitations and/or domain boundaries. The system's field-driven quantum criticality manifests itself as an abundance of magnetic fluctuations hindering the heat transport, which further depends on the field direction in an intriguing manner.


title: Causal Inference on Process Graphs, Part II: Causal Structure and Effect Identification

abstract: A structural vector autoregressive (SVAR) process is a linear causal model for variables that evolve over a discrete set of time points and between which there may be lagged and instantaneous effects. The qualitative causal structure of an SVAR process can be represented by its finite and directed process graph, in which a directed link connects two processes whenever there is a lagged or instantaneous effect between them. At the process graph level, the causal structure of SVAR processes is compactly parameterised in the frequency domain. In this paper, we consider the problem of causal discovery and causal effect estimation from the spectral density, the frequency domain analogue of the auto covariance, of the SVAR process. Causal discovery concerns the recovery of the process graph and causal effect estimation concerns the identification and estimation of causal effects in the frequency domain. We show that information about the process graph, in terms of $d$- and $t$-separation statements, can be identified by verifying algebraic constraints on the spectral density. Furthermore, we introduce a notion of rational identifiability for frequency causal effects that may be confounded by exogenous latent processes, and show that the recent graphical latent factor half-trek criterion can be used on the process graph to assess whether a given (confounded) effect can be identified by rational operations on the entries of the spectral density.


title: Deep learning-based brain segmentation model performance validation with clinical radiotherapy CT

abstract: Manual segmentation of medical images is labor intensive and especially challenging for images with poor contrast or resolution. The presence of disease exacerbates this further, increasing the need for an automated solution. To this extent, SynthSeg is a robust deep learning model designed for automatic brain segmentation across various contrasts and resolutions. This study validates the SynthSeg robust brain segmentation model on computed tomography (CT), using a multi-center dataset. An open access dataset of 260 paired CT and magnetic resonance imaging (MRI) from radiotherapy patients treated in 5 centers was collected. Brain segmentations from CT and MRI were obtained with SynthSeg model, a component of the Freesurfer imaging suite. These segmentations were compared and evaluated using Dice scores and Hausdorff 95 distance (HD95), treating MRI-based segmentations as the ground truth. Brain regions that failed to meet performance criteria were excluded based on automated quality control (QC) scores. Dice scores indicate a median overlap of 0.76 (IQR: 0.65-0.83). The median HD95 is 2.95 mm (IQR: 1.73-5.39). QC score based thresholding improves median dice by 0.1 and median HD95 by 0.05mm. Morphological differences related to sex and age, as detected by MRI, were also replicated with CT, with an approximate 17% difference between the CT and MRI results for sex and 10% difference between the results for age. SynthSeg can be utilized for CT-based automatic brain segmentation, but only in applications where precision is not essential. CT performance is lower than MRI based on the integrated QC scores, but low-quality segmentations can be excluded with QC-based thresholding. Additionally, performing CT-based neuroanatomical studies is encouraged, as the results show correlations in sex- and age-based analyses similar to those found with MRI.


title: Sparse Outerstring Graphs Have Logarithmic Treewidth

abstract: An outerstring graph is the intersection graph of curves lying inside a disk with one endpoint on the boundary of the disk. We show that an outerstring graph with $n$ vertices has treewidth $O(\alpha\log n)$, where $\alpha$ denotes the arboricity of the graph, with an almost matching lower bound of $\Omega(\alpha \log (n/\alpha))$. As a corollary, we show that a $t$-biclique-free outerstring graph has treewidth $O(t(\log t)\log n)$. This leads to polynomial-time algorithms for most of the central NP-complete problems such as \textsc{Independent Set}, \textsc{Vertex Cover}, \textsc{Dominating Set}, \textsc{Feedback Vertex Set}, \textsc{Coloring} for sparse outerstring graphs. Also, we can obtain subexponential-time (exact, parameterized, and approximation) algorithms for various NP-complete problems such as \textsc{Vertex Cover}, \textsc{Feedback Vertex Set} and \textsc{Cycle Packing} for (not necessarily sparse) outerstring graphs.


title: CuDA2: An approach for Incorporating Traitor Agents into Cooperative Multi-Agent Systems

abstract: Cooperative Multi-Agent Reinforcement Learning (CMARL) strategies are well known to be vulnerable to adversarial perturbations. Previous works on adversarial attacks have primarily focused on white-box attacks that directly perturb the states or actions of victim agents, often in scenarios with a limited number of attacks. However, gaining complete access to victim agents in real-world environments is exceedingly difficult. To create more realistic adversarial attacks, we introduce a novel method that involves injecting traitor agents into the CMARL system. We model this problem as a Traitor Markov Decision Process (TMDP), where traitors cannot directly attack the victim agents but can influence their formation or positioning through collisions. In TMDP, traitors are trained using the same MARL algorithm as the victim agents, with their reward function set as the negative of the victim agents' reward. Despite this, the training efficiency for traitors remains low because it is challenging for them to directly associate their actions with the victim agents' rewards. To address this issue, we propose the Curiosity-Driven Adversarial Attack (CuDA2) framework. CuDA2 enhances the efficiency and aggressiveness of attacks on the specified victim agents' policies while maintaining the optimal policy invariance of the traitors. Specifically, we employ a pre-trained Random Network Distillation (RND) module, where the extra reward generated by the RND module encourages traitors to explore states unencountered by the victim agents. Extensive experiments on various scenarios from SMAC demonstrate that our CuDA2 framework offers comparable or superior adversarial attack capabilities compared to other baselines.


title: Optical ionization effects in kHz laser wakefield acceleration with few-cycle pulses

abstract: We present significant advances in Laser Wakefield Acceleration (LWFA) operating at a 1 kHz repetition rate, employing a sub-TW, few-femtosecond laser and a continuously flowing hydrogen gas target. We conducted the first comprehensive study assessing how the nature of the gas within the target influences accelerator performance. This work confirms and elucidates the superior performance of hydrogen in kHz LWFA. Our system generates quasi-monoenergetic electron bunches with energies up to 10 MeV, bunch charges of 2 pC, and angular divergences of 15 mrad. Notably, our novel scheme relying on differential pumping enables continuous operation at kHz repetition rates, contrasting with previous systems that operated in burst mode to achieve similar beam properties. Particle-in-cell simulations explain hydrogen's superior performances: the ionization effects in nitrogen and helium distort the laser pulse, negatively impacting accelerator performance. These effects are strongly mitigated in hydrogen plasma, thereby enhancing beam quality. This analysis represents a significant step forward in optimizing and understanding kHz LWFA. It underscores the critical role of hydrogen and the imperative need to develop hydrogen-compatible target systems capable of managing high repetition rates, as exemplified by our differential pumping system. These advances lay the groundwork for further developments in high-repetition-rate LWFA technology.


title: A Critical Analysis of the Theoretical Framework of the Extreme Learning Machine

abstract: Despite the number of successful applications of the Extreme Learning Machine (ELM), we show that its underlying foundational principles do not have a rigorous mathematical justification. Specifically, we refute the proofs of two main statements, and we also create a dataset that provides a counterexample to the ELM learning algorithm and explain its design, which leads to many such counterexamples. Finally, we provide alternative statements of the foundations, which justify the efficiency of ELM in some theoretical cases.


title: Space-time symmetry breaking on non-geodesic leaves and a new form of matter

abstract: We examine the permanent damage caused by the historical breakdown of full diffeomorphism invariance induced by a foliation. We focus on the case where the foliation is allowed to be non-geodesic after the interactions with the foliation switch off. Gravity and other forms of matter recover full diffeomorphism invariance only at the expense of introducing a new matter-like component, carrying the non-vanishing Hamiltonian (and momentum) left over from the violating past interactions. This matter form must be stress-free in the preferred frame, the only way a matter action can mimic the evolution of the leftover Hamiltonian (and momentum) driven by the Dirac hypersurface deformation algebra. If the preferred frame is non-geodesic, then in the preferred frame the equivalent matter component must have energy and a momentum current, but still no spatial stresses: an unusual form of "matter". It is equivalent to a fluid with anisotropic stress in some regimes, reducing to dust in others, or even displaying completely new features in extreme situations. Its stress energy tensor is conserved. We provide two examples based on accelerated frames: Rindler space-time and the canonical Schwarzchild frame.


title: Imaging of I Zw 18 by JWST: II. Spatially resolved star formation history

abstract: The blue compact dwarf galaxy I Zw 18 is one of the most metal-poor ($Z \sim 3% Z_{\sun}$) star-forming galaxies in the local Universe. Its evolutionary status has sparked debate within the astronomical community. We aim to investigate the stellar populations of I Zw 18 in the near-IR using JWST/NIRCam's high spatial resolution and sensitivity. Additionally, we aim to derive the galaxy's spatially resolved star formation history (SFH) over the last 1 Gyr and provide constraints for older epochs. We used DOLPHOT to measure positions and fluxes of point sources in the F115W and F200W filters' images of I Zw 18. To derive I Zw 18's SFH, we applied the color-magnitude diagram (CMD) fitting technique SFERA 2.0, using two independent sets of stellar models. Our analysis reveals three main stellar populations: one younger than $\sim30$ Myr, mainly in the northwest star-forming (SF) region; an intermediate-age population ($\sim 100 - 800$ Myr) in the southeast SF region; and a red and faint population linked to the underlying halo, older than 1 Gyr and possibly as old as 13.8 Gyr. The main body of the galaxy shows a very low star formation rate (SFR) of $\sim 10^{-4} M_{\odot} \text{yr}^{-1}$ between 1 and 13.8 Gyr ago. In the last billion years, I Zw 18 shows increasing SF, with strong bursts around $\sim10$ and $\sim100$ Myr ago. Component C mirrors the main body's evolution but with lower SFRs. Our findings confirm that I Zw 18 contains stars of all ages, indicating it is not a young galaxy but has an old stellar halo, similar to other BCDs. The low SF activity over the past billion years supports the "slow cooking" dwarf scenario, explaining its low metal content. Currently, the galaxy is undergoing its strongest SF episode ($\sim 0.6 M_{\odot} \text{yr}^{-1}$) mainly in the northwest region, likely due to a recent gravitational interaction with Component C.


title: Towards Probing Speech-Specific Risks in Large Multimodal Models: A Taxonomy, Benchmark, and Insights

abstract: Large Multimodal Models (LMMs) have achieved great success recently, demonstrating a strong capability to understand multimodal information and to interact with human users. Despite the progress made, the challenge of detecting high-risk interactions in multimodal settings, and in particular in speech modality, remains largely unexplored. Conventional research on risk for speech modality primarily emphasises the content (e.g., what is captured as transcription). However, in speech-based interactions, paralinguistic cues in audio can significantly alter the intended meaning behind utterances. In this work, we propose a speech-specific risk taxonomy, covering 8 risk categories under hostility (malicious sarcasm and threats), malicious imitation (age, gender, ethnicity), and stereotypical biases (age, gender, ethnicity). Based on the taxonomy, we create a small-scale dataset for evaluating current LMMs capability in detecting these categories of risk. We observe even the latest models remain ineffective to detect various paralinguistic-specific risks in speech (e.g., Gemini 1.5 Pro is performing only slightly above random baseline). Warning: this paper contains biased and offensive examples.


title: A Large-scale Investigation of Semantically Incompatible APIs behind Compatibility Issues in Android Apps

abstract: Application Programming Interface (API) incompatibility is a long-standing issue in Android application development. The rapid evolution of Android APIs results in a significant number of API additions, removals, and changes between adjacent versions. Unfortunately, this high frequency of alterations may lead to compatibility issues, often without adequate notification to developers regarding these changes. Although researchers have proposed some work on detecting compatibility issues caused by changes in API signatures, they often overlook compatibility issues stemming from sophisticated semantic changes. In response to this challenge, we conducted a large-scale discovery of incompatible APIs in the Android Open Source Project (AOSP) by leveraging static analysis and pre-trained Large Language Models (LLMs) across adjacent versions. We systematically formulate the problem and propose a unified framework to detect incompatible APIs, especially for semantic changes. It's worth highlighting that our approach achieves a 0.83 F1-score in identifying semantically incompatible APIs in the Android framework. Ultimately, our approach detects 5,481 incompatible APIs spanning from version 4 to version 33. We further demonstrate its effectiveness in supplementing the state-of-the-art methods in detecting a broader spectrum of compatibility issues (+92.3%) that have been previously overlooked.


title: Tuning the interlayer coupling in La0.7Sr0.3Mn0.95Ru0.05O3 / LaNiO3 multilayers with perpendicular magnetic anisotropy

abstract: In ferromagnetic oxide epitaxial multilayers, magnetic properties and interlayer coupling are determined by a variety of factors. Beyond the contribution of interlayer exchange coupling, strain and interfacial effects, such as structural reconstructions or charge transfer, play significant roles, resulting in complex magnetic behaviour. In this study the interlayer coupling of ferromagnetic La0.7Sr0.3Mn0.95Ru0.05O3 (LSMRO) layers (8 nm thick) was investigated, when separated by epitaxial spacers of paramagnetic metallic LaNiO3 (LNO), in stacks exhibiting perpendicular magnetic anisotropy. By varying the thickness of the spacer, it was found that the coupling between two LSMRO layers changes from antiferromagnetic (with a 4 unit cell thick LNO spacer) to ferromagnetic (with a 6 unit cells thick LNO spacer). For multilayers comprising five LSMRO layers and a 4 unit cell thick LNO spacer, the antiferromagnetic coupling was preserved. However, the effective magnetic anisotropy changed, causing the magnetization to cant more towards the in-plane direction. This behavior was corroborated by X-ray magnetic circular dichroism (XMCD) investigations at the Mn and Ni L3-edges. The XMCD results indicated that the 4 unit cells thick LNO spacer in the multilayer become magnetically ordered, closely following the magnetization of adjacent LSMRO layers.


title: Mind the Graph When Balancing Data for Fairness or Robustness

abstract: Failures of fairness or robustness in machine learning predictive settings can be due to undesired dependencies between covariates, outcomes and auxiliary factors of variation. A common strategy to mitigate these failures is data balancing, which attempts to remove those undesired dependencies. In this work, we define conditions on the training distribution for data balancing to lead to fair or robust models. Our results display that, in many cases, the balanced distribution does not correspond to selectively removing the undesired dependencies in a causal graph of the task, leading to multiple failure modes and even interference with other mitigation techniques such as regularization. Overall, our results highlight the importance of taking the causal graph into account before performing data balancing.


title: Moment-based parameter inference with error guarantees for stochastic reaction networks

abstract: Inferring parameters of models of biochemical kinetics from single-cell data remains challenging because of the uncertainty arising from the intractability of the likelihood function of stochastic reaction networks. Such uncertainty falls beyond current error quantification measures, which focus on the effects of finite sample size and identifiability but lack theoretical guarantees when likelihood approximations are needed. Here, we propose an inference method for stochastic reaction networks with nonlinear and rational propensities at steady state that provides bounds on the parameters via convex optimisation over sets constrained by moment equations and moment matrices. Our approach takes observations from the stochastic reaction network and forms moment intervals, which are then used to constrain parameters through convex sets. The bounds on the parameters contain the true parameters under the condition that the moment intervals contain the true stationary moments, thus providing uncertainty quantification and error guarantees. Our approach does not need to predict moments and distributions for given parameters (i.e., it avoids solving or simulating the forward problem), and hence circumvents intractable likelihood computations or computationally expensive simulations. We demonstrate its use for uncertainty quantification, data integration and prediction of latent species statistics through synthetic data from common nonlinear biochemical models including the Schl\"ogl model, the toggle switch and post-transcriptional regulation.

categories: q-bio.QM math.OC physics.bio-ph physics.data-an q-bio.MN


title: Echo chamber effects in signed networks

abstract: Echo chamber effects in social networks are generally attributed to the prevalence of interactions among like-minded peers. However, recent evidence has emphasized the role of hostile interactions between opposite-minded groups. Here, we model information propagation between such groups by generalizing popular contagion models to signed networks. We show that echo chambers spontaneously emerge in balanced networks, and in antibalanced ones for specific parameters. The robustness of our results is confirmed through simulations on various network topologies, including a real-world dataset.


title: Markovianity and non-Markovianity of Particle Bath with Dirac Dispersion Relation

abstract: The decay rate of quantum particles in open quantum systems has traditionally been known as exponential, based on empirical predictions from experiments and theoretical predictions from the Markovian dynamics of the corresponding quantum states. However, both theoretical predictions and experimental observations suggest deviations from this exponential decay, particularly in the short and long time regimes. In this study, we explore the spontaneous emission of a single Dirac particle within an environment characterized by an energy spectrum with a gap $m$ and an energy cutoff $L$. Our results reveal that high-energy structures, such as the spectral cutoff $L$, play a critical role in driving the short-time non-exponential decay. In contrast, the long-time decay is predominantly influenced by low-energy structures, such as the Dirac gap $m$. Surprisingly, we find that in the limits where the energy cutoff $L$ is infinite and the energy gap $m$ is zero, the decay dynamics of massless Dirac particles exhibit Markovian behavior without the need for conventional approximations like the Born-Markov approximation. This work underscores the complex interplay between particle energy properties and decay dynamics, providing new insights into quantum decay processes.


title: Advancing Question Answering on Handwritten Documents: A State-of-the-Art Recognition-Based Model for HW-SQuAD

abstract: Question-answering handwritten documents is a challenging task with numerous real-world applications. This paper proposes a novel recognition-based approach that improves upon the previous state-of-the-art on the HW-SQuAD and BenthamQA datasets. Our model incorporates transformer-based document retrieval and ensemble methods at the model level, achieving an Exact Match score of 82.02% and 92.55% in HW-SQuAD and BenthamQA datasets, respectively, surpassing the previous best recognition-based approach by 10.89% and 26%. We also enhance the document retrieval component, boosting the top-5 retrieval accuracy from 90% to 95.30%. Our results demonstrate the significance of our proposed approach in advancing question answering on handwritten documents. The code and trained models will be publicly available to facilitate future research in this critical area of natural language.


title: Implicit-Zoo: A Large-Scale Dataset of Neural Implicit Functions for 2D Images and 3D Scenes

abstract: Neural implicit functions have demonstrated significant importance in various areas such as computer vision, graphics. Their advantages include the ability to represent complex shapes and scenes with high fidelity, smooth interpolation capabilities, and continuous representations. Despite these benefits, the development and analysis of implicit functions have been limited by the lack of comprehensive datasets and the substantial computational resources required for their implementation and evaluation. To address these challenges, we introduce "Implicit-Zoo": a large-scale dataset requiring thousands of GPU training days designed to facilitate research and development in this field. Our dataset includes diverse 2D and 3D scenes, such as CIFAR-10, ImageNet-1K, and Cityscapes for 2D image tasks, and the OmniObject3D dataset for 3D vision tasks. We ensure high quality through strict checks, refining or filtering out low-quality data. Using Implicit-Zoo, we showcase two immediate benefits as it enables to: (1) learn token locations for transformer models; (2) directly regress 3D cameras poses of 2D images with respect to NeRF models. This in turn leads to an improved performance in all three task of image classification, semantic segmentation, and 3D pose regression, thereby unlocking new avenues for research.


title: Efficient generation of broadband photon pairs in shallow-etched lithium niobate nanowaveguide

abstract: We design and fabricate shallow-etched periodically poled lithium niobate waveguide to realize highly-efficient broadband spontaneous parametric down-conversion~(SPDC) on nanophotonic chip. The shallow-etched waveguide is capable to tolerate the non-uniformities of waveguide width induced by fabrication imperfections, enabling generation of photon pairs with high count rate and bandwidth. We demonstrate photon-pair generation with a high brightness of 11.7~GHz/mW and bandwidth of 22~THz, in a 5.7-mm-long PPLN waveguide. The generated photon pairs exhibit strong temporal correlation with a coincidence-to-accidental ratio up to 16262$\pm$850. Our results confirm the feasibility of shallow etching in fabrication of efficient SPDC device on platform of lithium niobate on insulator, and benefit quantum information processing with broadband photon source.


title: Effect of clustering on Turing instability in complex networks

abstract: Turing instability in complex networks have been shown in the literature to be dominated by the distribution of the nodal degrees. The conditions for Turing instability have been derived with an explicit dependence on the eigenvalues of the Laplacian, which in turn depends on the network topology. This study reveals that apart from average degree of the network, another global network measure - the nodal clustering - also plays a crucial role. Analytical and numerical results are presented to show the importance of clustering for several network topologies ranging from the $\mathbb{S}^1$ / $\mathbb{H}^2$ hyperbolic geometric networks that enable modelling the naturally occurring clustering in real world networks, as well as the random and scale free networks, which are obtained as limiting cases of the $\mathbb{S}^1$ / $\mathbb{H}^2$ model. Analysis of eigenvector localization properties in these networks are shown to reveal distinct signatures that enable identifying the so called Turing patterns even in complex networks.


title: A Matrix Product State Model for Simultaneous Classification and Generation

abstract: Quantum machine learning (QML) is a rapidly expanding field that merges the principles of quantum computing with the techniques of machine learning. One of the powerful mathematical frameworks in this domain is tensor networks. These networks are used to approximate high-order tensors by contracting tensors with lower ranks. Originally developed for simulating quantum systems, tensor networks have become integral to quantum computing and, by extension, to QML. Their ability to efficiently represent and manipulate complex, high-dimensional data makes them suitable for various machine learning tasks within the quantum realm. Here, we present a matrix product state (MPS) model, where the MPS functions as both a classifier and a generator. The dual functionality of this novel MPS model permits a strategy that enhances the traditional training of supervised MPS models. This framework is inspired by generative adversarial networks and is geared towards generating more realistic samples by reducing outliers. Additionally, our contributions offer insights into the mechanics of tensor network methods for generation tasks. Specifically, we discuss alternative embedding functions and a new sampling method from non-normalized MPSs.

categories: quant-ph math-ph math.MP physics.comp-ph stat.ML


title: Mamba24/8D: Enhancing Global Interaction in Point Clouds via State Space Model

abstract: Transformers have demonstrated impressive results for 3D point cloud semantic segmentation. However, the quadratic complexity of transformer makes computation cost high, limiting the number of points that can be processed simultaneously and impeding the modeling of long-range dependencies. Drawing inspiration from the great potential of recent state space models (SSM) for long sequence modeling, we introduce Mamba, a SSM-based architecture, to the point cloud domain and propose Mamba24/8D, which has strong global modeling capability under linear complexity. Specifically, to make disorderness of point clouds fit in with the causal nature of Mamba, we propose a multi-path serialization strategy applicable to point clouds. Besides, we propose the ConvMamba block to compensate for the shortcomings of Mamba in modeling local geometries and in unidirectional modeling. Mamba24/8D obtains state of the art results on several 3D point cloud segmentation tasks, including ScanNet v2, ScanNet200 and nuScenes, while its effectiveness is validated by extensive experiments.


title: Using joint angles based on the international biomechanical standards for human action recognition and related tasks

abstract: Keypoint data has received a considerable amount of attention in machine learning for tasks like action detection and recognition. However, human experts in movement such as doctors, physiotherapists, sports scientists and coaches use a notion of joint angles standardised by the International Society of Biomechanics to precisely and efficiently communicate static body poses and movements. In this paper, we introduce the basic biomechanical notions and show how they can be used to convert common keypoint data into joint angles that uniquely describe the given pose and have various desirable mathematical properties, such as independence of both the camera viewpoint and the person performing the action. We experimentally demonstrate that the joint angle representation of keypoint data is suitable for machine learning applications and can in some cases bring an immediate performance gain. The use of joint angles as a human meaningful representation of kinematic data is in particular promising for applications where interpretability and dialog with human experts is important, such as many sports and medical applications. To facilitate further research in this direction, we will release a python package to convert keypoint data into joint angles as outlined in this paper.


title: Bayesian Partial Reduced-Rank Regression

abstract: Reduced-rank (RR) regression may be interpreted as a dimensionality reduction technique able to reveal complex relationships among the data parsimoniously. However, RR regression models typically overlook any potential group structure among the responses by assuming a low-rank structure on the coefficient matrix. To address this limitation, a Bayesian Partial RR (BPRR) regression is exploited, where the response vector and the coefficient matrix are partitioned into low- and full-rank sub-groups. As opposed to the literature, which assumes known group structure and rank, a novel strategy is introduced that treats them as unknown parameters to be estimated. The main contribution is two-fold: an approach to infer the low- and full-rank group memberships from the data is proposed, and then, conditionally on this allocation, the corresponding (reduced) rank is estimated. Both steps are carried out in a Bayesian approach, allowing for full uncertainty quantification and based on a partially collapsed Gibbs sampler. It relies on a Laplace approximation of the marginal likelihood and the Metropolized Shotgun Stochastic Search to estimate the group allocation efficiently. Applications to synthetic and real-world data reveal the potential of the proposed method to reveal hidden structures in the data.


title: Copula-Based Estimation of Causal Effects in Multiple Linear and Path Analysis Models

abstract: Regression analysis is one of the most popularly used statistical technique which only measures the direct effect of independent variables on dependent variable. Path analysis looks for both direct and indirect effects of independent variables and may overcome several hurdles allied with regression models. It utilizes one or more structural regression equations in the model which are used to estimate the unknown parameters. The aim of this work is to study the path analysis models when the endogenous (dependent) variable and exogenous (independent) variables are linked through the elliptical copulas. Using well-organized numerical schemes, we investigate the performance of path models when direct and indirect effects are estimated applying classical ordinary least squares and copula-based regression approaches in different scenarios. Finally, two real data applications are also presented to demonstrate the performance of path analysis using copula approach.


title: Data-Driven Turbulence Modeling Approach for Cold-Wall Hypersonic Boundary Layers

abstract: Wall-cooling effect in hypersonic boundary layers can significantly alter the near-wall turbulence behavior, which is not accurately modeled by traditional RANS turbulence models. To address this shortcoming, this paper presents a turbulence modeling approach for hypersonic flows with cold-wall conditions using an iterative ensemble Kalman method. Specifically, a neural-network-based turbulence model is used to provide closure mapping from mean flow quantities to Reynolds stress as well as a variable turbulent Prandtl number. Sparse observation data of velocity and temperature are used to train the turbulence model. This approach is analyzed using direct numerical simulation database for boundary layer flows over a flat plate with a Mach number between 6 and 14 and wall-to-recovery temperature ratios ranging from 0.18 to 0.76. Two training cases are conducted: 1) a single training case with observation data from one flow case, 2) a joint training case where data from two flow cases are simultaneously used for training. Trained models are also tested for generalizability on the remaining flow cases in each of the training cases. The results are also analyzed for insights to inform the future work towards enhancing the generalizability of the learned turbulence model.


title: Constraints on local processes

abstract: If we want to transform the quantum of state of a system to another using local processes, what is the probability of success? It turns out that this probability can be bounded by quantifying entanglement within both the states. In this paper, we construct a family of multipartite entanglement measures that are monotonic under local operations and classical communication on average. The measures are constructed out of local unitary invariant polynomials of the state and its conjugate, and hence are easy to compute for pure states. Using these measures we bound the success probability of transforming a given state into another state using local quantum operations and classical communication.


title: Optimal Reflection Coefficients for ASK Modulated Backscattering from Passive Tags

abstract: A passive backscatter tag is an energy-efficient wireless communication device that is ideal for low-power and low-bandwidth applications, such as sensing and identification. Despite their usefulness, the effectiveness of these tags is limited by the amount of energy they can harness from the incident radio signals used to backscatter their information through the modulation of reflections. This paper aims to maximize this harvested power at a passive tag by optimally designing the underlying M-ary amplitude-shift keying (ASK) modulator in a monostatic backscatter communication (BackCom) system. Specifically, we derive the closed-form expression for the global optimal reflection coefficients that maximize the tag's harvested power while satisfying the minimum symbol error rate (SER) requirement, tag sensitivity, and reader sensitivity constraints. We also proposed optimal binary-ASK modulation design to gain novel design insights on practical BackCom systems with readers having superior sensitivity. We have validated these nontrivial analytical claims via extensive simulations. The numerical results provide insight into the impact of the transmit symbol probability, tag sensitivity constraint, and SER on the maximum average harvested power. Remarkably, our design achieves an overall gain of around 13% over the benchmark, signifying its utility in improving the efficiency of BackCom systems.


title: Pulsating string solution and stability in two parameter $\chi$-deformed background

abstract: In this paper, we investigate pulsating string solutions within the context of a two-parameter $\chi$-deformed $\mathcal{R} \times S^2$ background. We derive the energy and oscillation number relation for the deformed $\mathcal{R} \times S^2$ in a short string limit. Additionally, we derive the first-order perturbation equation for a pulsating string in this specific background. As a special case of the two-parameter deformed background, we examine the stability of the pulsating string solution in one-parameter deformed $\mathcal{R} \times S^2$ and $AdS_3$ background by setting one of the deformation parameters to zero.


title: Pseudo Labelling for Enhanced Masked Autoencoders

abstract: Masked Image Modeling (MIM)-based models, such as SdAE, CAE, GreenMIM, and MixAE, have explored different strategies to enhance the performance of Masked Autoencoders (MAE) by modifying prediction, loss functions, or incorporating additional architectural components. In this paper, we propose an enhanced approach that boosts MAE performance by integrating pseudo labelling for both class and data tokens, alongside replacing the traditional pixel-level reconstruction with token-level reconstruction. This strategy uses cluster assignments as pseudo labels to promote instance-level discrimination within the network, while token reconstruction requires generation of discrete tokens encapturing local context. The targets for pseudo labelling and reconstruction needs to be generated by a teacher network. To disentangle the generation of target pseudo labels and the reconstruction of the token features, we decouple the teacher into two distinct models, where one serves as a labelling teacher and the other as a reconstruction teacher. This separation proves empirically superior to a single teacher, while having negligible impact on throughput and memory consumption. Incorporating pseudo-labelling as an auxiliary task has demonstrated notable improvements in ImageNet-1K and other downstream tasks, including classification, semantic segmentation, and detection.


title: Quantization of Carrollian conformal scalar theories

abstract: In this work, we study the quantization of Carrollian conformal scalar theories, including two-dimensional(2D) magnetic scalar and three-dimensional(3D) electric and magnetic scalars. We discuss two different quantization schemes, depending on the choice of the vacuum. We show that the standard canonical quantization corresponding to the induced vacuum yields a unitary Hilbert space and the 2-point correlation functions in this scheme match exactly with the ones computed from the path integral. In the canonical quantization, the BMS symmetry can be realized without anomaly. On the other hand, for the quantization based on the highest-weight vacuum, it does not have a unitary Hilbert space. In 2D, the correlators in the highest-weight vacuum agree with the ones obtained by taking the $c\to 0$ limit of the 2D CFT, and there is an anomalous term in the commutation relations between the Virasoso generators, whose form is similar to the one in 2D CFT. In 3D, there is no good definition of the highest-weight vacuum without breaking the rotational symmetry. In our study, we find that the usual state-operator correspondence in CFT does not hold in the Carrollian case.


title: Study of the $f_{0}(980)$ through the decay $D_{s}^{+}\rightarrow \pi^{+}\pi^{+}\pi^{-}\pi^{0}$

abstract: We perform the first amplitude analysis of $D^+_s \to \pi^+\pi^+\pi^-\pi^0$ decays, based on data samples of electron-positron collisions recorded with the BESIII detector at center-of-mass energies between 4.128 and 4.226 GeV, corresponding to an integrated luminosity of 7.33~fb$^{-1}$. We report the observation of $D_{s}^{+} \to f_0(980)\rho(770)^{+}$ with a statistical significance greater than 10$\sigma$ and determine the branching fractions $\mathcal{B}(D_s^+\to\pi^+\pi^+\pi^-\pi^0|_{{\rm non}-\eta})=(2.04\pm0.08_{\rm stat.}\pm0.05_{\rm syst.})\%$ and $\mathcal{B}(D_s^+\to\eta\pi^+)=(1.56\pm0.09_{\rm stat.}\pm0.04_{\rm syst.})\%$. Moreover, we measure the relative branching fraction between $\phi\to\pi^+\pi^-\pi^0$ and $\phi\to K^+K^-$ to be $\frac{\mathcal{B}(\phi(1020) \to \pi^+\pi^-\pi^0)}{\mathcal{B}(\phi(1020) \to K^+K^-)}=0.230 \pm 0.014_{\rm stat.} \pm 0.010_{\rm syst.}$, which deviates from the world average value by more than $4\sigma$.


title: Learning to Ask Informative Questions: Enhancing LLMs with Preference Optimization and Expected Information Gain

abstract: Questions are essential tools for acquiring the necessary information to complete information-seeking tasks. However, large language models (LLMs), especially open-source models, often perform poorly in generating informative questions, as measured by expected information gain (EIG). In this paper, we propose a method to enhance the informativeness of LLM-generated questions in 20-question game dialogues. We sample multiple questions from the same model (LLAMA 2-CHAT 7B) for each game and create pairs of low-EIG and high-EIG questions to apply a Direct Preference Optimization (DPO) algorithm. Our results show that this method produces more effective questions (in terms of EIG), even in domains different from those used to train the DPO model.


title: On torsion in the Kauffman bracket skein module of $3$-manifolds

abstract: We study Kirby problems 1.92(E)-(G), which, roughly speaking, ask for which compact oriented $3$-manifold $M$ the Kauffman bracket skein module $\mathcal{S}(M)$ has torsion as a $\mathbb{Z}[A^{\pm 1}]$-module. We give new criteria for the presence of torsion in terms of how large the $SL_2(\mathbb{C})$-character variety of $M$ is. This gives many counterexamples to question 1.92(G)-(i) in Kirby's list. For manifolds with incompressible tori, we give new effective criteria for the presence of torsion, revisiting the work of Przytycki and Veve. We also show that $\mathcal{S}(\mathbb{R P}^3# L(p,1))$ has torsion when $p$ is even. Finally, we show that for $M$ an oriented Seifert manifold, closed or with boundary, $\mathcal{S}(M)$ has torsion if and only if $M$ admits a $2$-sided non-boundary parallel essential surface.


title: Smart Casual Verification of CCF's Distributed Consensus and Consistency Protocols

abstract: The Confidential Consortium Framework (CCF) is an open-source platform for developing trustworthy and reliable cloud applications. CCF powers Microsoft's Azure Confidential Ledger service and as such it is vital to build confidence in the correctness of CCF's design and implementation. This paper reports our experiences applying smart casual verification to validate the correctness of CCF's novel distributed protocols, focusing on its unique distributed consensus protocol and its custom client consistency model. We use the term smart casual verification to describe our hybrid approach, which combines the rigor of formal specification and model checking with the pragmatism of automated testing, in our case binding the formal specification in TLA+ to the C++ implementation. While traditional formal methods approaches require substantial buy-in and are often one-off efforts by domain experts, we have integrated our smart casual verification approach into CCF's continuous integration pipeline, allowing contributors to continuously validate CCF as it evolves. We describe the challenges we faced in applying smart casual verification to a complex existing codebase and how we overcame them to find subtle bugs in the design and implementation before they could impact production.


title: Improving Grammatical Error Correction via Contextual Data Augmentation

abstract: Nowadays, data augmentation through synthetic data has been widely used in the field of Grammatical Error Correction (GEC) to alleviate the problem of data scarcity. However, these synthetic data are mainly used in the pre-training phase rather than the data-limited fine-tuning phase due to inconsistent error distribution and noisy labels. In this paper, we propose a synthetic data construction method based on contextual augmentation, which can ensure an efficient augmentation of the original data with a more consistent error distribution. Specifically, we combine rule-based substitution with model-based generation, using the generative model to generate a richer context for the extracted error patterns. Besides, we also propose a relabeling-based data cleaning method to mitigate the effects of noisy labels in synthetic data. Experiments on CoNLL14 and BEA19-Test show that our proposed augmentation method consistently and substantially outperforms strong baselines and achieves the state-of-the-art level with only a few synthetic data.


title: Additively manufacturable high-strength aluminum alloys with thermally stable microstructures enabled by hybrid machine learning-based design

abstract: Additively manufactured (AM) structural components with complex geometries and tailored properties at voxel-size resolution will lead to significant leap in performance in various critical engineering applications. However, at each voxel, we first need to be able to design the alloy efficiently and reliably. We demonstrate a hybrid approach combining calculation of phase diagram (CALPHAD)-based integrated computational materials engineering (ICME) with machine learning and inverse design techniques and performed a full alloy design cycle of a novel Al alloy (Al-Er-Zr-Y-Yb-Ni) for AM from virtual predictions to experimental validation. We designed this alloy to exhibit high tensile strength at room temperature through nanoscale L1$_2$-phase precipitation which stabilizes the microstructure to maintain strength after high-temperature aging. We initially exploit a fine distribution of metastable eutectic ternary phases through rapid solidification, which serve as the source for the reactive elements enabling nanoscale precipitation of a high phase fraction of the thermally stable L1$_2$ strengthening phases. The strength of the 3D-printed samples manufactured via laser powder bed fusion (LPBF) from the designed composition is comparable to that of wrought Al 7075, and after high-temperature (400$^\circ$C) aging is 50% stronger than the best benchmark printable Al alloy1. The stable strengthening strategy is applicable to a wide range of alloys and rapid solidification processes, and our hybrid ML/CALPHAD numerical framework can be used for the efficient and robust design of alloy microstructures and properties, expanding the capabilities of additive as well as traditional manufacturing.


title: Continuous Urban Change Detection from Satellite Image Time Series with Temporal Feature Refinement and Multi-Task Integration

abstract: Urbanization advances at unprecedented rates, resulting in negative effects on the environment and human well-being. Remote sensing has the potential to mitigate these effects by supporting sustainable development strategies with accurate information on urban growth. Deep learning-based methods have achieved promising urban change detection results from optical satellite image pairs using convolutional neural networks (ConvNets), transformers, and a multi-task learning setup. However, transformers have not been leveraged for urban change detection with multi-temporal data, i.e., >2 images, and multi-task learning methods lack integration approaches that combine change and segmentation outputs. To fill this research gap, we propose a continuous urban change detection method that identifies changes in each consecutive image pair of a satellite image time series. Specifically, we propose a temporal feature refinement (TFR) module that utilizes self-attention to improve ConvNet-based multi-temporal building representations. Furthermore, we propose a multi-task integration (MTI) module that utilizes Markov networks to find an optimal building map time series based on segmentation and dense change outputs. The proposed method effectively identifies urban changes based on high-resolution satellite image time series acquired by the PlanetScope constellation (F1 score 0.551) and Gaofen-2 (F1 score 0.440). Moreover, our experiments on two challenging datasets demonstrate the effectiveness of the proposed method compared to bi-temporal and multi-temporal urban change detection and segmentation methods.


title: Orbits of a symmetric subgroup in the Bruhat-Tits building

abstract: Let $G$ be a connected reductive algebraic group defined over a non-archimedean locally compact field $F$ of odd residue characteristic. Let $\theta$ be an $F$-rational involution of $G$ and $H$ be the reductive $F$-group $G^\theta$. We describe the orbits of the symmetric subgroup $H_F$ in the set of chambers of the reduced building of $G$ over $F$.


title: Investigating Self-Supervised Methods for Label-Efficient Learning

abstract: Vision transformers combined with self-supervised learning have enabled the development of models which scale across large datasets for several downstream tasks like classification, segmentation and detection. The low-shot learning capability of these models, across several low-shot downstream tasks, has been largely under explored. We perform a system level study of different self supervised pretext tasks, namely contrastive learning, clustering, and masked image modelling for their low-shot capabilities by comparing the pretrained models. In addition we also study the effects of collapse avoidance methods, namely centring, ME-MAX, sinkhorn, on these downstream tasks. Based on our detailed analysis, we introduce a framework involving both mask image modelling and clustering as pretext tasks, which performs better across all low-shot downstream tasks, including multi-class classification, multi-label classification and semantic segmentation. Furthermore, when testing the model on full scale datasets, we show performance gains in multi-class classification, multi-label classification and semantic segmentation.