title: Exploring Alignment in Shared Cross-lingual Spaces

abstract: Despite their remarkable ability to capture linguistic nuances across diverse languages, questions persist regarding the degree of alignment between languages in multilingual embeddings. Drawing inspiration from research on high-dimensional representations in neural language models, we employ clustering to uncover latent concepts within multilingual models. Our analysis focuses on quantifying the \textit{alignment} and \textit{overlap} of these concepts across various languages within the latent space. To this end, we introduce two metrics \CA{} and \CO{} aimed at quantifying these aspects, enabling a deeper exploration of multilingual embeddings. Our study encompasses three multilingual models (\texttt{mT5}, \texttt{mBERT}, and \texttt{XLM-R}) and three downstream tasks (Machine Translation, Named Entity Recognition, and Sentiment Analysis). Key findings from our analysis include: i) deeper layers in the network demonstrate increased cross-lingual \textit{alignment} due to the presence of language-agnostic concepts, ii) fine-tuning of the models enhances \textit{alignment} within the latent space, and iii) such task-specific calibration helps in explaining the emergence of zero-shot capabilities in the models.\footnote{The code is available at \url{https://github.com/baselmousi/multilingual-latent-concepts}}


title: Regressor-free Molecule Generation to Support Drug Response Prediction

abstract: Drug response prediction (DRP) is a crucial phase in drug discovery, and the most important metric for its evaluation is the IC50 score. DRP results are heavily dependent on the quality of the generated molecules. Existing molecule generation methods typically employ classifier-based guidance, enabling sampling within the IC50 classification range. However, these methods fail to ensure the sampling space range's effectiveness, generating numerous ineffective molecules. Through experimental and theoretical study, we hypothesize that conditional generation based on the target IC50 score can obtain a more effective sampling space. As a result, we introduce regressor-free guidance molecule generation to ensure sampling within a more effective space and support DRP. Regressor-free guidance combines a diffusion model's score estimation with a regression controller model's gradient based on number labels. To effectively map regression labels between drugs and cell lines, we design a common-sense numerical knowledge graph that constrains the order of text representations. Experimental results on the real-world dataset for the DRP task demonstrate our method's effectiveness in drug discovery. The code is available at:https://anonymous.4open.science/r/RMCD-DBD1.


title: Tau and low multiplicity decays at Belle and Belle II

abstract: We present recent measurements of $\tau$ physics at the Belle II experiment at SuperKEKB. Measurements include a test of $e-\mu$ lepton flavor universality in $\tau$ decays, a search for the lepton flavor violating $\tau \rightarrow \mu \mu \mu$ decay and a precision measurement of the $\tau$ lepton invariant mass. In addition, we present a measurement of the low multiplicity decay cross section $\sigma(e^+ e^- \rightarrow \pi^+ \pi^- \pi^0)$, a key input in the theoretical prediction of the anomalous magnetic moment of the muon.


title: Measurement of the production cross section of prompt $\Xi^0_{\rm c}$ baryons in p$-$Pb collisions at $\sqrt{s_{\mathrm{NN}}}~=~5.02$ TeV

abstract: The transverse momentum ($p_{\rm T}$) differential production cross section of the promptly-produced charm-strange baryon $\Xi_{\rm c}^{0}$ (and its charge conjugate $\overline{\Xi_{\rm c}^{0}}$) is measured at midrapidity via its hadronic decay into ${\rm \pi^{+}}\Xi^{-}$ in p$-$Pb collisions at a centre-of-mass energy per nucleon$-$nucleon collision $\sqrt{s_{\mathrm{NN}}}~=~5.02$ TeV with the ALICE detector at the LHC. The $\Xi_{\rm c}^{0}$ nuclear modification factor ($R_{\rm pPb}$), calculated from the cross sections in pp and p$-$Pb collisions, is presented and compared with the $R_{\rm pPb}$ of $\Lambda_{\rm c}^{+}$ baryons. The ratios between the $p_{\rm T}$-differential production cross section of $\Xi_{\rm c}^{0}$ baryons and those of $\mathrm {D^0}$ mesons and $\Lambda_{\rm c}^{+}$ baryons are also reported and compared with results at forward and backward rapidity from the LHCb Collaboration. The measurements of the production cross section of prompt $\Xi^0_{\rm c}$ baryons are compared with a model based on perturbative QCD calculations of charm-quark production cross sections, which includes only cold nuclear matter effects in p$-$Pb collisions, and underestimates the measurement by a factor of about 50. This discrepancy is reduced when the data is compared with a model in which hadronisation is implemented via quark coalescence. The $p_{\rm T}$-integrated cross section of prompt $\Xi^0_{\rm c}$-baryon production at midrapidity extrapolated down to $p_{\rm T}$ = 0 is also reported. These measurements offer insights and constraints for theoretical calculations of the hadronisation process. Additionally, they provide inputs for the calculation of the charm production cross section in p$-$Pb collisions at midrapidity.


title: VINS-Multi: A Robust Asynchronous Multi-camera-IMU State Estimator

abstract: State estimation is a critical foundational module in robotics applications, where robustness and performance are paramount. Although in recent years, many works have been focusing on improving one of the most widely adopted state estimation methods, visual inertial odometry (VIO), by incorporating multiple cameras, these efforts predominantly address synchronous camera systems. Asynchronous cameras, which offer simpler hardware configurations and enhanced resilience, have been largely overlooked. To fill this gap, this paper presents VINS-Multi, a novel multi-camera-IMU state estimator for asynchronous cameras. The estimator comprises parallel front ends, a front end coordinator, and a back end optimization module capable of handling asynchronous input frames. It utilizes the frames effectively through a dynamic feature number allocation and a frame priority coordination strategy. The proposed estimator is integrated into a customized quadrotor platform and tested in multiple realistic and challenging scenarios to validate its practicality. Additionally, comprehensive benchmark results are provided to showcase the robustness and superior performance of the proposed estimator.


title: This Too Shall Pass: Removing Stale Observations in Dynamic Bayesian Optimization

abstract: Bayesian Optimization (BO) has proven to be very successful at optimizing a static, noisy, costly-to-evaluate black-box function $f : \mathcal{S} \to \mathbb{R}$. However, optimizing a black-box which is also a function of time (i.e., a dynamic function) $f : \mathcal{S} \times \mathcal{T} \to \mathbb{R}$ remains a challenge, since a dynamic Bayesian Optimization (DBO) algorithm has to keep track of the optimum over time. This changes the nature of the optimization problem in at least three aspects: (i) querying an arbitrary point in $\mathcal{S} \times \mathcal{T}$ is impossible, (ii) past observations become less and less relevant for keeping track of the optimum as time goes by and (iii) the DBO algorithm must have a high sampling frequency so it can collect enough relevant observations to keep track of the optimum through time. In this paper, we design a Wasserstein distance-based criterion able to quantify the relevancy of an observation with respect to future predictions. Then, we leverage this criterion to build W-DBO, a DBO algorithm able to remove irrelevant observations from its dataset on the fly, thus maintaining simultaneously a good predictive performance and a high sampling frequency, even in continuous-time optimization tasks with unknown horizon. Numerical experiments establish the superiority of W-DBO, which outperforms state-of-the-art methods by a comfortable margin.


title: Concurrence of directional Kondo transport and incommensurate magnetic order in the layered material AgCrSe$_2$

abstract: In this work, we report on the concurrent emergence of the directional Kondo behavior and incommensurate magnetic ordering in a layered material. We employ temperature- and magnetic field-dependent resistivity measurements, susceptibility measurements, and high resolution wavelength X-ray diffraction spectroscopy to study the electronic properties of AgCrSe$_2$. Impurity Kondo behavior with a characteristic temperature of $T_\text K$ = 32 K is identified through quantitative analysis of the in-plane resistivity, substantiated by magneto-transport measurements. The agreement between our experimental data and the Schlottmann's scaling theory allows us to determine the impurity spin as $S$ = 3/2. Furthermore, we discuss the origin of the Kondo behavior and its relation to the material's antiferromagnetic transition. Our study uncovers an unusual phenomenon -- the equivalence of the N\'eel temperature and the Kondo temperature -- paving the way for further investigations into the intricate interplay between impurity physics and magnetic phenomena in quantum materials, with potential applications in advanced electronic and magnetic devices.


title: Emergence of metastability in frustrated oscillatory networks: the key role of hierarchical modularity

abstract: Oscillatory complex networks in the metastable regime have been used to study the emergence of integrated and segregated activity in the brain, which are hypothesised to be fundamental for cognition. Yet, the parameters and the underlying mechanisms necessary to achieve the metastable regime are hard to identify, often relying on maximising the correlation with empirical functional connectivity dynamics. Here, we propose and show that the brain's hierarchically modular mesoscale structure alone can give rise to robust metastable dynamics and (metastable) chimera states in the presence of phase frustration. We construct unweighted $3$-layer hierarchical networks of identical Kuramoto-Sakaguchi oscillators, parameterized by the average degree of the network and a structural parameter determining the ratio of connections between and within blocks in the upper two layers. Together, these parameters affect the characteristic timescales of the system. Away from the critical synchronization point, we detect the emergence of metastable states in the lowest hierarchical layer coexisting with chimera and metastable states in the upper layers. Using the Laplacian renormalization group flow approach, we uncover two distinct pathways towards achieving the metastable regimes detected in these distinct layers. In the upper layers, we show how the symmetry-breaking states depend on the slow eigenmodes of the system. In the lowest layer instead, metastable dynamics can be achieved as the separation of timescales between layers reaches a critical threshold. Our results show an explicit relationship between metastability, chimera states, and the eigenmodes of the system, bridging the gap between harmonic based studies of empirical data and oscillatory models.


title: Initial Burst of Disruptive Efforts Ensuring Scientific Career Viability

abstract: Despite persistent efforts to understand the dynamics of creativity of scientists over careers in terms of productivity, impact, and prize, little is known about the dynamics of scientists' disruptive efforts that affect individual academic careers and drive scientific advance. Drawing on millions of data over six decades and across nineteen disciplines, associating the publication records of individual scientists with the disruption index, we systematically quantify the temporal pattern of disruptive ideas over individual scientific careers, providing a detailed understanding of the macro phenomenon of scientific stagnation from the individual perspective. We start by checking the relationship between disruption-based and citation-based publication profiles. Next, we observe the finite inequality in the disruptive productivity of scientists, diminishing gradually as the level of disruption increases. We then identify the initial burst phenomenon in disruption dynamics. It is further revealed that while early engagement in high disruption frictions away initial productivity, compared to initial advantage in productivity or impact, initial high disruption ensures more subsequent academic viability evidenced by a longer career span and relatively final higher productivity, but does not necessarily guarantee academic success throughout careers. Further analysis shows that increasing disruptive work is uncorrelated to overall productivity but negatively correlated with the overall impact. However, increasing disruptive work in the early career is associated with higher overall productivity, yet lower overall productivity in the later career. Our research underscores the urgent need for a policy shift that encourages a balance between the pursuit of disruptive efforts and the achievement of impactful outcomes.


title: Nuclear Norm Regularization for Deep Learning

abstract: Penalizing the nuclear norm of a function's Jacobian encourages it to locally behave like a low-rank linear map. Such functions vary locally along only a handful of directions, making the Jacobian nuclear norm a natural regularizer for machine learning problems. However, this regularizer is intractable for high-dimensional problems, as it requires computing a large Jacobian matrix and taking its singular value decomposition. We show how to efficiently penalize the Jacobian nuclear norm using techniques tailor-made for deep learning. We prove that for functions parametrized as compositions $f = g \circ h$, one may equivalently penalize the average squared Frobenius norm of $Jg$ and $Jh$. We then propose a denoising-style approximation that avoids the Jacobian computations altogether. Our method is simple, efficient, and accurate, enabling Jacobian nuclear norm regularization to scale to high-dimensional deep learning problems. We complement our theory with an empirical study of our regularizer's performance and investigate applications to denoising and representation learning.


title: A Cross-Field Fusion Strategy for Drug-Target Interaction Prediction

abstract: Drug-target interaction (DTI) prediction is a critical component of the drug discovery process. In the drug development engineering field, predicting novel drug-target interactions is extremely crucial.However, although existing methods have achieved high accuracy levels in predicting known drugs and drug targets, they fail to utilize global protein information during DTI prediction. This leads to an inability to effectively predict interaction the interactions between novel drugs and their targets. As a result, the cross-field information fusion strategy is employed to acquire local and global protein information. Thus, we propose the siamese drug-target interaction SiamDTI prediction method, which utilizes a double channel network structure for cross-field supervised learning.Experimental results on three benchmark datasets demonstrate that SiamDTI achieves higher accuracy levels than other state-of-the-art (SOTA) methods on novel drugs and targets.Additionally, SiamDTI's performance with known drugs and targets is comparable to that of SOTA approachs. The code is available at https://anonymous.4open.science/r/DDDTI-434D.


title: Global Behavior of Learning Dynamics in Zero-Sum Games with Memory Asymmetry

abstract: This study examines the global behavior of dynamics in learning in games between two players, X and Y. We consider the simplest situation for memory asymmetry between two players: X memorizes the other Y's previous action and uses reactive strategies, while Y has no memory. Although this memory complicates the learning dynamics, we discover two novel quantities that characterize the global behavior of such complex dynamics. One is an extended Kullback-Leibler divergence from the Nash equilibrium, a well-known conserved quantity from previous studies. The other is a family of Lyapunov functions of X's reactive strategy. These two quantities capture the global behavior in which X's strategy becomes more exploitative, and the exploited Y's strategy converges to the Nash equilibrium. Indeed, we theoretically prove that Y's strategy globally converges to the Nash equilibrium in the simplest game equipped with an equilibrium in the interior of strategy spaces. Furthermore, our experiments also suggest that this global convergence is universal for more advanced zero-sum games than the simplest game. This study provides a novel characterization of the global behavior of learning in games through a couple of indicators.


title: Causal Effect Identification in a Sub-Population with Latent Variables

abstract: The s-ID problem seeks to compute a causal effect in a specific sub-population from the observational data pertaining to the same sub population (Abouei et al., 2023). This problem has been addressed when all the variables in the system are observable. In this paper, we consider an extension of the s-ID problem that allows for the presence of latent variables. To tackle the challenges induced by the presence of latent variables in a sub-population, we first extend the classical relevant graphical definitions, such as c-components and Hedges, initially defined for the so-called ID problem (Pearl, 1995; Tian & Pearl, 2002), to their new counterparts. Subsequently, we propose a sound algorithm for the s-ID problem with latent variables.


title: Rapid modelling of reactive transport in porous media using machine learning: limitations and solutions

abstract: Reactive transport in porous media plays a pivotal role in subsurface reservoir processes, influencing fluid properties and geochemical characteristics. However, coupling fluid flow and transport with geochemical reactions is computationally intensive, requiring geochemical calculations at each grid cell and each time step within a discretized simulation domain. Although recent advancements have integrated machine learning techniques as surrogates for geochemical simulations, ensuring computational efficiency and accuracy remains a challenge. This chapter investigates machine learning models as replacements for a geochemical module in a reactive transport in porous media simulation. We test this approach on a well-documented cation exchange problem. While the surrogate models excel in isolated predictions, they fall short in rollout predictions over successive time steps. By introducing modifications, including physics-based constraints and tailored dataset generation strategies, we show that machine learning surrogates can achieve accurate rollout predictions. Our findings emphasize that, when judiciously designed, machine learning surrogates can substantially expedite the cation exchange problem without compromising accuracy, offering significant potential for a range of reactive transport applications.


title: Efficient recursive encoders for quantum Reed-Muller codes towards Fault tolerance

abstract: Transversal gates are logical gate operations on encoded quantum information that are efficient in gate count and depth, and are designed to minimize error propagation. Efficient encoding circuits for quantum codes that admit transversal gates are thus crucial to reduce noise and realize useful quantum computers. The class of punctured Quantum Reed-Muller codes admit transversal gates. We construct resource efficient recursive encoders for the class of quantum codes constructed from Reed-Muller and punctured Reed-Muller codes. These encoders on $n$ qubits have circuit depth of $O(\log n)$ and lower gate counts compared to previous works. The number of CNOT gates in the encoder across bi-partitions of the qubits is found to be equal to the entanglement entropy across these partitions, demonstrating that the encoder is optimal in terms of CNOT gates across these partitions. Finally, connecting these ideas, we explicitly show that entanglement can be extracted from QRM codewords.


title: Non-Euclidean conformal devices with continuously varying refractive index profiles based on bi-spheres

abstract: Either conformal transformation optics or geodesic mapping provides a design method to bend light rays in two-dimensional space with a nonuniform refractive index profile. In this paper, we combine both methods above to design a conformal invisible cloak based on bi-spheres with a refractive index profile varying from 0 to 10.7, smaller than 24.6 for the previous case of a single sphere. Moreover, we obtain an omnidirectional retro-reflector and a specular reflector by making position adjustments to mirrors, and achieve similar invisible effect by tuning sizes of the bi-spheres. Our work expands the toolkits for designing conformal devices with continuously-varying index profile.


title: Lattice Boltzmann methods for soft flowing matter

abstract: Over the last decade, the Lattice Boltzmann method has found major scope for the simulation of a large spectrum of problems in soft matter, from multiphase and multi-component microfluidic flows, to foams, emulsions, colloidal flows, to name but a few. Crucial to many such applications is the role of supramolecular interactions which occur whenever mesoscale structures, such as bubbles or droplets, come in close contact, say of the order of tens of nanometers. Regardless of their specific physico-chemical origin, such near-contact interactions are vital to preserve the coherence of the mesoscale structures against coalescence phenomena promoted by capillarity and surface tension, hence the need of including them in Lattice Boltzmann schemes. Strictly speaking, this entails a complex multiscale problem, covering about six spatial decades, from centimeters down to tens of nanometers, and almost twice as many in time. Such a multiscale problem can hardly be taken by a single computational method, hence the need for coarse-grained models for the near-contact interactions. In this review, we shall discuss such coarse-grained models and illustrate their application to a variety of soft flowing matter problems, such as soft flowing crystals, strongly confined dense emulsions, flowing hierarchical emulsions, soft granular flows, as well as the transmigration of active droplets across constrictions. Finally, we conclude with a few considerations on future developments in the direction of quantum-nanofluidics, machine learning, and quantum computing for soft flows applications.


title: Design and Development of a Roaming Wireless Safety Emergency Stop

abstract: Modern manufacturing is characterized by a high degree of automation, with autonomous systems also frequently being used. In such environments human intervention in the event of malfunctions or maintenance becomes a rare but also necessary task. When human workers are no longer an integral part of the production process, but only intervene when necessary, e.g., in the case of unexpected machine behavior, appropriate safety solutions will become even more important. This work describes a wireless communication system enabling a flexible and safe emergency stop function for multiple automation cells. A portable emergency stop switch allows seamless transition between different wireless cells, ensuring functional safety. The communication protocol combines IO-Link Wireless features with the safety requirements already implemented in IO-Link Safety. Security requirements are fulfilled through encryption and authentication. The IO-Link Wireless roaming functionality is used to extend the system across several manufacturing cells. An experimental setup confirms the suitability of the system for various applications. The results demonstrate the effectiveness of the handover mechanism and evaluate the potential of the system to improve flexibility, availability and security in dynamic production environments. Future extensions could include the use of AI based evaluation of the radio signals for an intelligent cell handover.


title: Nonvanishing and Abundance for cones of movable divisors

abstract: Let $\overline{\mathrm{Mov}}^k(X)$ be the closure of the cone $\mathrm{Mov}^k(X)$ generated by classes of effective divisors on a projective variety $X$ with stable base locus of codimension at least $k+1$. We propose a generalized version of the Log Nonvanishing Conjecture and of the Log Abundance Conjecture for a klt pair $(X,\Delta)$, that is: if $K_X+\Delta \in \overline{\mathrm{Mov}}^{k}(X)$, then $K_X+\Delta \in \mathrm{Mov}^{k}(X)$. Moreover, we prove that if the Log Minimal Model Program, the Log Nonvanishing, and the Log Abundance hold, then so does our conjecture.


title: UDKAG: Augmenting Large Vision-Language Models with Up-to-Date Knowledge

abstract: Large vision-language models (LVLMs) are ignorant of the up-to-date knowledge, such as LLaVA series, because they cannot be updated frequently due to the large amount of resources required, and therefore fail in many cases. For example, if a LVLM was released on January 2024, and it wouldn't know the detailed plot of the new movie Dune 2, which wasn't released until February 2024. To solve the problem, a promising solution is to provide LVLMs with up-to-date knowledge via internet search during inference, i.e., internet-augmented generation (IAG), which is already integrated in some closed-source commercial LVLMs such as GPT-4V. However, the specific mechanics underpinning them remain a mystery. In this paper, we propose a plug-and-play framework, for augmenting existing LVLMs in handling visual question answering (VQA) about up-to-date knowledge, dubbed UDKAG. A hierarchical filtering model is trained to effectively and efficiently find the most helpful content from the websites returned by a search engine to prompt LVLMs with up-to-date knowledge. To train the model and evaluate our framework's performance, we propose a pipeline to automatically generate news-related VQA samples to construct a dataset, dubbed UDK-VQA. A multi-model voting mechanism is introduced to label the usefulness of website/content for VQA samples to construct the training set. Experimental results demonstrate the effectiveness of our framework, outperforming GPT-4V by about 25% in accuracy.


title: Subtle Biases Need Subtler Measures: Dual Metrics for Evaluating Representative and Affinity Bias in Large Language Models

abstract: Research on Large Language Models (LLMs) has often neglected subtle biases that, although less apparent, can significantly influence the models' outputs toward particular social narratives. This study addresses two such biases within LLMs: representative bias, which denotes a tendency of LLMs to generate outputs that mirror the experiences of certain identity groups, and affinity bias, reflecting the models' evaluative preferences for specific narratives or viewpoints. We introduce two novel metrics to measure these biases: the Representative Bias Score (RBS) and the Affinity Bias Score (ABS), and present the Creativity-Oriented Generation Suite (CoGS), a collection of open-ended tasks such as short story writing and poetry composition, designed with customized rubrics to detect these subtle biases. Our analysis uncovers marked representative biases in prominent LLMs, with a preference for identities associated with being white, straight, and men. Furthermore, our investigation of affinity bias reveals distinctive evaluative patterns within each model, akin to `bias fingerprints'. This trend is also seen in human evaluators, highlighting a complex interplay between human and machine bias perceptions.


title: Deep Learning Classification of Photoplethysmogram Signal for Hypertension Levels

abstract: Continuous photoplethysmography (PPG)-based blood pressure monitoring is necessary for healthcare and fitness applications. In Artificial Intelligence (AI), signal classification levels with the machine and deep learning arrangements need to be explored further. Techniques based on time-frequency spectra, such as Short-time Fourier Transform (STFT), have been used to address the challenges of motion artifact correction. Therefore, the proposed study works with PPG signals of more than 200 patients (650+ signal samples) with hypertension, using STFT with various Neural Networks (Convolution Neural Network (CNN), Long Short-Term Memory (LSTM), Bidirectional Long Short-Term Memory (Bi-LSTM), followed by machine learning classifiers, such as, Support Vector Machine (SVM) and Random Forest (RF). The classification has been done for two categories: Prehypertension (normal levels) and Hypertension (includes Stage I and Stage II). Various performance metrics have been obtained with two batch sizes of 3 and 16 for the fusion of the neural networks. With precision and specificity of 100% and recall of 82.1%, the LSTM model provides the best results among all combinations of Neural Networks. However, the maximum accuracy of 71.9% is achieved by the LSTM-CNN model. Further stacked Ensemble method has been used to achieve 100% accuracy for Meta-LSTM-RF, Meta- LSTM-CNN-RF and Meta- STFT-CNN-SVM.


title: High fidelity distribution of triggered polarization-entangled telecom photons via a 36km intra-city fiber network

abstract: Fiber-based distribution of triggered, entangled, single-photon pairs is a key requirement for the future development of terrestrial quantum networks. In this context, semiconductor quantum dots (QDs) are promising candidates for deterministic sources of on-demand polarization-entangled photon pairs. So far, the best QD polarization-entangled-pair sources emit in the near-infrared wavelength regime, where the transmission distance in deployed fibers is limited. Here, to be compatible with existing fiber network infrastructures, bi-directional polarization-conserving quantum frequency conversion (QFC) is employed to convert the QD emission from \unit[780]{nm} to telecom wavelengths. We show the preservation of polarization entanglement after QFC (fidelity to Bell state $F_{\phi^+, conv}=0.972\pm0.003$) of the biexciton transition. As a step towards real-world applicability, high entanglement fidelities ($F_{\phi^+, loop}=0.945\pm0.005$) after the propagation of one photon of the entangled pair along a \unit[35.8]{km} field installed standard single mode fiber link are reported. Furthermore, we successfully demonstrate a second polarization-conversing QFC step back to \unit[780]{nm} preserving entanglement ($F_{\phi^+, back}=0.903\pm0.005$). This further prepares the way for interfacing quantum light to various quantum memories.


title: FUSE: Fast Unified Simulation and Estimation for PDEs

abstract: The joint prediction of continuous fields and statistical estimation of the underlying discrete parameters is a common problem for many physical systems, governed by PDEs. Hitherto, it has been separately addressed by employing operator learning surrogates for field prediction while using simulation-based inference (and its variants) for statistical parameter determination. Here, we argue that solving both problems within the same framework can lead to consistent gains in accuracy and robustness. To this end, We propose a novel and flexible formulation of the operator learning problem that allows jointly predicting continuous quantities and inferring distributions of discrete parameters, and thus amortizing the cost of both the inverse and the surrogate models to a joint pre-training step. We present the capabilities of the proposed methodology for predicting continuous and discrete biomarkers in full-body haemodynamics simulations under different levels of missing information. We also consider a test case for atmospheric large-eddy simulation of a two-dimensional dry cold bubble, where we infer both continuous time-series and information about the systems conditions. We present comparisons against different baselines to showcase significantly increased accuracy in both the inverse and the surrogate tasks.


title: HemSeg-200: A Voxel-Annotated Dataset for Intracerebral Hemorrhages Segmentation in Brain CT Scans

abstract: Acute intracerebral hemorrhage is a life-threatening condition that demands immediate medical intervention. Intraparenchymal hemorrhage (IPH) and intraventricular hemorrhage (IVH) are critical subtypes of this condition. Clinically, when such hemorrhages are suspected, immediate CT scanning is essential to assess the extent of the bleeding and to facilitate the formulation of a targeted treatment plan. While current research in deep learning has largely focused on qualitative analyses, such as identifying subtypes of cerebral hemorrhages, there remains a significant gap in quantitative analysis crucial for enhancing clinical treatments. Addressing this gap, our paper introduces a dataset comprising 222 CT annotations, sourced from the RSNA 2019 Brain CT Hemorrhage Challenge and meticulously annotated at the voxel level for precise IPH and IVH segmentation. This dataset was utilized to train and evaluate seven advanced medical image segmentation algorithms, with the goal of refining the accuracy of segmentation for these hemorrhages. Our findings demonstrate that this dataset not only furthers the development of sophisticated segmentation algorithms but also substantially aids scientific research and clinical practice by improving the diagnosis and management of these severe hemorrhages. Our dataset and codes are available at \url{https://github.com/songchangwei/3DCT-SD-IVH-ICH}.


title: Effect of magnetic field configuration on double layer formation and reverse discharge ignition in bipolar HiPIMS

abstract: The reverse discharge (RD) phenomenon in bipolar HiPIMS has been observed when a sufficiently long positive pulse is applied to the magnetron. Due to the magnetic field, electrons accumulated behind the magnetic trap are prevented from reaching the positive target. Consequently, a space charge double layer (DL) is formed between the positive target and the plasma behind the magnetic trap, leading to electron acceleration across the DL and RD ignition. This study reveals the significant impact of the magnetic field configuration on RD ignition. Experiments are performed using a Ti target involving magnetic field variation, wire probe measurements of floating potential, and optical emission spectroscopy imaging. It is found that adjusting the magnetic field to a more balanced configuration leads to earlier RD ignition, while a more unbalanced one delays or even prevents it. Specifically, the time of RD ignition decreases with an increase in the magnetic null point distance from the target. Moreover, the size and shape of optical emission in the RD varies with nearby probe placement, suggesting sensitivity to external electrodes.


title: Beyond the Buzz: Strategic Paths for Enabling Useful NISQ Applications

abstract: There is much debate on whether quantum computing on current NISQ devices, consisting of noisy hundred qubits and requiring a non-negligible usage of classical computing as part of the algorithms, has utility and will ever offer advantages for scientific and industrial applications with respect to traditional computing. In this position paper, we argue that while real-world NISQ quantum applications have yet to surpass their classical counterparts, strategic approaches can be used to facilitate advancements in both industrial and scientific applications. We have identified three key strategies to guide NISQ computing towards practical and useful implementations. Firstly, prioritizing the identification of a "killer app" is a key point. An application demonstrating the distinctive capabilities of NISQ devices can catalyze broader development. We suggest focusing on applications that are inherently quantum, e.g., pointing towards quantum chemistry and material science as promising domains. These fields hold the potential to exhibit benefits, setting benchmarks for other applications to follow. Secondly, integrating AI and deep-learning methods into NISQ computing is a promising approach. Examples such as quantum Physics-Informed Neural Networks and Differentiable Quantum Circuits (DQC) demonstrate the synergy between quantum computing and AI. Lastly, recognizing the interdisciplinary nature of NISQ computing, we advocate for a co-design approach. Achieving synergy between classical and quantum computing necessitates an effort in co-designing quantum applications, algorithms, and programming environments, and the integration of HPC with quantum hardware. The interoperability of these components is crucial for enabling the full potential of NISQ computing.


title: Quantum Mixtures of Ultracold Atomic Gases

abstract: The combination of different kinds of ultracold gases constitutes a novel powerful experimental framework for the investigation of a variety of physical problems. We illustrate the differences among possible quantum mixtures, be they homonuclear spin mixtures or heteronuclear ones, and show how they can be exploited to investigate a plethora of topics from the few-body to the many-body regimes. In particular, we discuss quantum mixtures of ultracold gases under three different perspectives: systems made of a few atoms of different kinds, single impurities immersed in a host quantum gas, and quantum mixtures of two interacting gases. Given the broad spectrum of possible topics and experimental regimes, in this review we restrict the discussion on single harmonic or flat traps, predominantly in a three-dimensional configuration. A selection of results on recent experiments and possible interesting future directions are given.


title: Concept Visualization: Explaining the CLIP Multi-modal Embedding Using WordNet

abstract: Advances in multi-modal embeddings, and in particular CLIP, have recently driven several breakthroughs in Computer Vision (CV). CLIP has shown impressive performance on a variety of tasks, yet, its inherently opaque architecture may hinder the application of models employing CLIP as backbone, especially in fields where trust and model explainability are imperative, such as in the medical domain. Current explanation methodologies for CV models rely on Saliency Maps computed through gradient analysis or input perturbation. However, these Saliency Maps can only be computed to explain classes relevant to the end task, often smaller in scope than the backbone training classes. In the context of models implementing CLIP as their vision backbone, a substantial portion of the information embedded within the learned representations is thus left unexplained. In this work, we propose Concept Visualization (ConVis), a novel saliency methodology that explains the CLIP embedding of an image by exploiting the multi-modal nature of the embeddings. ConVis makes use of lexical information from WordNet to compute task-agnostic Saliency Maps for any concept, not limited to concepts the end model was trained on. We validate our use of WordNet via an out of distribution detection experiment, and test ConVis on an object localization benchmark, showing that Concept Visualizations correctly identify and localize the image's semantic content. Additionally, we perform a user study demonstrating that our methodology can give users insight on the model's functioning.


title: Giant graviton expansions and ETW brane

abstract: We study the giant gravitons in the $AdS_4$ bagpipe geometries involving end-of-the-world (ETW) brane constructed by a single $5$-brane and either two stacks or one stack of D3-branes in Type IIB string theory. From the exact formulae and giant graviton expansions of the half-indices for the half-BPS boundary conditions and interfaces in $\mathcal{N}=4$ super Yang-Mills theory, we obtain the BPS spectra of the fluctuation modes of the $AdS_4$ bagpipe geometries including the ETW brane region.


title: $L^1$-Contraction Property of Entropy Solutions for Scalar Conservation Laws with Minimal Regularity Assumptions on the Flux

abstract: This paper is concerned with entropy solutions of scalar conservation laws of the form $\partial_{t}u+\diver f=0$ in $\mathbb{R}^d\times(0,\infty)$. The flux $f=f(x,u)$ depends explicitly on the spatial variable $x$. Using an extension of Kruzkov's method, we establish the $L^1$-contraction property of entropy solutions under minimal regularity assumptions on the flux.


title: Task-Based Design and Policy Co-Optimization for Tendon-driven Underactuated Kinematic Chains

abstract: Underactuated manipulators reduce the number of bulky motors, thereby enabling compact and mechanically robust designs. However, fewer actuators than joints means that the manipulator can only access a specific manifold within the joint space, which is particular to a given hardware configuration and can be low-dimensional and/or discontinuous. Determining an appropriate set of hardware parameters for this class of mechanisms, therefore, is difficult - even for traditional task-based co-optimization methods. In this paper, our goal is to implement a task-based design and policy co-optimization method for underactuated, tendon-driven manipulators. We first formulate a general model for an underactuated, tendon-driven transmission. We then use this model to co-optimize a three-link, two-actuator kinematic chain using reinforcement learning. We demonstrate that our optimized tendon transmission and control policy can be transferred reliably to physical hardware with real-world reaching experiments.


title: EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Records

abstract: Transformers have significantly advanced the modeling of Electronic Health Records (EHR), yet their deployment in real-world healthcare is limited by several key challenges. Firstly, the quadratic computational cost and insufficient context length of these models pose significant obstacles for hospitals in processing the extensive medical histories typical in EHR data. Additionally, existing models employ separate finetuning for each clinical task, complicating maintenance in healthcare environments. Moreover, these models focus exclusively on either clinical prediction or EHR forecasting, lacking the flexibility to perform well across both. To overcome these limitations, we introduce EHRMamba, a robust foundation model built on the Mamba architecture. EHRMamba can process sequences up to four times longer than previous models due to its linear computational cost. We also introduce a novel approach to Multitask Prompted Finetuning (MTF) for EHR data, which enables EHRMamba to simultaneously learn multiple clinical tasks in a single finetuning phase, significantly enhancing deployment and cross-task generalization. Furthermore, our model leverages the HL7 FHIR data standard to simplify integration into existing hospital systems. Alongside EHRMamba, we open-source Odyssey, a toolkit designed to support the development and deployment of EHR foundation models, with an emphasis on data standardization and interpretability. Our evaluations on the MIMIC-IV dataset demonstrate that EHRMamba advances state-of-the-art performance across 6 major clinical tasks and excels in EHR forecasting, marking a significant leap forward in the field.


title: Tug-of-war games related to oblique derivative boundary value problems with the normalized $p$-Laplacian

abstract: In this paper, we are concerned with game-theoretic interpretations to the following oblique derivative boundary value problem \begin{align*} \left\{ \begin{array}{ll} \Delta_{p}^{N}u=0 & \textrm{in $ \Omega$,}\\ \langle \beta , Du \rangle + \gamma u = \gamma G & \textrm{on $ \partial \Omega$,}\\ \end{array} \right. \end{align*} where $\Delta_{p}^{N}$ is the normalized $p$-Laplacian. This problem can be regarded as a generalized version of the Robin boundary value problem for the Laplace equations. We construct several types of stochastic games associated with this problem by using `shrinking tug-of-war'. For the value functions of such games, we investigate the properties such as existence, uniqueness, regularity and convergence.


title: PrivCirNet: Efficient Private Inference via Block Circulant Transformation

abstract: Homomorphic encryption (HE)-based deep neural network (DNN) inference protects data and model privacy but suffers from significant computation overhead. We observe transforming the DNN weights into circulant matrices converts general matrix-vector multiplications into HE-friendly 1-dimensional convolutions, drastically reducing the HE computation cost. Hence, in this paper, we propose \method, a protocol/network co-optimization framework based on block circulant transformation. At the protocol level, PrivCirNet customizes the HE encoding algorithm that is fully compatible with the block circulant transformation and reduces the computation latency in proportion to the block size. At the network level, we propose a latency-aware formulation to search for the layer-wise block size assignment based on second-order information. PrivCirNet also leverages layer fusion to further reduce the inference cost. We compare PrivCirNet with the state-of-the-art HE-based framework Bolt (IEEE S\&P 2024) and the HE-friendly pruning method SpENCNN (ICML 2023). For ResNet-18 and Vision Transformer (ViT) on Tiny ImageNet, PrivCirNet reduces latency by $5.0\times$ and $1.3\times$ with iso-accuracy over Bolt, respectively, and improves accuracy by $4.1\%$ and $12\%$ over SpENCNN, respectively. For MobileNetV2 on ImageNet, PrivCirNet achieves $1.7\times$ lower latency and $4.2\%$ better accuracy over Bolt and SpENCNN, respectively. Our code and checkpoints are available in the supplementary materials.


title: A general method for the development of constrained codes

abstract: Nowadays there are several classes of constrained codes intended for different applications. The following two large classes can be distinguished. The first class contains codes with local constraints; for example, the source data must be encoded by binary sequences containing no sub-words 00 and 111. The second class contains codes with global constraints; for example, the code-words must be binary sequences of certain even length with half zeros and half ones. It is important to note that often the necessary codes must fulfill some requirements of both classes. In this paper we propose a general polynomial complexity method for constructing codes for both classes, as well as for combinations thereof. The proposed method uses the enumerative Cover's code, but the main difference between known applications of this code is that the known algorithms require the use of combinatorial formulae when applied, whereas the proposed method calculates all parameters on-the-fly using a polynomial complexity algorithm.


title: Charm fragmentation fractions and ${\rm c\overline{c}}$ cross section in p$-$Pb collisions at $\sqrt{s_{\rm NN}}=5.02$ TeV

abstract: The total charm-quark production cross section per unit of rapidity $\mathrm{d}\sigma({\rm c\overline{c}})/\mathrm{d}y$, and the fragmentation fractions of charm quarks to different charm-hadron species $f(\mathrm{c}\rightarrow {\rm h_{c}})$, are measured for the first time in p$-$Pb collisions at $\sqrt{s_\mathrm{NN}} = 5.02$ TeV at midrapidity ($-0.96<y<0.04$ in the centre-of-mass frame) using data collected by ALICE at the CERN LHC. The results are obtained based on all the available measurements of prompt production of ground-state charm-hadron species: $\mathrm{D}^{0}$, $\mathrm{D}^{+}$, $\mathrm{D}_\mathrm{s}^{+}$, and $\mathrm{J/\psi}$ mesons, and $\Lambda_\mathrm{c}^{+}$ and $\Xi_{\rm c}^{0}$ baryons. The resulting cross section is $\mathrm{d}\sigma({\rm c\overline{c}})/\mathrm{d}y =219.6 \pm 6.3\;(\mathrm{stat.}) {\;}_{-11.8}^{+10.5}\;(\mathrm{syst.}) {\;}_{-2.9}^{+7.6}\;(\mathrm{extr.})\pm 5.4\;(\mathrm{BR})\pm 4.6\;(\mathrm{lumi.}) \pm 19.5\;(\text{rapidity shape})+15.0\;(\Omega_{\rm c}^{0})$ mb, which is consistent with a binary scaling of pQCD calculations from pp collisions. The measured fragmentation fractions are compatible with those measured in pp collisions at $\sqrt{s} = 5.02$ and $13$ TeV, showing an increase in the relative production rates of charm baryons with respect to charm mesons in pp and p$-$Pb collisions compared with $\mathrm{e^{+}e^{-}}$ and $\mathrm{e^{-}p}$ collisions. The $p_\mathrm{T}$-integrated nuclear modification factor of charm quarks, $R_\mathrm{pPb}({\rm c\overline{c}})= 0.91 \pm 0.04\;{\rm (stat.)}{}^{+0.08}_{-0.09}\;{\rm (syst.)}{}^{+0.04}_{-0.03}\;{\rm (extr.)}{}\pm 0.03\;{\rm (lumi.)}$, is found to be consistent with unity and with theoretical predictions including nuclear modifications of the parton distribution functions.


title: Multicontinuum Homogenization for Coupled Flow and Transport Equations

abstract: In this paper, we present the derivation of a multicontinuum model for the coupled flow and transport equations by applying multicontinuum homogenization. We perform the multicontinuum expansion for both flow and transport solutions and formulate novel coupled constraint cell problems to capture the multiscale property, where oversampled regions are utilized to avoid boundary effects. Assuming the smoothness of macroscopic variables, we obtain a multicontinuum system composed of macroscopic elliptic equations and convection-diffusion-reaction equations with homogenized effective properties. Finally, we present numerical results for various coefficient fields and boundary conditions to validate our proposed algorithm.


title: AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agents

abstract: Autonomous agents that execute human tasks by controlling computers can enhance human productivity and application accessibility. However, progress in this field will be driven by realistic and reproducible benchmarks. We present AndroidWorld, a fully functional Android environment that provides reward signals for 116 programmatic tasks across 20 real-world Android apps. Unlike existing interactive environments, which provide a static test set, AndroidWorld dynamically constructs tasks that are parameterized and expressed in natural language in unlimited ways, thus enabling testing on a much larger and more realistic suite of tasks. Reward signals are derived from the computer's system state, making them durable across task variations and extensible across different apps. To demonstrate AndroidWorld's benefits and mode of operation, we introduce a new computer control agent, M3A. M3A can complete 30.6% of the AndroidWorld's tasks, leaving ample room for future work. Furthermore, we adapt a popular desktop web agent to work on Android, which we find to be less effective on mobile, suggesting future research is needed to achieve universal, cross-domain agents. Finally, we conduct a robustness analysis by testing M3A against a range of task variations on a representative subset of tasks, demonstrating that variations in task parameters can significantly alter a task's complexity and, consequently, an agent's performance, highlighting the importance of testing agents under diverse conditions. AndroidWorld and the experiments in this paper are available at https://github.com/google-research/android_world.


title: Learning with Fitzpatrick Losses

abstract: Fenchel-Young losses are a family of convex loss functions, encompassing the squared, logistic and sparsemax losses, among others. Each Fenchel-Young loss is implicitly associated with a link function, for mapping model outputs to predictions. For instance, the logistic loss is associated with the soft argmax link function. Can we build new loss functions associated with the same link function as Fenchel-Young losses? In this paper, we introduce Fitzpatrick losses, a new family of convex loss functions based on the Fitzpatrick function. A well-known theoretical tool in maximal monotone operator theory, the Fitzpatrick function naturally leads to a refined Fenchel-Young inequality, making Fitzpatrick losses tighter than Fenchel-Young losses, while maintaining the same link function for prediction. As an example, we introduce the Fitzpatrick logistic loss and the Fitzpatrick sparsemax loss, counterparts of the logistic and the sparsemax losses. This yields two new tighter losses associated with the soft argmax and the sparse argmax, two of the most ubiquitous output layers used in machine learning. We study in details the properties of Fitzpatrick losses and in particular, we show that they can be seen as Fenchel-Young losses using a modified, target-dependent generating function. We demonstrate the effectiveness of Fitzpatrick losses for label proportion estimation.


title: Share-Based Fairness for Arbitrary Entitlements

abstract: We consider the problem of fair allocation of indivisible items to agents that have arbitrary entitlements to the items. Every agent $i$ has a valuation function $v_i$ and an entitlement $b_i$, where entitlements sum up to~1. Which allocation should one choose in situations in which agents fail to agree on one acceptable fairness notion? We study this problem in the case in which each agent focuses on the value she gets, and fairness notions are restricted to be {\em share based}. A {\em share} $s$ is an function that maps every $(v_i,b_i)$ to a value $s(v_i,b_i)$, representing the minimal value $i$ should get, and $s$ is {\em feasible} if it is always possible to give every agent $i$ value of at least $s(v_i,b_i)$. Our main result is that for additive valuations over goods there is an allocation that gives every agent at least half her share value, regardless of which feasible share-based fairness notion the agent wishes to use. Moreover, the ratio of half is best possible. More generally, we provide tight characterizations of what can be achieved, both ex-post (as single allocations) and ex-ante (as expected values of distributions of allocations), both for goods and for chores. We also show that for chores one can achieve the ex-ante and ex-post guarantees simultaneously (a ``best of both world" result), whereas for goods one cannot.


title: Finding bifurcations in mathematical epidemiology via reaction network methods

abstract: Mathematical Epidemiology (ME) shares with Chemical Reaction Network Theory (CRNT) the basic mathematical structure of its dynamical systems. Despite this central similarity, methods from CRNT have been seldom applied to solving problems in ME. We explore here the applicability of CRNT methods to find bifurcations at endemic equilibria of ME models. We adapt three CRNT methods to the features of ME. First, we prove that essentially all ME models admit Hopf bifurcations for certain monotone choices of the interaction functions. Second, we offer a parametrization of equilibria Jacobians of ME systems where few interactions are not in mass action form. Third, for a quite general class of models, we show that periodic oscillations in closed systems imply periodic oscillations when demography is added. Finally, we apply such results to two families of networks: a general SIR model with a nonlinear force of infection and treatment rate and a recent SIRnS model with a gradual increase in infectiousness. We give both necessary conditions and sufficient conditions for the occurrence of bifurcations at endemic equilibria of both families.


title: Representation noising effectively prevents harmful fine-tuning on LLMs

abstract: Releasing open-source large language models (LLMs) presents a dual-use risk since bad actors can easily fine-tune these models for harmful purposes. Even without the open release of weights, weight stealing and fine-tuning APIs make closed models vulnerable to harmful fine-tuning attacks (HFAs). While safety measures like preventing jailbreaks and improving safety guardrails are important, such measures can easily be reversed through fine-tuning. In this work, we propose Representation Noising (RepNoise), a defence mechanism that is effective even when attackers have access to the weights and the defender no longer has any control. RepNoise works by removing information about harmful representations such that it is difficult to recover them during fine-tuning. Importantly, our defence is also able to generalize across different subsets of harm that have not been seen during the defence process. Our method does not degrade the general capability of LLMs and retains the ability to train the model on harmless tasks. We provide empirical evidence that the effectiveness of our defence lies in its "depth": the degree to which information about harmful representations is removed across all layers of the LLM.


title: Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling

abstract: In current deep learning tasks, Adam style optimizers such as Adam, Adagrad, RMSProp, Adafactor, and Lion have been widely used as alternatives to SGD style optimizers. These optimizers typically update model parameters using the sign of gradients, resulting in more stable convergence curves. The learning rate and the batch size are the most critical hyperparameters for optimizers, which require careful tuning to enable effective convergence. Previous research has shown that the optimal learning rate increases linearly or follows similar rules with batch size for SGD style optimizers. However, this conclusion is not applicable to Adam style optimizers. In this paper, we elucidate the connection between optimal learning rates and batch sizes for Adam style optimizers through both theoretical analysis and extensive experiments. First, we raise the scaling law between batch sizes and optimal learning rates in the sign of gradient case, in which we prove that the optimal learning rate first rises and then falls as the batch size increases. Moreover, the peak value of the surge will gradually move toward the larger batch size as training progresses. Second, we conducted experiments on various CV and NLP tasks and verified the correctness of the scaling law.


title: Assessment of the Role and Origin of S* in Orange Carotenoid Protein Photoconversion

abstract: The orange carotenoid protein (OCP) is the water-soluble mediator of non-photochemical quenching in cyanobacteria, a crucial photoprotective mechanism in response to excess illumination. OCP converts from a globular, inactive state (OCPo) to an extended, active conformation (OCPr) under high-light conditions, resulting in a concomitant redshift in the absorption of the bound carotenoid. Here, OCP was trapped in either the active or inactive state by fixing each protein conformation in trehalose-sucrose glass. Glass-encapsulated OCPo did not convert under intense illumination and OCPr did not convert in darkness, allowing the optical properties of each conformation to be determined at room temperature. We measured pump wavelength-dependent transient absorption of OCPo in glass films and found that initial OCP photoproducts are still formed, despite the glass preventing completion of the photocycle. By comparison to the pump wavelength dependence of the OCPo to OCPr photoconversion yield in buffer, we show that the long-lived carotenoid singlet-like feature (S*) is associated with ground-state heterogeneity within OCPo, rather than triggering OCP photoconversion.


title: LDM: Large Tensorial SDF Model for Textured Mesh Generation

abstract: Previous efforts have managed to generate production-ready 3D assets from text or images. However, these methods primarily employ NeRF or 3D Gaussian representations, which are not adept at producing smooth, high-quality geometries required by modern rendering pipelines. In this paper, we propose LDM, a novel feed-forward framework capable of generating high-fidelity, illumination-decoupled textured mesh from a single image or text prompts. We firstly utilize a multi-view diffusion model to generate sparse multi-view inputs from single images or text prompts, and then a transformer-based model is trained to predict a tensorial SDF field from these sparse multi-view image inputs. Finally, we employ a gradient-based mesh optimization layer to refine this model, enabling it to produce an SDF field from which high-quality textured meshes can be extracted. Extensive experiments demonstrate that our method can generate diverse, high-quality 3D mesh assets with corresponding decomposed RGB textures within seconds.


title: Free p-algebras revisited: an algebraic investigation of implication-free intuitionism

abstract: We give a new construction of free distributive p-algebras. Our construction relies on a detailed description of completely meet-irreducible congruences, so it is purely universal algebraic. It yields a normal form theorem for p-algebra terms, simpler proofs of several existing results, as well as a complete characterisation of structurally complete varieties of p-algebras.


title: PoseCrafter: One-Shot Personalized Video Synthesis Following Flexible Pose Control

abstract: In this paper, we introduce PoseCrafter, a one-shot method for personalized video generation following the control of flexible poses. Built upon Stable Diffusion and ControlNet, we carefully design an inference process to produce high-quality videos without the corresponding ground-truth frames. First, we select an appropriate reference frame from the training video and invert it to initialize all latent variables for generation. Then, we insert the corresponding training pose into the target pose sequences to enhance faithfulness through a trained temporal attention module. Furthermore, to alleviate the face and hand degradation resulting from discrepancies between poses of training videos and inference poses, we implement simple latent editing through an affine transformation matrix involving facial and hand landmarks. Extensive experiments on several datasets demonstrate that PoseCrafter achieves superior results to baselines pre-trained on a vast collection of videos under 8 commonly used metrics. Besides, PoseCrafter can follow poses from different individuals or artificial edits and simultaneously retain the human identity in an open-domain training video. Our project page is available at https://ml-gsai.github.io/PoseCrafter-demo/.


title: Anosov vector fields and Fried sections

abstract: The purpose of this paper is to prove that if $Y$ is a compact manifold, if $Z$ is an Anosov vector field on $Y$, and if $F$ is a flat vector bundle, then there is a corresponding canonical nonzero section $\tau_{\nu}\left(i_{Z}\right)$ of the determinant line $\nu=\mathrm{det} H\left(Y,F\right)$. In families, this section is $C^{1}$. When $F$ is flat on the total space of the corresponding fibration, our section is flat with respect to the Gauss-Manin connection on $\nu$.


title: SE3D: A Framework For Saliency Method Evaluation In 3D Imaging

abstract: For more than a decade, deep learning models have been dominating in various 2D imaging tasks. Their application is now extending to 3D imaging, with 3D Convolutional Neural Networks (3D CNNs) being able to process LIDAR, MRI, and CT scans, with significant implications for fields such as autonomous driving and medical imaging. In these critical settings, explaining the model's decisions is fundamental. Despite recent advances in Explainable Artificial Intelligence, however, little effort has been devoted to explaining 3D CNNs, and many works explain these models via inadequate extensions of 2D saliency methods. One fundamental limitation to the development of 3D saliency methods is the lack of a benchmark to quantitatively assess them on 3D data. To address this issue, we propose SE3D: a framework for Saliency method Evaluation in 3D imaging. We propose modifications to ShapeNet, ScanNet, and BraTS datasets, and evaluation metrics to assess saliency methods for 3D CNNs. We evaluate both state-of-the-art saliency methods designed for 3D data and extensions of popular 2D saliency methods to 3D. Our experiments show that 3D saliency methods do not provide explanations of sufficient quality, and that there is margin for future improvements and safer applications of 3D CNNs in critical fields.


title: Testing the CKM unitarity at high energy via the $W^+W^-$ production at the LHC and future colliders

abstract: We propose a novel test to assess the unitarity of the Cabibbo-Kobayashi-Maskawa matrix, $V_{\scriptscriptstyle{\rm CKM}}$, at present and future collider experiments. Our strategy makes use of the $W^+W^-$ production cross section to directly probe the $V_{\scriptscriptstyle{\rm CKM}}^{\dagger} V_{\scriptscriptstyle{\rm CKM}}$ product, which regulates the high-energy behavior of the observable. The violation of unitarity is signalled by an anomalous behavior of the cross section that grows quadratically with the $W^+W^-$ invariant mass with respect to the Standard Model prediction. By using the recent ATLAS measurements of the $W^+W^-$ cross section we are able to constrain the maximal unitarity violation allowed by current data, producing a bound complementary to the results of flavor physics experiments. Forecasts for the high luminosity phase of the LHC and for the future 100 TeV hadron collider are also discussed.


title: Low-frequency signature of magnetization nutation in nanomagnets

abstract: In this work, we show that surface anisotropy in nanomagnets induces a nutational motion of their magnetization at various frequencies, the lowest of which can be described by the macrospin model whose dynamics is governed by an effective energy potential. We derive analytical expressions for the precession and nutation frequencies and amplitudes as functions of the size of the nanomagnet and its atomistic parameters, such as the exchange coupling and the onsite anisotropy. Our analytical model predicts a reduction of the precession frequency with increased surface anisotropy. We also simulate the dynamics of the corresponding atomistic many-spin system and compare the results with the effective model. We thereby show that the first nutation mode induced by the finite size and surface anisotropy occurs at a frequency that is four times larger than the precession frequency, thus lending itself to a relatively easy detection by standard experiments of magnetic resonance.


title: Effects of Topological Boundary Conditions on Bell Nonlocality

abstract: Bell nonlocality is the resource that enables device-independent quantum information processing tasks. It is revealed through the violation of so-called Bell inequalities, indicating that the observed correlations cannot be reproduced by any local hidden variable model. While well explored in few-body settings, the question of which Bell inequalities are best suited for a given task remains quite open in the many-body scenario. One natural approach is to assign Bell inequalities to physical Hamiltonians, mapping their interaction graph to two-body, nearest-neighbor terms. Here, we investigate the effect of boundary conditions in a two-dimensional square lattice, which can induce different topologies in lattice systems. We find a relation between the induced topology and the Bell inequality's effectiveness in revealing nonlocal correlations. By using a combination of tropical algebra and tensor networks, we quantify their detection capacity for nonlocality. Our work can act as a guide to certify Bell nonlocality in many-qubit devices by choosing a suitable Hamiltonian and measuring its ground state energy; a task that many quantum experiments are purposely built for.


title: A Study of the Spectral properties of Gamma-Ray Bursts with the Precursors and Main bursts

abstract: There is no consensus yet on whether the precursor and the main burst of gamma-ray bursts (GRBs) have the same origin, and their jet composition is still unclear. In order to further investigate this issue, we systematically search 21 Fermi GRBs with both precursor and main burst for spectral analysis. We first perform Bayesian time-resolved spectral analysis and find that almost all the precursors and the main bursts (94.4$\%$) exhibit thermal components, and the vast majority of them have low-energy spectral index ($\alpha$) (72.2$\%$) that exceed the limit of synchrotron radiation. We then analyse the evolution and correlation of the spectral parameters and find that approximately half of the $\alpha$ (50$\%$) of the precursors and the main bursts evolve in a similar pattern, while peak energy ($E_{p}$) (55.6$\%$) behave similarly, and their evolution is mainly characterized by flux tracking; for the $\alpha-F$ (the flux) relation, more than half of the precursors and the main bursts (61.1$\%$) exhibit roughly similar patterns; the $E_{p}-F$ relation in both the precursor and main burst (100$\%$) exhibits a positive correlation of at least moderate strength. Next, we constrain the outflow properties of the precursors and the main bursts and find that most of them exhibit typical properties of photosphere radiation. Finally, we compare the time-integrated spectra of the precursors and the main bursts and find that nearly all of them are located in similar regions of the Amati relation and follow the Yonetoku relation. Therefore, we conclude that main bursts are continuations of precursors and they may share a common physical origin.


title: Top-Down Partitioning for Efficient List-Wise Ranking

abstract: Large Language Models (LLMs) have significantly impacted many facets of natural language processing and information retrieval. Unlike previous encoder-based approaches, the enlarged context window of these generative models allows for ranking multiple documents at once, commonly called list-wise ranking. However, there are still limits to the number of documents that can be ranked in a single inference of the model, leading to the broad adoption of a sliding window approach to identify the k most relevant items in a ranked list. We argue that the sliding window approach is not well-suited for list-wise re-ranking because it (1) cannot be parallelized in its current form, (2) leads to redundant computational steps repeatedly re-scoring the best set of documents as it works its way up the initial ranking, and (3) prioritizes the lowest-ranked documents for scoring rather than the highest-ranked documents by taking a bottom-up approach. Motivated by these shortcomings and an initial study that shows list-wise rankers are biased towards relevant documents at the start of their context window, we propose a novel algorithm that partitions a ranking to depth k and processes documents top-down. Unlike sliding window approaches, our algorithm is inherently parallelizable due to the use of a pivot element, which can be compared to documents down to an arbitrary depth concurrently. In doing so, we reduce the number of expected inference calls by around 33% when ranking at depth 100 while matching the performance of prior approaches across multiple strong re-rankers.


title: MAMOC: MRI Motion Correction via Masked Autoencoding

abstract: The presence of motion artifacts in magnetic resonance imaging (MRI) scans poses a significant challenge, where even minor patient movements can lead to artifacts that may compromise the scan's utility. This paper introduces Masked Motion Correction (MAMOC), a novel method designed to address the issue of Retrospective Artifact Correction (RAC) in motion-affected MRI brain scans. MAMOC uses masked autoencoding self-supervision and test-time prediction to efficiently remove motion artifacts, producing state-of-the-art, native resolution scans. Until recently, realistic data to evaluate retrospective motion correction methods did not exist, motion artifacts had to be simulated. Leveraging the MR-ART dataset, this work is the first to evaluate motion correction in MRI scans using real motion data, showing the superiority of MAMOC to existing motion correction (MC) methods.


title: Base of RoPE Bounds Context Length

abstract: Position embedding is a core component of current Large Language Models (LLMs). Rotary position embedding (RoPE), a technique that encodes the position information with a rotation matrix, has been the de facto choice for position embedding in many LLMs, such as the Llama series. RoPE has been further utilized to extend long context capability, which is roughly based on adjusting the \textit{base} parameter of RoPE to mitigate out-of-distribution (OOD) problems in position embedding. However, in this paper, we find that LLMs may obtain a superficial long-context ability based on the OOD theory. We revisit the role of RoPE in LLMs and propose a novel property of long-term decay, we derive that the \textit{base of RoPE bounds context length}: there is an absolute lower bound for the base value to obtain certain context length capability. Our work reveals the relationship between context length and RoPE base both theoretically and empirically, which may shed light on future long context training.


title: Increasingly Many Bounded Eigenvalues of the Graph of Whitehead Moves

abstract: In this paper, we investigate the eigenvalues of the Laplacian matrix of the "graph of graphs", in which cubic graphs of order n are joined together using Whitehead moves. Our work follows recent results from arXiv:2303.13923 , which discovered a significant "bottleneck" in the graph of graphs. We found that their bottleneck implies an eigenvalue of order at most O(1). In fact, our main contribution is to expand upon this result by showing that the graph of graphs has increasingly many bounded eigenvalues as n increases to infinity. We also show that these eigenvalues are unusually small, in the sense that they are much smaller than the eigenvalues of a random regular graph with an equal number of vertices and a similar degree.


title: On the role of the fast oscillations in the secular dynamics of the lunar coplanar perturbation on Galileo satellites

abstract: Motivated by the practical interest in the third-body perturbation as a natural cleaning mechanism for high-altitude Earth orbits, we investigate the dynamics stemming from the secular Hamiltonian associated with the lunar perturbation, assuming that the Moon lies on the ecliptic plane. The secular Hamiltonian defined in that way is characterized by two timescales. We compare the location and stability of the fixed points associated with the secular Hamiltonian averaged with respect to the fast variable with the corresponding periodic orbits of the full system. Focusing on the orbit of the Galileo satellites, it turns out that the two dynamics cannot be confused, as the relative difference depends on the ratio between the semi-major axis of Galileo and the one of the Moon, that is not negligible. The result is relevant to construct rigorously the Arnold diffusion mechanism that can drive a natural growth in eccentricity that allows a satellite initially on a circular orbit in Medium Earth Orbit to reenter into the Earth's atmosphere.


title: Data Augmentation Techniques for Process Extraction from Scientific Publications

abstract: We present data augmentation techniques for process extraction tasks in scientific publications. We cast the process extraction task as a sequence labeling task where we identify all the entities in a sentence and label them according to their process-specific roles. The proposed method attempts to create meaningful augmented sentences by utilizing (1) process-specific information from the original sentence, (2) role label similarity, and (3) sentence similarity. We demonstrate that the proposed methods substantially improve the performance of the process extraction model trained on chemistry domain datasets, up to 12.3 points improvement in performance accuracy (F-score). The proposed methods could potentially reduce overfitting as well, especially when training on small datasets or in a low-resource setting such as in chemistry and other scientific domains.


title: Elastic Locomotion with Mixed Second-order Differentiation

abstract: We present a framework of elastic locomotion, which allows users to enliven an elastic body to produce interesting locomotion by prescribing its high-level kinematics. We formulate this problem as an inverse simulation problem and seek the optimal muscle activations to drive the body to complete the desired actions. We employ the interior-point method to model wide-area contacts between the body and the environment with logarithmic barrier penalties. The core of our framework is a mixed second-order differentiation algorithm. By combining both analytic differentiation and numerical differentiation modalities, a general-purpose second-order differentiation scheme is made possible. Specifically, we augment complex-step finite difference (CSFD) with reverse automatic differentiation (AD). We treat AD as a generic function, mapping a computing procedure to its derivative w.r.t. output loss, and promote CSFD along the AD computation. To this end, we carefully implement all the arithmetics used in elastic locomotion, from elementary functions to linear algebra and matrix operation for CSFD promotion. With this novel differentiation tool, elastic locomotion can directly exploit Newton's method and use its strong second-order convergence to find the needed activations at muscle fibers. This is not possible with existing first-order inverse or differentiable simulation techniques. We showcase a wide range of interesting locomotions of soft bodies and creatures to validate our method.


title: Linear Mode Connectivity in Differentiable Tree Ensembles

abstract: Linear Mode Connectivity (LMC) refers to the phenomenon that performance remains consistent for linearly interpolated models in the parameter space. For independently optimized model pairs from different random initializations, achieving LMC is considered crucial for validating the stable success of the non-convex optimization in modern machine learning models and for facilitating practical parameter-based operations such as model merging. While LMC has been achieved for neural networks by considering the permutation invariance of neurons in each hidden layer, its attainment for other models remains an open question. In this paper, we first achieve LMC for soft tree ensembles, which are tree-based differentiable models extensively used in practice. We show the necessity of incorporating two invariances: subtree flip invariance and splitting order invariance, which do not exist in neural networks but are inherent to tree architectures, in addition to permutation invariance of trees. Moreover, we demonstrate that it is even possible to exclude such additional invariances while keeping LMC by designing decision list-based tree architectures, where such invariances do not exist by definition. Our findings indicate the significance of accounting for architecture-specific invariances in achieving LMC.


title: Integer Scale: A Free Lunch for Faster Fine-grained Quantization of LLMs

abstract: We introduce Integer Scale, a novel post-training quantization scheme for large language models that effectively resolves the inference bottleneck in current fine-grained quantization approaches while maintaining similar accuracies. Integer Scale is a free lunch as it requires no extra calibration or fine-tuning which will otherwise incur additional costs. It can be used plug-and-play for most fine-grained quantization methods. Its integration results in at most 1.85x end-to-end speed boost over the original counterpart with comparable accuracy. Additionally, due to the orchestration of the proposed Integer Scale and fine-grained quantization, we resolved the quantization difficulty for Mixtral-8x7B and LLaMA-3 models with negligible performance degradation, and it comes with an end-to-end speed boost of 2.13x, and 2.31x compared with their FP16 versions respectively.


title: Visual Echoes: A Simple Unified Transformer for Audio-Visual Generation

abstract: In recent years, with the realistic generation results and a wide range of personalized applications, diffusion-based generative models gain huge attention in both visual and audio generation areas. Compared to the considerable advancements of text2image or text2audio generation, research in audio2visual or visual2audio generation has been relatively slow. The recent audio-visual generation methods usually resort to huge large language model or composable diffusion models. Instead of designing another giant model for audio-visual generation, in this paper we take a step back showing a simple and lightweight generative transformer, which is not fully investigated in multi-modal generation, can achieve excellent results on image2audio generation. The transformer operates in the discrete audio and visual Vector-Quantized GAN space, and is trained in the mask denoising manner. After training, the classifier-free guidance could be deployed off-the-shelf achieving better performance, without any extra training or modification. Since the transformer model is modality symmetrical, it could also be directly deployed for audio2image generation and co-generation. In the experiments, we show that our simple method surpasses recent image2audio generation methods. Generated audio samples can be found at https://docs.google.com/presentation/d/1ZtC0SeblKkut4XJcRaDsSTuCRIXB3ypxmSi7HTY3IyQ/


title: Neuroexplicit Diffusion Models for Inpainting of Optical Flow Fields

abstract: Deep learning has revolutionized the field of computer vision by introducing large scale neural networks with millions of parameters. Training these networks requires massive datasets and leads to intransparent models that can fail to generalize. At the other extreme, models designed from partial differential equations (PDEs) embed specialized domain knowledge into mathematical equations and usually rely on few manually chosen hyperparameters. This makes them transparent by construction and if designed and calibrated carefully, they can generalize well to unseen scenarios. In this paper, we show how to bring model- and data-driven approaches together by combining the explicit PDE-based approaches with convolutional neural networks to obtain the best of both worlds. We illustrate a joint architecture for the task of inpainting optical flow fields and show that the combination of model- and data-driven modeling leads to an effective architecture. Our model outperforms both fully explicit and fully data-driven baselines in terms of reconstruction quality, robustness and amount of required training data. Averaging the endpoint error across different mask densities, our method outperforms the explicit baselines by 11-27%, the GAN baseline by 47% and the Probabilisitic Diffusion baseline by 42%. With that, our method sets a new state of the art for inpainting of optical flow fields from random masks.


title: Discretization of continuous input spaces in the hippocampal autoencoder

abstract: The hippocampus has been associated with both spatial cognition and episodic memory formation, but integrating these functions into a unified framework remains challenging. Here, we demonstrate that forming discrete memories of visual events in sparse autoencoder neurons can produce spatial tuning similar to hippocampal place cells. We then show that the resulting very high-dimensional code enables neurons to discretize and tile the underlying image space with minimal overlap. Additionally, we extend our results to the auditory domain, showing that neurons similarly tile the frequency space in an experience-dependent manner. Lastly, we show that reinforcement learning agents can effectively perform various visuo-spatial cognitive tasks using these sparse, very high-dimensional representations.


title: A FAIR and Free Prompt-based Research Assistant

abstract: This demo will present the Research Assistant (RA) tool developed to assist with six main types of research tasks defined as standardized instruction templates, instantiated with user input, applied finally as prompts to well-known--for their sophisticated natural language processing abilities--AI tools, such as ChatGPT (https://chat.openai.com/) and Gemini (https://gemini.google.com/app). The six research tasks addressed by RA are: creating FAIR research comparisons, ideating research topics, drafting grant applications, writing scientific blogs, aiding preliminary peer reviews, and formulating enhanced literature search queries. RA's reliance on generative AI tools like ChatGPT or Gemini means the same research task assistance can be offered in any scientific discipline. We demonstrate its versatility by sharing RA outputs in Computer Science, Virology, and Climate Science, where the output with the RA tool assistance mirrored that from a domain expert who performed the same research task.


title: Controllable Continual Test-Time Adaptation

abstract: Continual Test-Time Adaptation (CTTA) is an emerging and challenging task where a model trained in a source domain must adapt to continuously changing conditions during testing, without access to the original source data. CTTA is prone to error accumulation due to uncontrollable domain shifts, leading to blurred decision boundaries between categories. Existing CTTA methods primarily focus on suppressing domain shifts, which proves inadequate during the unsupervised test phase. In contrast, we introduce a novel approach that guides rather than suppresses these shifts. Specifically, we propose $\textbf{C}$ontrollable $\textbf{Co}$ntinual $\textbf{T}$est-$\textbf{T}$ime $\textbf{A}$daptation (C-CoTTA), which explicitly prevents any single category from encroaching on others, thereby mitigating the mutual influence between categories caused by uncontrollable shifts. Moreover, our method reduces the sensitivity of model to domain transformations, thereby minimizing the magnitude of category shifts. Extensive quantitative experiments demonstrate the effectiveness of our method, while qualitative analyses, such as t-SNE plots, confirm the theoretical validity of our approach.


title: The role of excitation vector fields and all-polarisation state control of cavity magnonics

abstract: Recently the field of cavity magnonics, a field focused on controlling the interaction between magnons and confined microwave photons within microwave resonators, has drawn significant attention as it offers a platform for enabling advancements in quantum- and spin-based technologies. Here, we introduce excitation vector fields, whose polarisation and profile can be easily tuned in a two-port cavity setup, thus acting as an effective experimental knob to explore the coupled dynamics of cavity magnon-polaritons. Moreover, we develop theoretical models that accurately predict and reproduce the experimental results for any polarisation state and field profile within the cavity resonator. This versatile experimental platform offers a new avenue for controlling spin-photon interactions and as such also delivering a mechanism to readily control the exchange of information between hybrid systems.


title: A Watermark for Low-entropy and Unbiased Generation in Large Language Models

abstract: Recent advancements in large language models (LLMs) have highlighted the risk of misuse, raising concerns about accurately detecting LLM-generated content. A viable solution for the detection problem is to inject imperceptible identifiers into LLMs, known as watermarks. Previous work demonstrates that unbiased watermarks ensure unforgeability and preserve text quality by maintaining the expectation of the LLM output probability distribution. However, previous unbiased watermarking methods are impractical for local deployment because they rely on accesses to white-box LLMs and input prompts during detection. Moreover, these methods fail to provide statistical guarantees for the type II error of watermark detection. This study proposes the Sampling One Then Accepting (STA-1) method, an unbiased watermark that does not require access to LLMs nor prompts during detection and has statistical guarantees for the type II error. Moreover, we propose a novel tradeoff between watermark strength and text quality in unbiased watermarks. We show that in low-entropy scenarios, unbiased watermarks face a tradeoff between watermark strength and the risk of unsatisfactory outputs. Experimental results on low-entropy and high-entropy datasets demonstrate that STA-1 achieves text quality and watermark strength comparable to existing unbiased watermarks, with a low risk of unsatisfactory outputs. Implementation codes for this study are available online.


title: Spectral analysis of block preconditioners for double saddle-point linear systems with application to PDE-constrained optimization

abstract: In this paper, we describe and analyze the spectral properties of a symmetric positive definite inexact block preconditioner for a class of symmetric, double saddle-point linear systems. We develop a spectral analysis of the preconditioned matrix, showing that its eigenvalues can be described in terms of the roots of a cubic polynomial with real coefficients. We illustrate the efficiency of the proposed preconditioners, and verify the theoretical bounds, in solving large-scale PDE-constrained optimization problems.


title: Logical Characterizations of Recurrent Graph Neural Networks with Reals and Floats

abstract: In pioneering work from 2019, Barcel\'o and coauthors identified logics that precisely match the expressive power of constant iteration-depth graph neural networks (GNNs) relative to properties definable in first-order logic. In this article, we give exact logical characterizations of recurrent GNNs in two scenarios: (1) in the setting with floating-point numbers and (2) with reals. For floats, the formalism matching recurrent GNNs is a rule-based modal logic with counting, while for reals we use a suitable infinitary modal logic, also with counting. These results give exact matches between logics and GNNs in the recurrent setting without relativising to a background logic in either case, but using some natural assumptions about floating-point arithmetic. Applying our characterizations, we also prove that, relative to graph properties definable in monadic second-order logic (MSO), our infinitary and rule-based logics are equally expressive. This implies that recurrent GNNs with reals and floats have the same expressive power over MSO-definable properties and shows that, for such properties, also recurrent GNNs with reals are characterized by a (finitary!) rule-based modal logic. In the general case, in contrast, the expressive power with floats is weaker than with reals. In addition to logic-oriented results, we also characterize recurrent GNNs, with both reals and floats, via distributed automata, drawing links to distributed computing models.


title: Discontinuous transition to chaos in a canonical random neural network

abstract: We study a paradigmatic random recurrent neural network introduced by Sompolinsky, Crisanti, and Sommers (SCS). In the infinite size limit, this system exhibits a direct transition from a homogeneous rest state to chaotic behavior, with the Lyapunov exponent gradually increasing from zero. We generalize the SCS model considering odd saturating nonlinear transfer functions, beyond the usual choice $\phi(x)=\tanh x$. A discontinuous transition to chaos occurs whenever the slope of $\phi$ at 0 is a local minimum (i.e.,~for $\phi'''(0)>0$). Chaos appears out of the blue, by an attractor-repeller fold. Accordingly, the Lyapunov exponent stays away from zero at the birth of chaos.


title: ShapeFormer: Shapelet Transformer for Multivariate Time Series Classification

abstract: Multivariate time series classification (MTSC) has attracted significant research attention due to its diverse real-world applications. Recently, exploiting transformers for MTSC has achieved state-of-the-art performance. However, existing methods focus on generic features, providing a comprehensive understanding of data, but they ignore class-specific features crucial for learning the representative characteristics of each class. This leads to poor performance in the case of imbalanced datasets or datasets with similar overall patterns but differing in minor class-specific details. In this paper, we propose a novel Shapelet Transformer (ShapeFormer), which comprises class-specific and generic transformer modules to capture both of these features. In the class-specific module, we introduce the discovery method to extract the discriminative subsequences of each class (i.e. shapelets) from the training set. We then propose a Shapelet Filter to learn the difference features between these shapelets and the input time series. We found that the difference feature for each shapelet contains important class-specific features, as it shows a significant distinction between its class and others. In the generic module, convolution filters are used to extract generic features that contain information to distinguish among all classes. For each module, we employ the transformer encoder to capture the correlation between their features. As a result, the combination of two transformer modules allows our model to exploit the power of both types of features, thereby enhancing the classification performance. Our experiments on 30 UEA MTSC datasets demonstrate that ShapeFormer has achieved the highest accuracy ranking compared to state-of-the-art methods. The code is available at https://github.com/xuanmay2701/shapeformer.


title: Dimensions of Riesz products and pluriharmonic measures

abstract: We estimate the energy and Hausdorff dimensions of the Riesz products on the unit sphere of $\mathbb{C}^n$, $n\ge 2$. Also, we obtain similar results for the pluriharmonic measures on the torus.


title: Flavored Dark Matter: Freeze-out Scenarios and LHC Signatures

abstract: We present the phenomenology of a simplified dark matter model within the dark minimal flavor violation framework, extending the standard model with a Majorana fermion flavor triplet and colored scalar mediator. We explore the allowed parameter space considering constraints from flavor observables, direct and indirect dark matter detection, and the relic density measurement. Our analysis reveals previously unexplored scenarios such as conversion-driven freeze-out within the model. We study limits from the LHC and discuss new signatures of the model, highlighting its richer phenomenology compared to single flavor dark matter.


title: Is the EJRA proportionate and therefore justified? A critical review of the EJRA policy at Cambridge

abstract: This paper critically evaluates the HESA (Higher Education Statistics Agency) Data Report for the Employer Justified Retirement Age (EJRA) Review Group at the University of Cambridge (\cite{CambridgeHESA2024}), identifying significant methodological flaws and misinterpretations. Our analysis reveals issues such as unclear application of data filters, inconsistent variable treatment, and erroneous statistical conclusions. The Report suggests that the EJRA increased job creation rates at Cambridge, but we show Cambridge consistently had lower job creation rates for Established Academic Careers compared to other Russell Group universities, both before and after EJRA implementation in 2011, with no evidence for a significant change in this deficit post implementation. This suggests that EJRA is not a significant factor driving job creation rates. Since other universities without an EJRA exhibit higher job creation rates, this suggests job creation can be sustained without such a policy. We conclude that the EJRA did not achieve its intended goal of increasing opportunities for young academics and may have exacerbated existing disparities compared to other leading universities. We recommend EJRA be abolished at Cambridge since it does not meet its aims and could be viewed as unlawful age discrimination.\newline \it{This version is a revision reflecting some of the comments made by members of the university EJRA review group in public discussion, see \cite{Holmes24}.}


title: Explaining Multi-modal Large Language Models by Analyzing their Vision Perception

abstract: Multi-modal Large Language Models (MLLMs) have demonstrated remarkable capabilities in understanding and generating content across various modalities, such as images and text. However, their interpretability remains a challenge, hindering their adoption in critical applications. This research proposes a novel approach to enhance the interpretability of MLLMs by focusing on the image embedding component. We combine an open-world localization model with a MLLM, thus creating a new architecture able to simultaneously produce text and object localization outputs from the same vision embedding. The proposed architecture greatly promotes interpretability, enabling us to design a novel saliency map to explain any output token, to identify model hallucinations, and to assess model biases through semantic adversarial perturbations.


title: Last-iterate convergence of modified predictive method via high-resolution differential equation on bilinear game

abstract: This paper discusses the convergence of the modified predictive method (MPM) proposed by Liang and stokes corresponding to high-resolution differential equations (HRDE) in bilinear games. First, we present the high-resolution differential equations (MPM-HRDE) corresponding to the MPM. Then, we discuss the uniqueness of the solution for MPM-HRDE in bilinear games. Finally, we provide the convergence results of MPM-HRDE in bilinear games. The results obtained in this paper address the gap in the existing literature and extend the conclusions of related works.


title: Push and Pull: A Framework for Measuring Attentional Agency

abstract: We propose a framework for measuring attentional agency - the ability to allocate one's attention according to personal desires, goals, and intentions - on digital platforms. Platforms extend people's limited powers of attention by extrapolating their preferences to large collections of previously unconsidered informational objects. However, platforms typically also allow people to influence one another's attention. We introduce a formal framework for measuring how much a given platform empowers people to both pull information into their own attentional field and push information into the attentional fields of others. We also use these definitions to shed light on the implications of generative foundation models, which enable users to bypass the implicit "attentional bargain" that underlies embedded advertising and other methods for capturing economic value from informational goods. We conclude with a set of policy strategies that can be used to understand and reshape the distribution of attentional agency online.