title: Prototype-based Interpretable Breast Cancer Prediction Models: Analysis and Challenges

abstract: Deep learning models have achieved high performance in medical applications, however, their adoption in clinical practice is hindered due to their black-box nature. Self-explainable models, like prototype-based models, can be especially beneficial as they are interpretable by design. However, if the learnt prototypes are of low quality then the prototype-based models are as good as black-box. Having high quality prototypes is a pre-requisite for a truly interpretable model. In this work, we propose a prototype evaluation framework for coherence (PEF-C) for quantitatively evaluating the quality of the prototypes based on domain knowledge. We show the use of PEF-C in the context of breast cancer prediction using mammography. Existing works on prototype-based models on breast cancer prediction using mammography have focused on improving the classification performance of prototype-based models compared to black-box models and have evaluated prototype quality through anecdotal evidence. We are the first to go beyond anecdotal evidence and evaluate the quality of the mammography prototypes systematically using our PEF-C. Specifically, we apply three state-of-the-art prototype-based models, ProtoPNet, BRAIxProtoPNet++ and PIP-Net on mammography images for breast cancer prediction and evaluate these models w.r.t. i) classification performance, and ii) quality of the prototypes, on three public datasets. Our results show that prototype-based models are competitive with black-box models in terms of classification performance, and achieve a higher score in detecting ROIs. However, the quality of the prototypes are not yet sufficient and can be improved in aspects of relevance, purity and learning a variety of prototypes. We call the XAI community to systematically evaluate the quality of the prototypes to check their true usability in high stake decisions and improve such models further.


title: FABind+: Enhancing Molecular Docking through Improved Pocket Prediction and Pose Generation

abstract: Molecular docking is a pivotal process in drug discovery. While traditional techniques rely on extensive sampling and simulation governed by physical principles, these methods are often slow and costly. The advent of deep learning-based approaches has shown significant promise, offering increases in both accuracy and efficiency. Building upon the foundational work of FABind, a model designed with a focus on speed and accuracy, we present FABind+, an enhanced iteration that largely boosts the performance of its predecessor. We identify pocket prediction as a critical bottleneck in molecular docking and propose a novel methodology that significantly refines pocket prediction, thereby streamlining the docking process. Furthermore, we introduce modifications to the docking module to enhance its pose generation capabilities. In an effort to bridge the gap with conventional sampling/generative methods, we incorporate a simple yet effective sampling technique coupled with a confidence model, requiring only minor adjustments to the regression framework of FABind. Experimental results and analysis reveal that FABind+ remarkably outperforms the original FABind, achieves competitive state-of-the-art performance, and delivers insightful modeling strategies. This demonstrates FABind+ represents a substantial step forward in molecular docking and drug discovery. Our code is in https://github.com/QizhiPei/FABind.


title: ELITR-Bench: A Meeting Assistant Benchmark for Long-Context Language Models

abstract: Research on Large Language Models (LLMs) has recently witnessed an increasing interest in extending models' context size to better capture dependencies within long documents. While benchmarks have been proposed to assess long-range abilities, existing efforts primarily considered generic tasks that are not necessarily aligned with real-world applications. In contrast, our work proposes a new benchmark for long-context LLMs focused on a practical meeting assistant scenario. In this scenario, the long contexts consist of transcripts obtained by automatic speech recognition, presenting unique challenges for LLMs due to the inherent noisiness and oral nature of such data. Our benchmark, named ELITR-Bench, augments the existing ELITR corpus' transcripts with 271 manually crafted questions and their ground-truth answers. Our experiments with recent long-context LLMs on ELITR-Bench highlight a gap between open-source and proprietary models, especially when questions are asked sequentially within a conversation. We also provide a thorough analysis of our GPT-4-based evaluation method, encompassing insights from a crowdsourcing study. Our findings suggest that while GPT-4's evaluation scores are correlated with human judges', its ability to differentiate among more than three score levels may be limited.


title: Probing Dark Matter Particles from Evaporating Primordial Black Holes via Electron Scattering in the CDEX-10 Experiment

abstract: Dark matter (DM) is a major constituent of the Universe. However, no definite evidence of DM particles (denoted as ``$\chi$") has been found in DM direct detection (DD) experiments to date. There is a novel concept that detecting $\chi$ from evaporating primordial black holes (PBHs). We search for $\chi$ emitted from PBHs by investigating their interaction with target electrons. The examined PBH masses range from 1$\times$10$^{15}$ to 7$\times$10$^{16}$ g under the current limits of PBH abundance $f_{PBH}$. Using 205.4 kg$\cdot$day data obtained from the CDEX-10 experiment conducted in the China Jinping Underground Laboratory, we exclude the $\chi$--electron ($\chi$--$e$) elastic-scattering cross section $\sigma_{\chi e} \sim 5\times10^{-29}$ cm$^2$ for $\chi$ with a mass $m_{\chi}\lesssim$ 0.1 keV from our results. If ($m_{\chi}$, $\sigma_{\chi e}$) can be determined in the future, DD experiments are expected to impose strong constraints on $f_{PBH}$ for large $M_{PBH}$s.


title: Infinitesimal calculations in fundamental groups

abstract: We show that Hopf invariants, defined by evaluation in Harrison cohomology of the commutative cochains of a space, calculate the logarithm map from a fundamental group to its Malcev Lie algebra. They thus present the zeroth Harrison cohomology as a universal dual object to the Malcev Lie algebra. This structural theorem supports explicit calculations in algebraic topology, geometric topology and combinatorial group theory. In particular, we give the first algorithm to determine whether a word raised to some power is a k-fold nested product of commutators, in any group presented by generators and relations.


title: Rigidity of Euclidean product structure: breakdown for low Sobolev exponents

abstract: We develop a general toolbox to study $W^{1,p}$ solutions of differential inclusions $\nabla u \in K$ for unbounded sets $K$. A key notion is the concept that a subset $K$ of the space $\mathbb{R}^{d \times m}$ of $d \times m$ matrices can be reduced to another set $K'$. We then use this framework to show that the product rigidity for Sobolev maps fails for $p<2$, and also apply our toolbox to simplify several examples from the literature.


title: Latxa: An Open Language Model and Evaluation Suite for Basque

abstract: We introduce Latxa, a family of large language models for Basque ranging from 7 to 70 billion parameters. Latxa is based on Llama 2, which we continue pretraining on a new Basque corpus comprising 4.3M documents and 4.2B tokens. Addressing the scarcity of high-quality benchmarks for Basque, we further introduce 4 multiple choice evaluation datasets: EusProficiency, comprising 5,169 questions from official language proficiency exams; EusReading, comprising 352 reading comprehension questions; EusTrivia, comprising 1,715 trivia questions from 5 knowledge areas; and EusExams, comprising 16,774 questions from public examinations. In our extensive evaluation, Latxa outperforms all previous open models we compare to by a large margin. In addition, it is competitive with GPT-4 Turbo in language proficiency and understanding, despite lagging behind in reading comprehension and knowledge-intensive tasks. Both the Latxa family of models, as well as our new pretraining corpora and evaluation datasets, are publicly available under open licenses at https://github.com/hitz-zentroa/latxa. Our suite enables reproducible research on methods to build LLMs for low-resource languages.


title: Counterdiabatic, Better, Faster, Stronger: Optimal control for approximate counterdiabatic driving

abstract: Adiabatic protocols are employed across a variety of quantum technologies, from implementing state preparation and individual operations that are building blocks of larger devices, to higher-level protocols in quantum annealing and adiabatic quantum computation. The main drawback of adiabatic processes, however, is that they require prohibitively long timescales. This generally leads to losses due to decoherence and heating processes. The problem of speeding up system dynamics while retaining the adiabatic condition has garnered a large amount of interest, resulting in a whole host of diverse methods and approaches made for this purpose. This thesis is dedicated to the discovery of new ways to combine optimal control techniques with a universal method from STA: counterdiabatic driving (CD). The CD approach offers perfect suppression of all non-adiabatic effects experienced by a system driven by a time-dependent Hamiltonian regardless of how fast the process occurs. In practice, however, exact CD is difficult to derive often even more difficult to implement. The main result presented in the thesis is thus the development of a new method called counterdiabatic optimized local driving (COLD), which implements optimal control techniques in tandem with \emph{approximations} of exact CD in a way that maximises suppression of non-adiabatic effects.


title: In Violation of the Prime Directive: Simulating detriments to Delta-Quadrant civilizations from the starship Voyager's impact on planetary rings

abstract: In the seven years that the starship Voyager spent in the Delta Quadrant, it used many questionable techniques to engage with alien civilizations and ultimately find its way home. From detailed studies of their logs and opening credits, we simulate Voyager's practice of orbiting a planet, to examine the effect on planetary rings. We outline a feasible planetary system and simulate the extent to which its rings would be disrupted. We find that Voyager's orbit could inflate the height of the rings in the vicinity of the spacecraft by a factor of 2, as well as increase the relative speeds of neighboring planetesimals within the rings. This increase in ring thickness has the potential to alter shadows on any moons of this planet, impacting ring-shadow based religions. Additionally, the acceleration of these planetesimals could rival their gravity, bucking any alien inhabitants and their tiny civilizations off of their planetesimal homeworlds. Finally, we posit that due to increased collisions amongst the planetesimals (which may harbor tiny intelligent life) the trajectory of these civilizations may be forever altered, violating the prime directive.


title: Available potential vorticity and the wave-vortex decomposition for arbitrary stratification

abstract: We consider a rotating non-hydrostatic flow with arbitrary stratification and argue that 1) the appropriate form of potential vorticity (PV) for this system is in terms of isopycnal deviation and 2) the decomposition into energetically orthogonal solutions is fundamentally a PV-inversion. The new closed-form expression for available potential vorticity (APV) is expressed in terms of isopycnal deviation, following the ideas in Wagner & Young (2015). This form of APV linearizes to quasigeostrophic PV (QGPV) after discarding the nonlinear stretching term and a height nonlinearity, the latter of which is not present in constant stratification. This formulation leads to positive definite definitions of potential enstrophy and total energy expressed in terms of isopycnal deviation, from which the quadratic versions emerge at lowest order. It is exactly these quantities diagonalized by the linear eigenmodes. Internal-gravity waves, geostrophic motions, inertial oscillations, and a mean density anomaly form the energetically and enstrophically orthogonal constituents of flow. The complete state of the fluid can be represented in terms of these physically realizeable modes and determined from the derived projection operators using the horizontal velocity and density anomaly. The projection of the fluid state onto the non-hydrostatic wave modes, reveals that one must first account for the PV portion of the flow before recovering the wave solutions. We apply the physical insights of the decomposition to a mesoscale eddy showing how strict adherence to adiabatic rearrangement places strong constraints on the vertical structure of such eddies, including a skew towards stronger cyclonic eddies in the upper water-column. Finally, the expression for APV is shown to reproduce the height nonlinearity of shallow-water PV, a well know feature that breaks the cyclone-anticyclone symmetry in QGPV.


title: Mekler's Construction and Murphy's Law for 2-Nilpotent Groups

abstract: Mekler's construction is a powerful technique for building purely algebraic structures from combinatorial ones. Its power lies in the fact that it allows various model-theoretic tameness properties of the combinatorial structure to transfer to the algebraic one. In this paper, we push this ideology much further, describing a broad class of properties that transfer through Mekler's construction. This technique subsumes many well-known results and opens avenues for many more. As a straightforward application of our methods, we (1) obtain transfer principles for stably embedded pairs of Mekler groups and (2) construct the first examples of strictly $\mathsf{NFOP}_k$ pure groups for all $k\in\mathbb{N}_{>2}$. We also answer a question of Chernikov and Hempel on the transfer of burden.


title: Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want

abstract: The interaction between humans and artificial intelligence (AI) is a crucial factor that reflects the effectiveness of multimodal large language models (MLLMs). However, current MLLMs primarily focus on image-level comprehension and limit interaction to textual instructions, thereby constraining their flexibility in usage and depth of response. In this paper, we introduce the Draw-and-Understand project: a new model, a multi-domain dataset, and a challenging benchmark for visual prompting. Specifically, we propose SPHINX-V, a new end-to-end trained Multimodal Large Language Model (MLLM) that connects a vision encoder, a visual prompt encoder and an LLM for various visual prompts (points, bounding boxes, and free-form shape) and language understanding. To advance visual prompting research for MLLMs, we introduce MDVP-Data and MDVP-Bench. MDVP-Data features a multi-domain dataset containing 1.6M unique image-visual prompt-text instruction-following samples, including natural images, document images, OCR images, mobile screenshots, web screenshots, and multi-panel images. Furthermore, we present MDVP-Bench, a comprehensive and challenging benchmark to assess a model's capability in understanding visual prompting instructions. Our experiments demonstrate SPHINX-V's impressive multimodal interaction capabilities through visual prompting, revealing significant improvements in detailed pixel-level description and question-answering abilities.


title: A Versatile Hong-Ou-Mandel Interference Experiment in Optical Fiber for the Undergraduate Laboratory

abstract: Hong-Ou-Mandel (HOM) interference is a quantum optics laboratory experiment that has recently become more accessible to undergraduate students. The experiment consists of two identical photons simultaneously entering a non-polarizing beam splitter. The wavefunctions destructively interfere and the photon pairs bunch at the outputs whereas classically they are equally likely to exit different outputs. Due to the precision needed to achieve indistinguishability, setup and alignment of this experiment is often considered to be too difficult and time consuming to be appropriate for an undergraduate lab, with an end goal of merely demonstrating the HOM interference dip. Here, we present an alternative optical fiber-based apparatus that gives a consistently reproducible experiment with interference occurring in a fused-fiber coupler instead of a traditional beam splitter. We use a commercially available fiber coupled biphoton source that requires minimal alignment and increases coherence length of the interference. In addition, our biphoton source provides direct temperature based control of the frequency degeneracy of the photon pairs produced, allowing for students to investigate physical properties of HOM interference such as coherence length and interference visibility. Through use of standard opto-mechanical parts combined with the commercially available fiber integrated biphoton source and laser, our apparatus is a middle ground between built-from-scratch and pre-aligned setups.


title: CATSNet: a context-aware network for Height Estimation in a Forested Area based on Pol-TomoSAR data

abstract: Tropical forests are a key component of the global carbon cycle. With plans for upcoming space-borne missions like BIOMASS to monitor forestry, several airborne missions, including TropiSAR and AfriSAR campaigns, have been successfully launched and experimented. Typical Synthetic Aperture Radar Tomography (TomoSAR) methods involve complex models with low accuracy and high computation costs. In recent years, deep learning methods have also gained attention in the TomoSAR framework, showing interesting performance. Recently, a solution based on a fully connected Tomographic Neural Network (TSNN) has demonstrated its effectiveness in accurately estimating forest and ground heights by exploiting the pixel-wise elements of the covariance matrix derived from TomoSAR data. This work instead goes beyond the pixel-wise approach to define a context-aware deep learning-based solution named CATSNet. A convolutional neural network is considered to leverage patch-based information and extract features from a neighborhood rather than focus on a single pixel. The training is conducted by considering TomoSAR data as the input and Light Detection and Ranging (LiDAR) values as the ground truth. The experimental results show striking advantages in both performance and generalization ability by leveraging context information within Multiple Baselines (MB) TomoSAR data across different polarimetric modalities, surpassing existing techniques.


title: Spherical Particle in Nematic Liquid Crystal with a Magnetic Field and Planar Anchoring

abstract: We study minimizers of the Landau-de Gennes energy in $\mathbb{R}^3\setminus B_1(0)$ with external magnetic field in the large particle limit. We impose strong tangential anchoring and uniaxiality of the $Q-$tensor on the boundary. We derive a lower bound for the energy in terms of the boundary condition and show in the extreme cases that the longitudinal director field is energy minimizing, indicating the presence of two half-point defects, so called boojums, at two opposite points of the sphere. Using a recovery sequence, we show that the energy bound is optimal.


title: Snap-it, Tap-it, Splat-it: Tactile-Informed 3D Gaussian Splatting for Reconstructing Challenging Surfaces

abstract: Touch and vision go hand in hand, mutually enhancing our ability to understand the world. From a research perspective, the problem of mixing touch and vision is underexplored and presents interesting challenges. To this end, we propose Tactile-Informed 3DGS, a novel approach that incorporates touch data (local depth maps) with multi-view vision data to achieve surface reconstruction and novel view synthesis. Our method optimises 3D Gaussian primitives to accurately model the object's geometry at points of contact. By creating a framework that decreases the transmittance at touch locations, we achieve a refined surface reconstruction, ensuring a uniformly smooth depth map. Touch is particularly useful when considering non-Lambertian objects (e.g. shiny or reflective surfaces) since contemporary methods tend to fail to reconstruct with fidelity specular highlights. By combining vision and tactile sensing, we achieve more accurate geometry reconstructions with fewer images than prior methods. We conduct evaluation on objects with glossy and reflective surfaces and demonstrate the effectiveness of our approach, offering significant improvements in reconstruction quality.


title: Constraints on the Blazar-Boosted Dark Matter from the CDEX-10 Experiment

abstract: We report new constraints on light dark matter (DM) boosted by blazars using the 205.4 kg day data from the CDEX-10 experiment located at the China Jinping Underground Laboratory. Two representative blazars, TXS 0506+56 and BL Lacertae are studied. The results derived from TXS 0506+56 exclude DM-nucleon elastic scattering cross sections from $4.6\times 10^{-33}\ \rm cm^2$ to $1\times10^{-26}\ \rm cm^2$ for DM masses between 10 keV and 1 GeV, and the results derived from BL Lacertae exclude DM-nucleon elastic scattering cross sections from $2.4\times 10^{-34}\ \rm cm^2$ to $1\times10^{-26}\ \rm cm^2$ for the same range of DM masses. The constraints correspond to the best sensitivities among solid-state detector experiments in the sub-MeV mass range.


title: Metamagnetism in the high-pressure tetragonal phase of UTe$_2$

abstract: A structural orthorhombic-to-tetragonal phase transition was recently discovered in the heavy-fermion compound UTe$_2$ at a pressure $p^*\simeq3-8$~GPa [Honda \textit{et al.}, J. Phys. Soc. Jpn. \textbf{92}, 044702 (2023); Huston \textit{et al.}, Phys. Rev. Mat. \textbf{6}, 114801 (2022)]. In the high-pressure tetragonal phase, a phase transition at $T_x=235$~K and a superconducting transition at $T_{sc}=2$~K have been revealed. In this work, we present an electrical-resistivity study of UTe$_2$ in pulsed magnetic fields up to $\mu_0H=58$~T combined with pressures up to $p$ = 6 GPa. The field was applied in a direction tilted by 30~$^\circ$~from \textbf{b} to \textbf{c} in the orthogonal structure, which is identified as the direction \textbf{c} of the tetragonal structure. In the tetragonal phase, the presence of superconductivity is confirmed and signatures of metamagnetic transitions are observed at the fields $\mu_0H_{x1}=24$~T and $\mu_0H_{x2}=34$~T and temperatures smaller than $T_x$. We discuss the effects of uniaxial pressure and we propose that a magnetic ordering drives the transition at $T_x$.


title: A realistic theory of $\mathrm{E_{6}}$ unification through novel intermediate symmetries

abstract: We propose a non-supersymmetric $\mathrm{E}_{6}$ GUT with the scalar sector consisting of $\mathbf{650}\oplus \mathbf{351'} \oplus \mathbf{27}$. Making use of the first representation for the initial symmetry breaking to an intermediate stage, and the latter two representations for second-stage breaking to the Standard Model and a realistic Yukawa sector, this theory represents the minimal $\mathrm{E}_{6}$ GUT that proceeds through one of the intermediate stages that are novel compared to $\mathrm{SU(5)}$ or $\mathrm{SO}(10)$ GUT: trinification $\mathrm{SU}(3)_C\times \mathrm{SU}(3)_L\times \mathrm{SU}(3)_R$, $\mathrm{SU}(6)\times \mathrm{SU}(2)$ and flipped $\mathrm{SO}(10)\times\mathrm{U}(1)$. We analyze these possibilities under the choice of vacuum that preserves a $\mathbb{Z}_{2}$ ``spinorial parity'', which disentangles the chiral and vector-like fermions of $\mathrm{E}_{6}$ and provides a dark matter candidate in the form of a (scalar) inert doublet. Three cases are shown to consistently unify under the extended survival hypothesis (with minimal fine-tuning): trinification symmetry $\mathrm{SU}(3)_C\times \mathrm{SU}(3)_L\times \mathrm{SU}(3)_R$ with either $LR$ or $CR$ parity, and $\mathrm{SU}(6)_{CR}\times\mathrm{SU}(2)_L$. Although the successful cases give a large range for proton lifetime estimates, all of them include regions consistent with current experimental bounds and within reach of forthcoming experiments. The scenario investigated in this paper essentially represents the unique (potentially) viable choice in the class of $\mathrm{E}_{6}$ GUTs proceeding through a novel-symmetry intermediate stage, since non-minimal alternatives seem to be intrinsically non-perturbative.


title: LUQ: Long-text Uncertainty Quantification for LLMs

abstract: Large Language Models (LLMs) have demonstrated remarkable capability in a variety of NLP tasks. Despite their effectiveness, these models are prone to generate nonfactual content. Uncertainty Quantification (UQ) is pivotal in enhancing our understanding of a model's confidence in its generated content, thereby aiding in the mitigation of nonfactual outputs. Existing research on UQ predominantly targets short text generation, typically yielding brief, word-limited responses. However, real-world applications frequently necessitate much longer responses. Our study first highlights the limitations of current UQ methods in handling long text generation. We then introduce \textsc{Luq}, a novel sampling-based UQ approach specifically designed for long text. Our findings reveal that \textsc{Luq} outperforms existing baseline methods in correlating with the model's factuality scores (negative coefficient of -0.85 observed for Gemini Pro). With \textsc{Luq} as the tool for UQ, we investigate behavior patterns of several popular LLMs' response confidence spectrum and how that interplays with the response' factuality. We identify that LLMs lack confidence in generating long text for rare facts and a factually strong model (i.e. GPT-4) tends to reject questions it is not sure about. To further improve the factual accuracy of LLM responses, we propose a method called \textsc{Luq-Ensemble} that ensembles responses from multiple models and selects the response with the least uncertainty. The ensembling method greatly improves the response factuality upon the best standalone LLM.


title: Sparse multimodal fusion with modal channel attention

abstract: The ability of masked multimodal transformer architectures to learn a robust embedding space when modality samples are sparsely aligned is studied by measuring the quality of generated embedding spaces as a function of modal sparsity. An extension to the masked multimodal transformer model is proposed which incorporates modal-incomplete channels in the multihead attention mechanism called modal channel attention (MCA). Two datasets with 4 modalities are used, CMU-MOSEI for multimodal sentiment recognition and TCGA for multiomics. Models are shown to learn uniform and aligned embedding spaces with only two out of four modalities in most samples. It was found that, even with no modal sparsity, the proposed MCA mechanism improves the quality of generated embedding spaces, recall metrics, and subsequent performance on downstream tasks.


title: Vulcan: Retreading a Tired Hypothesis with the 2024 Total Solar Eclipse

abstract: The number of planets in the solar system over the last three centuries has, perhaps surprisingly, been less of a fixed value than one would think it should be. In this paper, we look at the specific case of Vulcan, which was both a planet before Pluto was a planet and discarded from being a planet before Pluto was downgraded. We examine the historical context that led to its discovery in the 19th century, the decades of observations that were taken of it, and its eventual fall from glory. By applying a more modern understanding of astrophysics, we provide multiple mechanisms that may have changed the orbit of Vulcan sufficiently that it would have been outside the footprint of early 20th century searches for it. Finally, we discuss how the April 8, 2024 eclipse provides a renewed opportunity to rediscover this lost planet after more than a century of having been overlooked.


title: The Higgs Mass and a Perspective on Broken Autonomy of Scales

abstract: The hierarchy problem of the Higgs mass, the violation of the autonomy of far-distant energy scales, is identified as a pseudo-problem. The pseudo-problem is based on the dogmatic adherence to the methodology of effective theories, for which there is no justification when dealing with presumably fundamental phenomena such as the Higgs mechanism. In view of further breaches of autonomy of scales in fundamental principles outside particle physics, the hierarchy problem is instead reinterpreted as an indication of the fundamental ontological status of the Higgs boson. Selective Realism justifies this attribution within the effective theories of the standard model of particle physics. Moreover, a model of changes in aesthetic canons provides an explanation for the existing dogmatism regarding effective theories.


title: A New Information Complexity Measure for Multi-pass Streaming with Applications

abstract: We introduce a new notion of information complexity for multi-pass streaming problems and use it to resolve several important questions in data streams. In the coin problem, one sees a stream of $n$ i.i.d. uniform bits and one would like to compute the majority with constant advantage. We show that any constant pass algorithm must use $\Omega(\log n)$ bits of memory, significantly extending an earlier $\Omega(\log n)$ bit lower bound for single-pass algorithms of Braverman-Garg-Woodruff (FOCS, 2020). This also gives the first $\Omega(\log n)$ bit lower bound for the problem of approximating a counter up to a constant factor in worst-case turnstile streams for more than one pass. In the needle problem, one either sees a stream of $n$ i.i.d. uniform samples from a domain $[t]$, or there is a randomly chosen needle $\alpha \in[t]$ for which each item independently is chosen to equal $\alpha$ with probability $p$, and is otherwise uniformly random in $[t]$. The problem of distinguishing these two cases is central to understanding the space complexity of the frequency moment estimation problem in random order streams. We show tight multi-pass space bounds for this problem for every $p < 1/\sqrt{n \log^3 n}$, resolving an open question of Lovett and Zhang (FOCS, 2023); even for $1$-pass our bounds are new. To show optimality, we improve both lower and upper bounds from existing results. Our information complexity framework significantly extends the toolkit for proving multi-pass streaming lower bounds, and we give a wide number of additional streaming applications of our lower bound techniques, including multi-pass lower bounds for $\ell_p$-norm estimation, $\ell_p$-point query and heavy hitters, and compressed sensing problems.


title: LayerNorm: A key component in parameter-efficient fine-tuning

abstract: Fine-tuning a pre-trained model, such as Bidirectional Encoder Representations from Transformers (BERT), has been proven to be an effective method for solving many natural language processing (NLP) tasks. However, due to the large number of parameters in many state-of-the-art NLP models, including BERT, the process of fine-tuning is computationally expensive. One attractive solution to this issue is parameter-efficient fine-tuning, which involves modifying only a minimal segment of the model while keeping the remainder unchanged. Yet, it remains unclear which segment of the BERT model is crucial for fine-tuning. In this paper, we first analyze different components in the BERT model to pinpoint which one undergoes the most significant changes after fine-tuning. We find that output LayerNorm changes more than any other components when fine-tuned for different General Language Understanding Evaluation (GLUE) tasks. Then we show that only fine-tuning the LayerNorm can reach comparable, or in some cases better, performance to full fine-tuning and other parameter-efficient fine-tuning methods. Moreover, we use Fisher information to determine the most critical subset of LayerNorm and demonstrate that many NLP tasks in the GLUE benchmark can be solved by fine-tuning only a small portion of LayerNorm with negligible performance degradation.


title: A reanalysis of the LHS 1140 b atmosphere observed with the Hubble Space Telescope

abstract: The super-Earth LHS 1140 b is an interesting target for atmospheric observations since it is close to the habitable zone of its star and falls in the gap of the radius distribution of small exoplanets, in the region thought to correspond to the transition between planets with and without atmospheres. Observations of the primary transit with WFC3 on board of the Hubble Space Telescope (HST) revealed a modulation in the planet transmission spectrum compatible with the presence of water; however this modulation may be also due to stellar activity-related phenomena. Here we present a detailed analysis of the WFC3/HST observations to probe the nature of this modulation and to understand if it can be attributable to the presence of unocculted spots on the stellar surface. Our analysis strongly suggests that LHS1140 is a rather quiet star with subsolar [Fe/H] and enriched in alpha elements. Therefore, we rule out the possibility that the planetary spectrum is affected by the presence of spots and faculae. This analysis shows the importance of a proper modelling of the stellar spectrum when analyzing transit observations. Finally, we modelled the planetary atmosphere of LHS1140 b to retrieve its atmospheric composition. However, the low resolution and the narrow spectral range of HST observations prevented us from definitively determining whether the spectral features are attributable to the presence of water or of other molecules in the planetary atmosphere.


title: On generic singularities of intersections of ellipsoids: the octahedron

abstract: The goal of this work is to study the smoothings of singular coaxial intersections of ellipsoids (where coaxial includes concentric) with generic singularities, with special attention to the 3-dimensional case.


title: Benchmarking Counterfactual Image Generation

abstract: Generative AI has revolutionised visual content editing, empowering users to effortlessly modify images and videos. However, not all edits are equal. To perform realistic edits in domains such as natural image or medical imaging, modifications must respect causal relationships inherent to the data generation process. Such image editing falls into the counterfactual image generation regime. Evaluating counterfactual image generation is substantially complex: not only it lacks observable ground truths, but also requires adherence to causal constraints. Although several counterfactual image generation methods and evaluation metrics exist, a comprehensive comparison within a unified setting is lacking. We present a comparison framework to thoroughly benchmark counterfactual image generation methods. We integrate all models that have been used for the task at hand and expand them to novel datasets and causal graphs, demonstrating the superiority of Hierarchical VAEs across most datasets and metrics. Our framework is implemented in a user-friendly Python package that can be extended to incorporate additional SCMs, causal methods, generative models, and datasets for the community to build on.


title: Can LLMs Correct Physicians, Yet? Investigating Effective Interaction Methods in the Medical Domain

abstract: We explore the potential of Large Language Models (LLMs) to assist and potentially correct physicians in medical decision-making tasks. We evaluate several LLMs, including Meditron, Llama2, and Mistral, to analyze the ability of these models to interact effectively with physicians across different scenarios. We consider questions from PubMedQA and several tasks, ranging from binary (yes/no) responses to long answer generation, where the answer of the model is produced after an interaction with a physician. Our findings suggest that prompt design significantly influences the downstream accuracy of LLMs and that LLMs can provide valuable feedback to physicians, challenging incorrect diagnoses and contributing to more accurate decision-making. For example, when the physician is accurate 38% of the time, Mistral can produce the correct answer, improving accuracy up to 74% depending on the prompt being used, while Llama2 and Meditron models exhibit greater sensitivity to prompt choice. Our analysis also uncovers the challenges of ensuring that LLM-generated suggestions are pertinent and useful, emphasizing the need for further research in this area.


title: Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversation

abstract: Emotion Recognition in Conversation (ERC) involves detecting the underlying emotion behind each utterance within a conversation. Effectively generating representations for utterances remains a significant challenge in this task. Recent works propose various models to address this issue, but they still struggle with differentiating similar emotions such as excitement and happiness. To alleviate this problem, We propose an Emotion-Anchored Contrastive Learning (EACL) framework that can generate more distinguishable utterance representations for similar emotions. To achieve this, we utilize label encodings as anchors to guide the learning of utterance representations and design an auxiliary loss to ensure the effective separation of anchors for similar emotions. Moreover, an additional adaptation process is proposed to adapt anchors to serve as effective classifiers to improve classification performance. Across extensive experiments, our proposed EACL achieves state-of-the-art emotion recognition performance and exhibits superior performance on similar emotions. Our code is available at https://github.com/Yu-Fangxu/EACL.


title: Monotone inclusion methods for a class of second-order non-potential mean-field games

abstract: We propose a monotone splitting algorithm for solving a class of second-order non-potential mean-field games. Following [Achdou, Capuzzo-Dolcetta, "Mean Field Games: Numerical Methods," SINUM (2010)], we introduce a finite-difference scheme and observe that the scheme represents first-order optimality conditions for a primal-dual pair of monotone inclusions. Based on this observation, we prove that the finite-difference system obtains a solution that can be provably recovered by an extension of the celebrated primal-dual hybrid gradient (PDHG) algorithm.


title: A catalogue of asteroseismically calibrated ages for APOGEE DR17. The predictions of a CatBoost machine learning model based on the [Mg/Ce] chemical clock and other stellar parameters

abstract: Context. Understanding the Milky Way's formation and evolution across cosmic epochs necessitates precise stellar age determination across all Galactic components. Recent advancements in asteroseismology, spectroscopy, stellar modelling, and machine learning, coupled with all-sky surveys, now offer highly reliable stellar age estimates. Aims. This study aims to furnish accurate age assessments for the Main Red Star Sample within the APOGEE DR17 catalogue. Leveraging asteroseismic age constraints, we employ machine learning to achieve this goal. Methods. We explore optimal non-asteroseismic stellar parameters, including T$_{eff}$, L, [CI/N], [Mg/Ce], [$\alpha$/Fe], U(LSR) velocity, and 'Z' vertical height from the Galactic plane, to predict ages via categorical gradient boost decision trees. Training merges samples from the TESS Southern Continuous Viewing Zone and Second APOKASC catalogue to mitigate data shifts, enhancing prediction reliability. Validation employs an independent dataset from the K2 Galactic Archaeology Program. Results. Our model yields a median fractional age error of 20.8%, with a prediction variance of 4.77%. Median fractional errors for stars older than 3 Gyr range from 7% to 23%, from 1 to 3 Gyr range from 26% to 28%, and for stars younger than 1 Gyr, it's 43%. Applicable to 125,445 stars in the APOGEE DR17 Main Red Star Sample, our analysis confirms previous findings on the young Galactic disc's flaring and reveals an age gradient among the youngest Galactic plane stars. Additionally, we identify two groups of metal-poor ([Fe/H] < -1 dex) young stars (Age < 2 Gyr) exhibiting similar chemical abundances and halo kinematics, likely remnants of the predicted third gas infall episode (~2.7 Gyr ago).


title: Further remarks on absorbing Markov decision processes

abstract: In this note, based on the recent remarkable results of Dufour and Prieto-Rumeau, we deduce that for an absorbing MDP with a given initial state, under a standard compactness-continuity condition, the space of occupation measures has the same convergent sequences, when it is endowed with the weak topology and with the weak-strong topology. We provided two examples demonstrating that imposed condition cannot be replaced with its popular alternative, and the above assertion does not hold for the space of marginals of occupation measures on the state space. Moreover, the examples also clarify some results in the previous literature.


title: Probing Heavy Charged Higgs Boson Using Multivariate Technique at Gamma-Gamma Collider

abstract: The current study explores the production of charged Higgs particles through photon-photon collisions within the Two Higgs Doublet Model context, including one-loop-level scattering amplitude of Electroweak and QED radiation. The cross-section has been scanned for plane ($m_{\phi^{0}}, \sqrt{s}$) investigating the process of $\gamma\gamma \rightarrow H^{+}H^{-}$. Three particular numerical scenarios low-$m_{H}$, non-alignment, and short-cascade are employed. Hence using $h^{0}$ for low-$m_{H^{0}}$ and $H^{0}$ for non-alignment and short-cascade scenario, the new experimental and theoretical constraints are applied.The decay channels for charged Higgs particles are examined in all the scenarios along with the analysis for cross-sections revealing that at low energy it is consistently higher for all scenarios. However as $\sqrt{s}$ increases, it reaches a peak value at 1$~$TeV for all benchmark scenarios. The branching ratio of the decay channels indicates that for non-alignment, the mode of decay $W^{\pm} h^{0}$ takes control %{} when $BR(H^{\pm} \rightarrow W^{\pm} H^{0})$ decreases at larger values of $m_{H^{0}}$.} and for short cascade the prominent decay mode remains $t\bar{b}$, while in the low-$m_{H}$ the dominant decay channel is of $W^{\pm} h^{0}$. In our research, we employ contemporary machine-learning methodologies to investigate the production of high-energy Higgs Bosons within a 3$ $TeV Gamma-Gamma collider. We have used multivariate approaches such as Boosted Decision Trees (BDT), LikelihoodD, and Multilayer Perceptron (MLP) to show the observability of heavy-charged Higgs Bosons versus the most significant Standard Model backgrounds. The purity of the signal efficiency and background rejection are measured for each cut value.


title: Invertibility of Discrete-Time Linear Systems with Sparse Inputs

abstract: One of the fundamental problems of interest for discrete-time linear systems is whether its input sequence may be recovered given its output sequence, a.k.a. the left inversion problem. Many conditions on the state space geometry, dynamics, and spectral structure of a system have been used to characterize the well-posedness of this problem, without assumptions on the inputs. However, certain structural assumptions, such as input sparsity, have been shown to translate to practical gains in the performance of inversion algorithms, surpassing classical guarantees. Establishing necessary and sufficient conditions for left invertibility of systems with sparse inputs is therefore a crucial step toward understanding the performance limits of system inversion under structured input assumptions. In this work, we provide the first necessary and sufficient characterizations of left invertibility for linear systems with sparse inputs, echoing classic characterizations for standard linear systems. The key insight in deriving these results is in establishing the existence of two novel geometric invariants unique to the sparse-input setting, the weakly unobservable and strongly reachable subspace arrangements. By means of a concrete example, we demonstrate the utility of these characterizations. We conclude by discussing extensions and applications of this framework to several related problems in sparse control.


title: Active flow control of a turbulent separation bubble through deep reinforcement learning

abstract: The control efficacy of classical periodic forcing and deep reinforcement learning (DRL) is assessed for a turbulent separation bubble (TSB) at $Re_\tau=180$ on the upstream region before separation occurs. The TSB can resemble a separation phenomenon naturally arising in wings, and a successful reduction of the TSB can have practical implications in the reduction of the aviation carbon footprint. We find that the classical zero-net-mas-flux (ZNMF) periodic control is able to reduce the TSB by 15.7%. On the other hand, the DRL-based control achieves 25.3% reduction and provides a smoother control strategy while also being ZNMF. To the best of our knowledge, the current test case is the highest Reynolds-number flow that has been successfully controlled using DRL to this date. In future work, these results will be scaled to well-resolved large-eddy simulation grids. Furthermore, we provide details of our open-source CFD-DRL framework suited for the next generation of exascale computing machines.


title: Aiming at the Target: Filter Collaborative Information for Cross-Domain Recommendation

abstract: Cross-domain recommender (CDR) systems aim to enhance the performance of the target domain by utilizing data from other related domains. However, irrelevant information from the source domain may instead degrade target domain performance, which is known as the negative transfer problem. There have been some attempts to address this problem, mostly by designing adaptive representations for overlapped users. Whereas, representation adaptions solely rely on the expressive capacity of the CDR model, lacking explicit constraint to filter the irrelevant source-domain collaborative information for the target domain. In this paper, we propose a novel Collaborative information regularized User Transformation (CUT) framework to tackle the negative transfer problem by directly filtering users' collaborative information. In CUT, user similarity in the target domain is adopted as a constraint for user transformation learning to filter the user collaborative information from the source domain. CUT first learns user similarity relationships from the target domain. Then, source-target information transfer is guided by the user similarity, where we design a user transformation layer to learn target-domain user representations and a contrastive loss to supervise the user collaborative information transferred. The results show significant performance improvement of CUT compared with SOTA single and cross-domain methods. Further analysis of the target-domain results illustrates that CUT can effectively alleviate the negative transfer problem.


title: Balanced Data Placement for GEMV Acceleration with Processing-In-Memory

abstract: With unprecedented demand for generative AI (GenAI) inference, acceleration of primitives that dominate GenAI such as general matrix-vector multiplication (GEMV) is receiving considerable attention. A challenge with GEMVs is the high memory bandwidth this primitive demands. Multiple memory vendors have proposed commercially viable processing-in-memory (PIM) prototypes that attain bandwidth boost over processor via augmenting memory banks with compute capabilities and broadcasting same command to all banks. While proposed PIM designs stand to accelerate GEMV, we observe in this work that a key impediment to truly harness PIM acceleration is deducing optimal data-placement to place the matrix in memory banks. To this end, we tease out several factors that impact data-placement and propose PIMnast methodology which, like a gymnast, balances these factors to identify data-placements that deliver GEMV acceleration. Across a spectrum of GenAI models, our proposed PIMnast methodology along with additional orchestration knobs we identify delivers up to 6.86$\times$ speedup for GEMVs (of the available 7$\times$ roofline speedup) leading to up to 5$\times$ speedup for per-token latencies.


title: Review-Based Cross-Domain Recommendation via Hyperbolic Embedding and Hierarchy-Aware Domain Disentanglement

abstract: The issue of data sparsity poses a significant challenge to recommender systems. In response to this, algorithms that leverage side information such as review texts have been proposed. Furthermore, Cross-Domain Recommendation (CDR), which captures domain-shareable knowledge and transfers it from a richer domain (source) to a sparser one (target), has received notable attention. Nevertheless, the majority of existing methodologies assume a Euclidean embedding space, encountering difficulties in accurately representing richer text information and managing complex interactions between users and items. This paper advocates a hyperbolic CDR approach based on review texts for modeling user-item relationships. We first emphasize that conventional distance-based domain alignment techniques may cause problems because small modifications in hyperbolic geometry result in magnified perturbations, ultimately leading to the collapse of hierarchical structures. To address this challenge, we propose hierarchy-aware embedding and domain alignment schemes that adjust the scale to extract domain-shareable information without disrupting structural forms. The process involves the initial embedding of review texts in hyperbolic space, followed by feature extraction incorporating degree-based normalization and structure alignment. We conducted extensive experiments to substantiate the efficiency, robustness, and scalability of our proposed model in comparison to state-of-the-art baselines.


title: Every locally compact group is the outer automorphism group of a II$_1$ factor

abstract: We prove that every locally compact second countable group $G$ arises as the outer automorphism group Out $M$ of a II$_1$ factor, which was so far only known for totally disconnected groups, compact groups and a few isolated examples. We obtain this result by proving that every locally compact second countable group is a centralizer group, a class of Polish groups that arise naturally in ergodic theory and that may all be realized as Out $M$.


title: Improving Learnt Local MAPF Policies with Heuristic Search

abstract: Multi-agent path finding (MAPF) is the problem of finding collision-free paths for a team of agents to reach their goal locations. State-of-the-art classical MAPF solvers typically employ heuristic search to find solutions for hundreds of agents but are typically centralized and can struggle to scale when run with short timeouts. Machine learning (ML) approaches that learn policies for each agent are appealing as these could enable decentralized systems and scale well while maintaining good solution quality. Current ML approaches to MAPF have proposed methods that have started to scratch the surface of this potential. However, state-of-the-art ML approaches produce "local" policies that only plan for a single timestep and have poor success rates and scalability. Our main idea is that we can improve a ML local policy by using heuristic search methods on the output probability distribution to resolve deadlocks and enable full horizon planning. We show several model-agnostic ways to use heuristic search with learnt policies that significantly improve the policies' success rates and scalability. To our best knowledge, we demonstrate the first time ML-based MAPF approaches have scaled to high congestion scenarios (e.g. 20% agent density).


title: A microstructure-sensitive electro-chemo-mechanical phase-field model of pitting and stress corrosion cracking

abstract: An electro-chemo-mechanical phase-field formulation is developed to simulate pitting and stress corrosion in polycrystalline materials. The formulation incorporates dependencies of mechanical properties and corrosion potential on crystallographic orientation. The model considers the formation and charging dynamics of an electric double layer through a new general boundary condition for the solution potential. The potential of the model is demonstrated by simulating corrosion in polycrystalline materials with various grain morphology distributions. The results show that incorporating the underlying microstructure yields more extensive defects, faster defect kinetics, and irregular pit and crack shapes relative to a microstructurally-insensitive homogeneous material scenario.

categories: cs.CE cond-mat.mtrl-sci physics.app-ph physics.chem-ph


title: I'm in AGNi: A new standard for AGN pluralisation

abstract: We present a new standard acronym for Active Galactic Nuclei, finally settling the argument of AGN vs. AGNs. Our new standard is not only etymologically superior (following the consensus set by SNe), but also boasts other linguistic opportunities, connecting strongly with relevant theology and streamlining descriptions of AGN properties.


title: Exploring Constraints on Simplified Dark Matter Model Through Flavour and Electroweak Observables

abstract: This study focuses on a combined analysis of various available inputs to constrain the parameter spaces of a simplified dark matter (SDM) model featuring a spin-0 mediator and fermionic dark matter (DM). The spin-0 mediator interacts with standard model (SM) fermions, SM gauge bosons, and DM. We constrain the parameter spaces of different relevant couplings, DM mass, and the mediator mass, using the data from flavour-changing charged and neutral current processes, CKM matrices, $W$ and $Z$-pole observables, DM relic density, direct and indirect detection bounds. We have calculated bounds on the couplings from both separate and simultaneous analyses of the mentioned processes. We identify correlated parameter spaces for all the relevant parameters which include the couplings and the masses. For the DM and mediator masses, we have scanned the region between 100 GeV and 1000 GeV. Using our results, we have obtained bounds on the couplings of possible higher dimensional operators from which we can formulate our SDM.


title: Pandigital and penholodigital numbers

abstract: Pandigital and penholodigital numbers are numbers that contain every digit or nonzero digit respectively. We study properties of pandigital or penholodigital numbers that are also squares or prime.


title: Local Correction of Linear Functions over the Boolean Cube

abstract: We consider the task of locally correcting, and locally list-correcting, multivariate linear functions over the domain $\{0,1\}^n$ over arbitrary fields and more generally Abelian groups. Such functions form error-correcting codes of relative distance $1/2$ and we give local-correction algorithms correcting up to nearly $1/4$-fraction errors making $\widetilde{\mathcal{O}}(\log n)$ queries. This query complexity is optimal up to $\mathrm{poly}(\log\log n)$ factors. We also give local list-correcting algorithms correcting $(1/2 - \varepsilon)$-fraction errors with $\widetilde{\mathcal{O}}_{\varepsilon}(\log n)$ queries. These results may be viewed as natural generalizations of the classical work of Goldreich and Levin whose work addresses the special case where the underlying group is $\mathbb{Z}_2$. By extending to the case where the underlying group is, say, the reals, we give the first non-trivial locally correctable codes (LCCs) over the reals (with query complexity being sublinear in the dimension (also known as message length)). The central challenge in constructing the local corrector is constructing "nearly balanced vectors" over $\{-1,1\}^n$ that span $1^n$ -- we show how to construct $\mathcal{O}(\log n)$ vectors that do so, with entries in each vector summing to $\pm1$. The challenge to the local-list-correction algorithms, given the local corrector, is principally combinatorial, i.e., in proving that the number of linear functions within any Hamming ball of radius $(1/2-\varepsilon)$ is $\mathcal{O}_{\varepsilon}(1)$. Getting this general result covering every Abelian group requires integrating a variety of known methods with some new combinatorial ingredients analyzing the structural properties of codewords that lie within small Hamming balls.


title: Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference

abstract: With the ubiquitous use of modern large language models (LLMs) across industries, the inference serving for these models is ever expanding. Given the high compute and memory requirements of modern LLMs, more and more top-of-the-line GPUs are being deployed to serve these models. Energy availability has come to the forefront as the biggest challenge for data center expansion to serve these models. In this paper, we present the trade-offs brought up by making energy efficiency the primary goal of LLM serving under performance SLOs. We show that depending on the inputs, the model, and the service-level agreements, there are several knobs available to the LLM inference provider to use for being energy efficient. We characterize the impact of these knobs on the latency, throughput, as well as the energy. By exploring these trade-offs, we offer valuable insights into optimizing energy usage without compromising on performance, thereby paving the way for sustainable and cost-effective LLM deployment in data center environments.


title: Optimal Communication for Classic Functions in the Coordinator Model and Beyond

abstract: In the coordinator model of communication with $s$ servers, given an arbitrary non-negative function $f$, we study the problem of approximating the sum $\sum_{i \in [n]}f(x_i)$ up to a $1 \pm \varepsilon$ factor. Here the vector $x \in R^n$ is defined to be $x = x(1) + \cdots + x(s)$, where $x(j) \ge 0$ denotes the non-negative vector held by the $j$-th server. A special case of the problem is when $f(x) = x^k$ which corresponds to the well-studied problem of $F_k$ moment estimation in the distributed communication model. We introduce a new parameter $c_f[s]$ which captures the communication complexity of approximating $\sum_{i\in [n]} f(x_i)$ and for a broad class of functions $f$ which includes $f(x) = x^k$ for $k \ge 2$ and other robust functions such as the Huber loss function, we give a two round protocol that uses total communication $c_f[s]/\varepsilon^2$ bits, up to polylogarithmic factors. For this broad class of functions, our result improves upon the communication bounds achieved by Kannan, Vempala, and Woodruff (COLT 2014) and Woodruff and Zhang (STOC 2012), obtaining the optimal communication up to polylogarithmic factors in the minimum number of rounds. We show that our protocol can also be used for approximating higher-order correlations. Apart from the coordinator model, algorithms for other graph topologies in which each node is a server have been extensively studied. We argue that directly lifting protocols leads to inefficient algorithms. Hence, a natural question is the problems that can be efficiently solved in general graph topologies. We give communication efficient protocols in the so-called personalized CONGEST model for solving linear regression and low rank approximation by designing composable sketches. Our sketch construction may be of independent interest and can implement any importance sampling procedure that has a monotonicity property.


title: ChainNet: Structured Metaphor and Metonymy in WordNet

abstract: The senses of a word exhibit rich internal structure. In a typical lexicon, this structure is overlooked: a word's senses are encoded as a list without inter-sense relations. We present ChainNet, a lexical resource which for the first time explicitly identifies these structures. ChainNet expresses how senses in the Open English Wordnet are derived from one another: every nominal sense of a word is either connected to another sense by metaphor or metonymy, or is disconnected in the case of homonymy. Because WordNet senses are linked to resources which capture information about their meaning, ChainNet represents the first dataset of grounded metaphor and metonymy.


title: InstantSplat: Unbounded Sparse-view Pose-free Gaussian Splatting in 40 Seconds

abstract: While novel view synthesis (NVS) has made substantial progress in 3D computer vision, it typically requires an initial estimation of camera intrinsics and extrinsics from dense viewpoints. This pre-processing is usually conducted via a Structure-from-Motion (SfM) pipeline, a procedure that can be slow and unreliable, particularly in sparse-view scenarios with insufficient matched features for accurate reconstruction. In this work, we integrate the strengths of point-based representations (e.g., 3D Gaussian Splatting, 3D-GS) with end-to-end dense stereo models (DUSt3R) to tackle the complex yet unresolved issues in NVS under unconstrained settings, which encompasses pose-free and sparse view challenges. Our framework, InstantSplat, unifies dense stereo priors with 3D-GS to build 3D Gaussians of large-scale scenes from sparseview & pose-free images in less than 1 minute. Specifically, InstantSplat comprises a Coarse Geometric Initialization (CGI) module that swiftly establishes a preliminary scene structure and camera parameters across all training views, utilizing globally-aligned 3D point maps derived from a pre-trained dense stereo pipeline. This is followed by the Fast 3D-Gaussian Optimization (F-3DGO) module, which jointly optimizes the 3D Gaussian attributes and the initialized poses with pose regularization. Experiments conducted on the large-scale outdoor Tanks & Temples datasets demonstrate that InstantSplat significantly improves SSIM (by 32%) while concurrently reducing Absolute Trajectory Error (ATE) by 80%. These establish InstantSplat as a viable solution for scenarios involving posefree and sparse-view conditions. Project page: instantsplat.github.io.


title: Predicting the impact of e-commerce indices on international trade in Iran and other selected members of the Organization for Economic Co-operation and Development (OECD) by using the artificial intelligence and P-VAR model

abstract: This study aims at predicting the impact of e-commerce indicators on international trade of the selected OECD countries and Iran, by using the artificial intelligence approach and P-VAR. According to the nature of export, import, GDP, and ICT functions, and the characteristics of nonlinearity, this analysis is performed by using the MPL neural network. The export, import, GDP, and ICT findings were examined with 99 percent accuracy. Using the P-VAR model in the Eviews software, the initial database and predicted data were applied to estimate the impact of e-commerce on international trade. The findings from analyzing the data show that there is a bilateral correlation between e-commerce which means that ICT and international trade affect each other and the Goodness of fit of the studied model is confirmed.


title: Gravitational Waves on Kerr Black Holes I: Reconstruction of Linearized Metric Perturbations

abstract: The gravitational perturbations of a rotating Kerr black hole are notoriously complicated, even at the linear level. In 1973, Teukolsky showed that their physical degrees of freedom are encoded in two gauge-invariant Weyl curvature scalars that obey a separable wave equation. Determining these scalars is sufficient for many purposes, such as the computation of energy fluxes. However, some applications -- such as second-order perturbation theory -- require the reconstruction of metric perturbations. In principle, this problem was solved long ago, but in practice, the solution has never been worked out explicitly. Here, we do so by writing down the metric perturbation (in either ingoing or outgoing radiation gauge) that corresponds to a given mode of either Weyl scalar. Our formulas make no reference to the Hertz potential (an intermediate quantity that plays no fundamental role) and involve only the radial and angular Kerr modes, but not their derivatives, which can be altogether eliminated using the Teukolsky--Starobinsky identities. We expect these analytic results to prove useful in numerical studies and for extending black hole perturbation theory beyond the linear regime.


title: Learn "No" to Say "Yes" Better: Improving Vision-Language Models via Negations

abstract: Existing vision-language models (VLMs) treat text descriptions as a unit, confusing individual concepts in a prompt and impairing visual semantic matching and reasoning. An important aspect of reasoning in logic and language is negations. This paper highlights the limitations of popular VLMs such as CLIP, at understanding the implications of negations, i.e., the effect of the word "not" in a given prompt. To enable evaluation of VLMs on fluent prompts with negations, we present CC-Neg, a dataset containing 228,246 images, true captions and their corresponding negated captions. Using CC-Neg along with modifications to the contrastive loss of CLIP, our proposed CoN-CLIP framework, has an improved understanding of negations. This training paradigm improves CoN-CLIP's ability to encode semantics reliably, resulting in 3.85% average gain in top-1 accuracy for zero-shot image classification across 8 datasets. Further, CoN-CLIP outperforms CLIP on challenging compositionality benchmarks such as SugarCREPE by 4.4%, showcasing emergent compositional understanding of objects, relations, and attributes in text. Overall, our work addresses a crucial limitation of VLMs by introducing a dataset and framework that strengthens semantic associations between images and text, demonstrating improved large-scale foundation models with significantly reduced computational cost, promoting efficiency and accessibility.


title: Towards a turnkey approach to unbiased Monte Carlo estimation of smooth functions of expectations

abstract: Given a smooth function $f$, we develop a general approach to turn Monte Carlo samples with expectation $m$ into an unbiased estimate of $f(m)$. Specifically, we develop estimators that are based on randomly truncating the Taylor series expansion of $f$ and estimating the coefficients of the truncated series. We derive their properties and propose a strategy to set their tuning parameters -- which depend on $m$ -- automatically, with a view to make the whole approach simple to use. We develop our methods for the specific functions $f(x)=\log x$ and $f(x)=1/x$, as they arise in several statistical applications such as maximum likelihood estimation of latent variable models and Bayesian inference for un-normalised models. Detailed numerical studies are performed for a range of applications to determine how competitive and reliable the proposed approach is.


title: pastamarkers: astrophysical data visualization with pasta-like markers

abstract: We aim at facilitating the visualization of astrophysical data for several tasks, such as uncovering patterns, presenting results to the community, and facilitating the understanding of complex physical relationships to the public. We present pastamarkers, a customized Python package fully compatible with matplotlib, that contains unique pasta-shaped markers meant to enhance the visualization of astrophysical data. We prove that using different pasta types as markers can improve the clarity of astrophysical plots by reproducing some of the most famous plots in the literature.


title: Resummation phenomenology and PDF determination for precision QCD at the LHC

abstract: With the ongoing Run 3 of the LHC and its upcoming High-Luminosity upgrade, there is a growing need to study observables with high precision both experimentally and theoretically. To increase precision on the theory side, improvements of fixed-order perturbative predictions, resummation of logarithmic enhancements and accurate determination of proton structure are required. This thesis explores the latter two topics. We discuss high-energy logarithms and their resummation techniques, introducing an extension of the HELL formalism for multi-differential distributions in transverse momentum, rapidity and invariant mass. We apply this framework to heavy-quark pair production at the LHC, studying the kinematics of both a single quark and the final-state pair. An additional discussion is dedicated to a possible extension of the kt-factorisation framework, which underlies high-energy resummation, to capture next-to-leading logarithmic corrections. To test this hypothesis, we delve into the computation of a NLO off-shell coefficient function using Higgs-induced DIS in the infinite top mass limit as a benchmark process and report a partial result. Beside high-energy logarithms, we consider the determination of transverse-momentum distributions from a high mass system with additional QCD radiation and exclusive production cuts. Specifically, we focus on $HW^+$ production with a jet veto and analyse the Higgs transverse momentum spectrum at NNLO, using qt-subtraction. We complement the fixed order study with NNLL resummation of jet-veto logarithms and linear power correction in ptHW using the RadISH formalism. Finally, in the last project pertaining to this thesis we consider the problem of Parton Distribution Function determination. We propose a minimal parametrisation guided by physical arguments and investigate its performance in fitting the HERA dataset with NLO QCD theory predictions.


title: Schr\"odinger symmetry: a historical review

abstract: This paper reviews the history of the conformal extension of Galilean symmetry, now called Schr\"odinger symmetry. In the physics literature, its discovery is commonly attributed to Jackiw, Niederer and Hagen (1972). However, Schr\"odinger symmetry has a much older ancestry: the associated conserved quantities were known to Jacobi in 1842/43 and its euclidean counterpart was discovered by Sophus Lie in 1881 in his studies of the heat equation. A convenient way to study Schr\"odinger symmetry is provided by a non-relativistic Kaluza-Klein-type "Bargmann" framework, first proposed by Eisenhart (1929), but then forgotten and re-discovered by Duval {\it et al.} only in 1984. Representations of Schr\"odinger symmetry differ by the value $z=2$ of the dynamical exponent from the value $z=1$ found in representations of relativistic conformal invariance. For generic values of $z$, whole families of new algebras exist, which for $z=2/\ell$ include the $\ell$-conformal galilean algebras. We also review the non-relativistic limit of conformal algebras and that this limit leads to the $1$-conformal galilean algebra and not to the Schr\"odinger algebra. The latter can be recovered in the Bargmann framework through reduction. A distinctive feature of Galilean and Schr\"odinger symmetries are the Bargmann super-selection rules, algebraically related to a central extension. An empirical consequence of this was known as "mass conservation" already to Lavoisier. As an illustration of these concepts, some applications to physical ageing in simple model systems are reviewed.

categories: hep-th cond-mat.stat-mech gr-qc math-ph math.MP


title: Convolutional Prompting meets Language Models for Continual Learning

abstract: Continual Learning (CL) enables machine learning models to learn from continuously shifting new training data in absence of data from old tasks. Recently, pretrained vision transformers combined with prompt tuning have shown promise for overcoming catastrophic forgetting in CL. These approaches rely on a pool of learnable prompts which can be inefficient in sharing knowledge across tasks leading to inferior performance. In addition, the lack of fine-grained layer specific prompts does not allow these to fully express the strength of the prompts for CL. We address these limitations by proposing ConvPrompt, a novel convolutional prompt creation mechanism that maintains layer-wise shared embeddings, enabling both layer-specific learning and better concept transfer across tasks. The intelligent use of convolution enables us to maintain a low parameter overhead without compromising performance. We further leverage Large Language Models to generate fine-grained text descriptions of each category which are used to get task similarity and dynamically decide the number of prompts to be learned. Extensive experiments demonstrate the superiority of ConvPrompt and improves SOTA by ~3% with significantly less parameter overhead. We also perform strong ablation over various modules to disentangle the importance of different components.


title: SeaBird: Segmentation in Bird's View with Dice Loss Improves Monocular 3D Detection of Large Objects

abstract: Monocular 3D detectors achieve remarkable performance on cars and smaller objects. However, their performance drops on larger objects, leading to fatal accidents. Some attribute the failures to training data scarcity or their receptive field requirements of large objects. In this paper, we highlight this understudied problem of generalization to large objects. We find that modern frontal detectors struggle to generalize to large objects even on nearly balanced datasets. We argue that the cause of failure is the sensitivity of depth regression losses to noise of larger objects. To bridge this gap, we comprehensively investigate regression and dice losses, examining their robustness under varying error levels and object sizes. We mathematically prove that the dice loss leads to superior noise-robustness and model convergence for large objects compared to regression losses for a simplified case. Leveraging our theoretical insights, we propose SeaBird (Segmentation in Bird's View) as the first step towards generalizing to large objects. SeaBird effectively integrates BEV segmentation on foreground objects for 3D detection, with the segmentation head trained with the dice loss. SeaBird achieves SoTA results on the KITTI-360 leaderboard and improves existing detectors on the nuScenes leaderboard, particularly for large objects. Code and models at https://github.com/abhi1kumar/SeaBird


title: Towards a Fault-Injection Benchmarking Suite

abstract: Soft errors in memories and logic circuits are known to disturb program execution. In this context, the research community has been proposing a plethora of fault-tolerance (FT) solutions over the last decades, as well as fault-injection (FI) approaches to test, measure and compare them. However, there is no agreed-upon benchmarking suite for demonstrating FT or FI approaches. As a replacement, authors pick benchmarks from other domains, e.g. embedded systems. This leads to little comparability across publications, and causes behavioral overlap within benchmarks that were not selected for orthogonality in the FT/FI domain. In this paper, we want to initiate a discussion on what a benchmarking suite for the FT/FI domain should look like, and propose criteria for benchmark selection.


title: MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning

abstract: Adapting models pre-trained on large-scale datasets to a variety of downstream tasks is a common strategy in deep learning. Consequently, parameter-efficient fine-tuning methods have emerged as a promising way to adapt pre-trained models to different tasks while training only a minimal number of parameters. While most of these methods are designed for single-task adaptation, parameter-efficient training in Multi-Task Learning (MTL) architectures is still unexplored. In this paper, we introduce MTLoRA, a novel framework for parameter-efficient training of MTL models. MTLoRA employs Task-Agnostic and Task-Specific Low-Rank Adaptation modules, which effectively disentangle the parameter space in MTL fine-tuning, thereby enabling the model to adeptly handle both task specialization and interaction within MTL contexts. We applied MTLoRA to hierarchical-transformer-based MTL architectures, adapting them to multiple downstream dense prediction tasks. Our extensive experiments on the PASCAL dataset show that MTLoRA achieves higher accuracy on downstream tasks compared to fully fine-tuning the MTL model while reducing the number of trainable parameters by 3.6x. Furthermore, MTLoRA establishes a Pareto-optimal trade-off between the number of trainable parameters and the accuracy of the downstream tasks, outperforming current state-of-the-art parameter-efficient training methods in both accuracy and efficiency. Our code is publicly available.


title: Structure and Dynamics of Magneto-Inertial, Differentially Rotating Laboratory Plasmas

abstract: We present a detailed characterization of the structure and evolution of differentially rotating plasmas driven on the MAGPIE pulsed-power generator (1.4 MA peak current, 240 ns rise-time). The experiments were designed to simulate physics relevant to accretion discs and jets on laboratory scales. A cylindrical aluminium wire array Z pinch enclosed by return posts with an overall azimuthal off-set angle was driven to produce ablation plasma flows that propagate inwards in a slightly off-radial trajectory, injecting mass, angular momentum, and confining ram pressure to a rotating plasma column on the axis. However, the plasma is free to expand axially, forming a collimated, differentially rotating axial jet that propagates at $\approx 100$ km/s. The density profile of the jet corresponds to a dense shell surrounding a low-density core, which is consistent with the centrifugal barrier effect being sustained along the jet's propagation. We show analytically that, as the rotating plasma accretes mass, conservation of mass and momentum implies plasma radial growth scaling as $r \propto t^{1/3}$. As the characteristic moment of inertia increases, the rotation velocity is predicted to decrease and settle on a characteristic value $\approx 20$ km/s. We find that both predictions are in agreement with Thomson scattering and optical self-emission imaging measurements.


title: Towards a Framework for Evaluating Explanations in Automated Fact Verification

abstract: As deep neural models in NLP become more complex, and as a consequence opaque, the necessity to interpret them becomes greater. A burgeoning interest has emerged in rationalizing explanations to provide short and coherent justifications for predictions. In this position paper, we advocate for a formal framework for key concepts and properties about rationalizing explanations to support their evaluation systematically. We also outline one such formal framework, tailored to rationalizing explanations of increasingly complex structures, from free-form explanations to deductive explanations, to argumentative explanations (with the richest structure). Focusing on the automated fact verification task, we provide illustrations of the use and usefulness of our formalization for evaluating explanations, tailored to their varying structures.


title: Exploring the baryonic effect signature in the Hyper Suprime-Cam Year 3 cosmic shear two-point correlations on small scales: the $S_8$ tension remains present

abstract: The baryonic feedback effect is considered as a possible solution to the so-called $S_8$ tension indicated in cosmic shear cosmology. The baryonic effect is more significant on smaller scales, and affects the cosmic shear two-point correlation functions (2PCFs) with different scale- and redshift-dependencies from those of the cosmological parameters. In this paper, we use the Hyper Suprime-Cam Year 3 (HSC-Y3) data to measure the cosmic shear 2PCFs ($\xi_{\pm}$) down to 0.28 arcminutes, taking full advantage of the high number density of source galaxies in the deep HSC data, to explore a possible signature of the baryonic effect. While the published HSC analysis used the cosmic shear 2PCFs on angular scales, which are sensitive to the matter power spectrum at $k\lesssim 1~h{\rm Mpc}^{-1}$, the smaller scale HSC cosmic shear signal allows us to probe the signature of matter power spectrum up to $k\simeq 20~h{\rm Mpc}^{-1}$. Using the accurate emulator of the nonlinear matter power spectrum, DarkEmulator2, we show that the dark matter-only model can provide an acceptable fit to the HSC-Y3 2PCFs down to the smallest scales. In other words, we do not find any clear signature of the baryonic effects or do not find a systematic shift in the $S_8$ value with the inclusion of the smaller-scale information as would be expected if the baryonic effect is significant. Alternatively, we use a flexible 6-parameter model of the baryonic effects, which can lead to both enhancement and suppression in the matter power spectrum compared to the dark matter-only model, to perform the parameter inference of the HSC-Y3 2PCFs. We find that the small-scale HSC data allow only a fractional suppression of up to 5 percent in the matter power spectrum at $k\sim 1~h{\rm Mpc}^{-1}$, which is not sufficient to reconcile the $S_8$ tension.


title: Localising the Seizure Onset Zone from Single-Pulse Electrical Stimulation Responses with a Transformer

abstract: Epilepsy is one of the most common neurological disorders, and many patients require surgical intervention when medication fails to control seizures. For effective surgical outcomes, precise localisation of the epileptogenic focus - often approximated through the Seizure Onset Zone (SOZ) - is critical yet remains a challenge. Active probing through electrical stimulation is already standard clinical practice for identifying epileptogenic areas. This paper advances the application of deep learning for SOZ localisation using Single Pulse Electrical Stimulation (SPES) responses. We achieve this by introducing Transformer models that incorporate cross-channel attention. We evaluate these models on held-out patient test sets to assess their generalisability to unseen patients and electrode placements. Our study makes three key contributions: Firstly, we implement an existing deep learning model to compare two SPES analysis paradigms - namely, divergent and convergent. These paradigms evaluate outward and inward effective connections, respectively. Our findings reveal a notable improvement in moving from a divergent (AUROC: 0.574) to a convergent approach (AUROC: 0.666), marking the first application of the latter in this context. Secondly, we demonstrate the efficacy of the Transformer models in handling heterogeneous electrode placements, increasing the AUROC to 0.730. Lastly, by incorporating inter-trial variability, we further refine the Transformer models, with an AUROC of 0.745, yielding more consistent predictions across patients. These advancements provide a deeper insight into SOZ localisation and represent a significant step in modelling patient-specific intracranial EEG electrode placements in SPES. Future work will explore integrating these models into clinical decision-making processes to bridge the gap between deep learning research and practical healthcare applications.


title: Mean-Field Limits for Stochastic Interacting Particles on Digraph Measures

abstract: Many natural phenomena are effectively described by interacting particle systems, which can be modeled using either deterministic or stochastic differential equations (SDEs). In this study, we specifically investigate particle systems modeled by SDEs, wherein the mean field limit converges to a Vlasov-Fokker-Planck-type equation. Departing from conventional approaches in stochastic analysis, we explore the network connectivity between particles using diagraph measures (DGMs). DGMs are one possible tool to capture sparse, intermediate and dense network/graph interactions in the mean-field thereby going beyond more classical approaches such as graphons. Since the main goal is to capture large classes of mean-field limits, we set up our approach using measure-theoretic arguments and combine them with suitable moment estimates to ensure approximation results for the mean-field.


title: Shaving Logs via Large Sieve Inequality: Faster Algorithms for Sparse Convolution and More

abstract: In sparse convolution-type problems, a common technique is to hash the input integers modulo a random prime $p\in [Q/2,Q]$ for some parameter $Q$, which reduces the range of the input integers while preserving their additive structure. However, this hash family suffers from two drawbacks, which led to bottlenecks in many state-of-the-art algorithms: (1) The collision probability of two elements from $[N]$ is $O(\frac{\log N}{Q})$ rather than $O(\frac{1}{Q})$; (2) It is difficult to derandomize the choice of $p$; known derandomization techniques lead to super-logarithmic overhead [Chan, Lewenstein STOC'15]. In this paper, we partially overcome these drawbacks in certain scenarios, via novel applications of the large sieve inequality from analytic number theory. Consequently, we obtain the following improved algorithms for various problems (in the standard word RAM model): Sparse Nonnegative Convolution: We obtain an $O(t\log t)$-time Las Vegas algorithm that computes the convolution $A\star B$ of two nonnegative integer vectors $A,B$, where $t$ is the output sparsity $\|A\star B\|_0$. Moreover, our algorithm terminates in $O(t\log t)$ time with $1-1/\mathrm{poly}(t)$ probability. Text-to-Pattern Hamming Distances: Given a length-$m$ pattern $P$ and a length-$n$ text $T$, we obtain a deterministic $O(n\sqrt{m\log \log m})$-time algorithm that exactly computes the Hamming distance between $P$ and every length-$m$ substring of $T$. Sparse General Convolution: We also give a Monte Carlo $O(t\log t)$ time algorithm for sparse convolution with possibly negative input in the restricted case where the length $N$ of the input vectors satisfies $N\le t^{1.99}$.


title: Gecko: Versatile Text Embeddings Distilled from Large Language Models

abstract: We present Gecko, a compact and versatile text embedding model. Gecko achieves strong retrieval performance by leveraging a key idea: distilling knowledge from large language models (LLMs) into a retriever. Our two-step distillation process begins with generating diverse, synthetic paired data using an LLM. Next, we further refine the data quality by retrieving a set of candidate passages for each query, and relabeling the positive and hard negative passages using the same LLM. The effectiveness of our approach is demonstrated by the compactness of the Gecko. On the Massive Text Embedding Benchmark (MTEB), Gecko with 256 embedding dimensions outperforms all existing entries with 768 embedding size. Gecko with 768 embedding dimensions achieves an average score of 66.31, competing with 7x larger models and 5x higher dimensional embeddings.


title: Learning Visual Quadrupedal Loco-Manipulation from Demonstrations

abstract: Quadruped robots are progressively being integrated into human environments. Despite the growing locomotion capabilities of quadrupedal robots, their interaction with objects in realistic scenes is still limited. While additional robotic arms on quadrupedal robots enable manipulating objects, they are sometimes redundant given that a quadruped robot is essentially a mobile unit equipped with four limbs, each possessing 3 degrees of freedom (DoFs). Hence, we aim to empower a quadruped robot to execute real-world manipulation tasks using only its legs. We decompose the loco-manipulation process into a low-level reinforcement learning (RL)-based controller and a high-level Behavior Cloning (BC)-based planner. By parameterizing the manipulation trajectory, we synchronize the efforts of the upper and lower layers, thereby leveraging the advantages of both RL and BC. Our approach is validated through simulations and real-world experiments, demonstrating the robot's ability to perform tasks that demand mobility and high precision, such as lifting a basket from the ground while moving, closing a dishwasher, pressing a button, and pushing a door. Project website: https://zhengmaohe.github.io/leg-manip


title: ReALM: Reference Resolution As Language Modeling

abstract: Reference resolution is an important problem, one that is essential to understand and successfully handle context of different kinds. This context includes both previous turns and context that pertains to non-conversational entities, such as entities on the user's screen or those running in the background. While LLMs have been shown to be extremely powerful for a variety of tasks, their use in reference resolution, particularly for non-conversational entities, remains underutilized. This paper demonstrates how LLMs can be used to create an extremely effective system to resolve references of various types, by showing how reference resolution can be converted into a language modeling problem, despite involving forms of entities like those on screen that are not traditionally conducive to being reduced to a text-only modality. We demonstrate large improvements over an existing system with similar functionality across different types of references, with our smallest model obtaining absolute gains of over 5% for on-screen references. We also benchmark against GPT-3.5 and GPT-4, with our smallest model achieving performance comparable to that of GPT-4, and our larger models substantially outperforming it.


title: Are We on the Right Way for Evaluating Large Vision-Language Models?

abstract: Large vision-language models (LVLMs) have recently achieved rapid progress, sparking numerous studies to evaluate their multi-modal capabilities. However, we dig into current evaluation works and identify two primary issues: 1) Visual content is unnecessary for many samples. The answers can be directly inferred from the questions and options, or the world knowledge embedded in LLMs. This phenomenon is prevalent across current benchmarks. For instance, GeminiPro achieves 42.9% on the MMMU benchmark without any visual input, and outperforms the random choice baseline across six benchmarks over 24% on average. 2) Unintentional data leakage exists in LLM and LVLM training. LLM and LVLM could still answer some visual-necessary questions without visual content, indicating the memorizing of these samples within large-scale training data. For example, Sphinx-X-MoE gets 43.6% on MMMU without accessing images, surpassing its LLM backbone with 17.9%. Both problems lead to misjudgments of actual multi-modal gains and potentially misguide the study of LVLM. To this end, we present MMStar, an elite vision-indispensable multi-modal benchmark comprising 1,500 samples meticulously selected by humans. MMStar benchmarks 6 core capabilities and 18 detailed axes, aiming to evaluate LVLMs' multi-modal capacities with carefully balanced and purified samples. These samples are first roughly selected from current benchmarks with an automated pipeline, human review is then involved to ensure each curated sample exhibits visual dependency, minimal data leakage, and requires advanced multi-modal capabilities. Moreover, two metrics are developed to measure data leakage and actual performance gain in multi-modal training. We evaluate 16 leading LVLMs on MMStar to assess their multi-modal capabilities, and on 7 benchmarks with the proposed metrics to investigate their data leakage and actual multi-modal gain.


title: Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models

abstract: This paper introduces a novel and significant challenge for Vision Language Models (VLMs), termed Unsolvable Problem Detection (UPD). UPD examines the VLM's ability to withhold answers when faced with unsolvable problems in the context of Visual Question Answering (VQA) tasks. UPD encompasses three distinct settings: Absent Answer Detection (AAD), Incompatible Answer Set Detection (IASD), and Incompatible Visual Question Detection (IVQD). To deeply investigate the UPD problem, extensive experiments indicate that most VLMs, including GPT-4V and LLaVA-Next-34B, struggle with our benchmarks to varying extents, highlighting significant room for the improvements. To address UPD, we explore both training-free and training-based solutions, offering new insights into their effectiveness and limitations. We hope our insights, together with future efforts within the proposed UPD settings, will enhance the broader understanding and development of more practical and reliable VLMs.


title: Self Gravitating Spinning String Condensates

abstract: In the context of the black hole/string transition, it is useful to produce Euclidean string backgrounds representing hot and self-gravitating strings. We utilise analytical and numerical methods to find a smooth, stationary rotating solution in the heterotic string theory at high temperatures. The solution describes a spinning winding-momentum condensate living in three non-compact dimensions, and its backreaction on the thermal cycle. At low temperatures, we expect a transition between our solution to an analytical continuation of an axionic Kerr black hole.


title: Uso de herramientas digitales matem\'aticas en la Educaci\'on Secundaria

abstract: Information and Community Technologies (ICT) are very present in our society nowadays and particularly in the educative field. In just two decades, we have passed from a learning based, in many cases, on the master lessons to one such that methodologies like the flipped classroom or the gamification are stronger than ever. Along this work, we have done a study to teachers and students with the main objective to compare the knowledge on digital tools, their use and their acceptation. We use WxMaxima and Geogebra in order to solve an exercise of \textit{Evaluaci\'on de Bachillerato para el Acceso a la Universidad} (EBAU) related with Geometry, comparing their ins and outs with the manual solution. Finally, we expose some conclusions and some possible research lines about digital tools, as well as a proposition of an introductory course on WxMaxima and Geogebra in order to teach the teachers.


title: The Minimum $L_2$-Distance Projection onto the Canonical Simplex: A Simple Algorithm

abstract: We consider the minimum distance projection in the $L_2$-norm from an arbitrary point in an $n$-dimensional, Euclidian space onto the canonical simplex. It is shown that this problem reduces to a univariate problem that can be solved by a simple algorithm. This optimization problem occurs in the setting of credit risk, where one has stochastic matrices that describe transition probabilities between different credit ratings, and one wants to determine the roots of these matrices, or close approximations to them.


title: Algorithms for constrained optimal transport

abstract: We derive iterative scaling algorithms of the Sinkhorn-Knopp (SK) type for constrained optimal transport. The constraints are in the form of prior-imposed zeroes in the transport plan. Based on classical Bregman arguments, we prove asymptotic convergence of our algorithms to a unique optimal solution. New insights obtained from the convergence proof are highlighted. An example from electrical vehicle charging in a smart city context is outlined, in which the prior zero-constraints prevent energy from being transported from some providers to some vehicles.


title: A contribution to the theory of $\sigma$-properties of a finite group

abstract: We characterize some classes of finite soluble groups. In particular, we prove that: a finite group $G$ is supersoluble if and only if $G$ has a normal subgroup $D$ such that $G/D$ is supersoluble and $D$ avoids every chief factor of $G$ between $V^{G}$ and $V_{G}$ for every maximal subgroup $V$ of the generalized Fitting subgroup $F^{*}(G)$ of $G$; a finite soluble group $G$ is a $PST$-group (that is, Sylow permutability is a transitive relation on $G$) if and only if $G$ has a normal subgroup $D$ such that $G/D$ is nilpotent and $D$ avoids every chief factor of $G$ between $V^{G}$ and $V_{G}$ for every subnormal subgroup $A$ of $G$.


title: Introduction: Swarm-based gradient descent for non convex optimization

abstract: The field of optimization has the goal to find an optimal solution to a target function, i.e. to minimize (or maximize) the target function. When trying to find such a global minimum, one often encounters local minima due to unfavorable procedures and starting regions. The swarm-based gradient descent method of Prof. Eitan Tadmor offers an alternative method for solving global minimization problems. By using a swarm of agents, local minima will not be taken account and the global minimum will be found. Furthermore leads the communication between the agent to a further expansion of the search region. Under the supervision of Prof. Angela Kunoth, I give an introduction to this swarm-based method in my bachelor thesis. Therefore I used my own program in Julia to give a more visual understanding of how the new method works and which influence certain parameters such as the number of agents or "q" have.


title: A Critique of Chen's "The 2-MAXSAT Problem Can Be Solved in Polynomial Time"

abstract: In this paper, we examine Yangjun Chen's technical report titled ``The 2-MAXSAT Problem Can Be Solved in Polynomial Time'' [Che23], which revises and expands upon their conference paper of the same name [Che22]. Chen's paper purports to build a polynomial-time algorithm for the ${\rm NP}$-complete problem 2-MAXSAT by converting a 2-CNF formula into a graph that is then searched. We show through multiple counterexamples that Chen's proposed algorithms contain flaws, and we find that the structures they create lack properly formalized definitions. Furthermore, we elaborate on how the author fails to prove the correctness of their algorithms and how they make overgeneralizations in their time analysis of their proposed solution. Due to these issues, we conclude that Chen's technical report [Che23] and conference paper [Che22] both fail to provide a proof that ${\rm P}={\rm NP}$.