title: If in a Crowdsourced Data Annotation Pipeline, a GPT-4

abstract: Recent studies indicated GPT-4 outperforms online crowd workers in data labeling accuracy, notably workers from Amazon Mechanical Turk (MTurk). However, these studies were criticized for deviating from standard crowdsourcing practices and emphasizing individual workers' performances over the whole data-annotation process. This paper compared GPT-4 and an ethical and well-executed MTurk pipeline, with 415 workers labeling 3,177 sentence segments from 200 scholarly articles using the CODA-19 scheme. Two worker interfaces yielded 127,080 labels, which were then used to infer the final labels through eight label-aggregation algorithms. Our evaluation showed that despite best practices, MTurk pipeline's highest accuracy was 81.5%, whereas GPT-4 achieved 83.6%. Interestingly, when combining GPT-4's labels with crowd labels collected via an advanced worker interface for aggregation, 2 out of the 8 algorithms achieved an even higher accuracy (87.5%, 87.0%). Further analysis suggested that, when the crowd's and GPT-4's labeling strengths are complementary, aggregating them could increase labeling accuracy.


title: Expressive Whole-Body Control for Humanoid Robots

abstract: Can we enable humanoid robots to generate rich, diverse, and expressive motions in the real world? We propose to learn a whole-body control policy on a human-sized robot to mimic human motions as realistic as possible. To train such a policy, we leverage the large-scale human motion capture data from the graphics community in a Reinforcement Learning framework. However, directly performing imitation learning with the motion capture dataset would not work on the real humanoid robot, given the large gap in degrees of freedom and physical capabilities. Our method Expressive Whole-Body Control (Exbody) tackles this problem by encouraging the upper humanoid body to imitate a reference motion, while relaxing the imitation constraint on its two legs and only requiring them to follow a given velocity robustly. With training in simulation and Sim2Real transfer, our policy can control a humanoid robot to walk in different styles, shake hands with humans, and even dance with a human in the real world. We conduct extensive studies and comparisons on diverse motions in both simulation and the real world to show the effectiveness of our approach.


title: Set the Clock: Temporal Alignment of Pretrained Language Models

abstract: Language models (LMs) are trained on web text originating from many points in time and, in general, without any explicit temporal grounding. This work investigates the temporal chaos of pretrained LMs and explores various methods to align their internal knowledge to a target time, which we call "temporal alignment." To do this, we first automatically construct a dataset containing 20K time-sensitive questions and their answers for each year from 2000 to 2023. Based on this dataset, we empirically show that pretrained LMs (e.g., LLaMa2), despite having a recent pretraining cutoff (e.g., 2022), mostly answer questions using earlier knowledge (e.g., in 2019). We then develop several methods, from prompting to finetuning, to align LMs to use their most recent knowledge when answering questions, and investigate various factors in this alignment. Our experiments demonstrate that aligning LLaMa2 to the year 2022 can enhance its performance by up to 62% according to that year's answers. This improvement occurs even without explicitly mentioning time information, indicating the possibility of aligning models' internal sense of time after pretraining. Finally, we find that alignment to a historical time is also possible, with up to 2.8$\times$ the performance of the unaligned LM in 2010 if finetuning models to that year. These findings hint at the sophistication of LMs' internal knowledge organization and the necessity of tuning them properly.


title: Detection of possible glycine precursor molecule methylamine towards the hot molecular core G358.93$-$0.03 MM1

abstract: The search for the simplest amino acid, glycine (NH$_{2}$CH$_{2}$COOH), in the interstellar medium (ISM), has become a never-ending story for astrochemistry and astrophysics researchers because that molecule plays a possible connection between the Universe and the origin of life. In the last forty years, all searches for NH$_{2}$CH$_{2}$COOH in the ISM at millimeter and submillimeter wavelengths have failed. Since the detection of NH$_{2}$CH$_{2}$COOH in the ISM was extremely difficult, we aimed to search for the possible precursors of NH$_{2}$CH$_{2}$COOH. Earlier, many laboratory experiments have suggested that methylamine (CH$_{3}$NH$_{2}$) plays an important role in the ISM as a possible precursor of NH$_{2}$CH$_{2}$COOH. After spectral analysis using the local thermodynamic equilibrium (LTE) model, we identified the rotational emission lines of CH$_{3}$NH$_{2}$ towards the hot molecular core G358.93$-$0.03 MM1 using the Atacama Large Millimeter/Submillimeter Array (ALMA). The column density of CH$_{3}$NH$_{2}$ towards the G358.93$-$0.03 MM1 was estimated to be (1.10$\pm$0.31)$\times$10$^{17}$ cm$^{-2}$ with an excitation temperature of 180.8$\pm$25.5 K. The fractional abundance of CH$_{3}$NH$_{2}$ with respect to H$_{2}$ towards the G358.93$-$0.03 MM1 was (8.80$\pm$2.60)$\times$10$^{-8}$. The column density ratio of CH$_{3}$NH$_{2}$ and NH$_{2}$CN towards G358.93$-$0.03 MM1 was (1.86$\pm$0.95)$\times$10$^{2}$. The estimated fractional abundance of CH$_{3}$NH$_{2}$ towards the G358.93$-$0.03 MM1 agrees fairly well with the previous three-phase warm-up chemical modelling abundance of CH$_{3}$NH$_{2}$. We also discussed the possible formation mechanism of CH$_{3}$NH$_{2}$, and we find that CH$_{3}$NH$_{2}$ is most probably formed via the reactions of radical CH$_{3}$ and radical NH$_{2}$ on the grain surface of G358.93$-$0.03 MM1.


title: Finite element schemes with tangential motion for fourth order geometric curve evolutions in arbitrary codimension

abstract: We introduce novel finite element schemes for curve diffusion and elastic flow in arbitrary codimension. The schemes are based on a variational form of a system that includes a specifically chosen tangential motion. We derive optimal $L^2$- and $H^1$-error bounds for continuous-in-time semidiscrete finite element approximations that use piecewise linear elements. In addition, we consider fully discrete schemes and, in the case of curve diffusion, prove unconditional stability for it. Finally, we present several numerical simulations, including some convergence experiments that confirm the derived error bounds. The presented simulations suggest that the tangential motion leads to equidistribution in practice.


title: Observed kinematics of the Milky Way nuclear stellar disk region

abstract: The nuclear region of the Milky Way is believed to host a nuclear stellar disk, co-spatial with the gaseous central molecular zone. Previous kinematical studies detected faster rotation for the stars belonging to the nuclear stellar disk, compared to the surrounding regions. We analyze the rotation velocity of stars at the nuclear stellar disk, and compare them with its analog in a few control fields just outside this region. We limit our analysis to stars in the red clump of the color magnitude diagram, in order to be able to relate their mean de-reddened luminosity with distance along the line of sight. We used a proper motion catalog, obtained from point spread function photometry on VVV images, to construct maps of the transverse velocity for these stars. We complemented our analysis with radial velocities from the 17th data release of the APOGEE survey. We find that the main difference between the nuclear stellar disk region and its surroundings is that at the former we see only stars moving eastward, which we believe are located in front of the Galactic center. On the contrary, in every other direction, we see the brightest red clump stars moving eastward, and the faintest ones moving westward, as expected for a rotating disk. We interpret these observations as being produced by the central molecular zone, hiding stars behind itself. What we observe is compatible with being produced by just the absence of the component at the back, without requiring the presence of a cold, fast rotating disk. This component is also not clearly detected in the newest release of the APOGEE catalog. In other words, we find no clear signature of the nuclear stellar disk as a distinct kinematical component.


title: Craftax: A Lightning-Fast Benchmark for Open-Ended Reinforcement Learning

abstract: Benchmarks play a crucial role in the development and analysis of reinforcement learning (RL) algorithms. We identify that existing benchmarks used for research into open-ended learning fall into one of two categories. Either they are too slow for meaningful research to be performed without enormous computational resources, like Crafter, NetHack and Minecraft, or they are not complex enough to pose a significant challenge, like Minigrid and Procgen. To remedy this, we first present Craftax-Classic: a ground-up rewrite of Crafter in JAX that runs up to 250x faster than the Python-native original. A run of PPO using 1 billion environment interactions finishes in under an hour using only a single GPU and averages 90% of the optimal reward. To provide a more compelling challenge we present the main Craftax benchmark, a significant extension of the Crafter mechanics with elements inspired from NetHack. Solving Craftax requires deep exploration, long term planning and memory, as well as continual adaptation to novel situations as more of the world is discovered. We show that existing methods including global and episodic exploration, as well as unsupervised environment design fail to make material progress on the benchmark. We believe that Craftax can for the first time allow researchers to experiment in a complex, open-ended environment with limited computational resources.


title: Spectral characterization of young LT dwarfs

abstract: We aim to provide a detailed characterization of near-infrared spectra for young LT brown dwarfs, including robust spectral typing, calibrating spectral indices, identifying possible binaries, and selecting suitable spectral standards. We processed and analyzed archival spectra from VLT/X-shooter for a sample of 56 dwarfs with ages between 10 and 600 Myr and spectral types between late-M and mid-T. We re-determine spectral types by comparing them with a set of literature templates and assess a large range of spectral indices, calibrated using a specifically designed literature sample. We are able to identify 15 spectral indices that are useful for spectral typing for specific spectral ranges discussed here and provide the scaling relations with spectral types. Moreover, we also identify 6 spectral indices which can be used to separate young L dwarfs from the field ones. The equivalent-widths of the alkali lines show a correlation with age, increasing towards the objects with higher surface gravity. From our sample, we confirm 3 that are likely to be binaries by their anomalous spectra that appear to be better fitted by a combination of spectral types. Finally, we identify 12 objects as preliminary near-infrared spectral standards for young LT dwarfs. This paper presents a significant step toward understanding the spectral sequence and properties of young L and T dwarfs. The relations and standards provided here will be useful for future spectroscopic work on young brown dwarfs and giant planets.


title: A stochastic perturbation approach to nonlinear bifurcating problems

abstract: Incorporating probabilistic terms in mathematical models is crucial for capturing and quantifying uncertainties in real-world systems. Indeed, randomness can have a significant impact on the behavior of the problem's solution, and a deeper analysis is needed to obtain more realistic and informative results. On the other hand, the investigation of stochastic models may require great computational resources due to the importance of generating numerous realizations of the system to have meaningful statistics. This makes the development of complexity reduction techniques, such as surrogate models, essential for enabling efficient and scalable simulations. In this work, we exploit polynomial chaos (PC) expansion to study the accuracy of surrogate representations for a bifurcating phenomena in fluid dynamics, namely the Coanda effect, where the stochastic setting gives a different perspective on the non-uniqueness of the solution. Then, its inclusion in the finite element setting is described, arriving to the formulation of the enhanced Spectral Stochastic Finite Element Method (SSFEM). Moreover, we investigate the connections between the deterministic bifurcation diagram and the PC polynomials, underlying their capability in reconstructing the whole solution manifold.


title: Construction of Hodge structures on the $\mathrm{SO}(3)$ modular functors

abstract: We prove that $\mathrm{SO}(3)$ modular functors in genus $0$ have geometric origin and support integral variations of Hodge structures for any odd level $r$ and $r$-th root of unity $\zeta_r\in\mathbb{C}$. We identify the TQFT intersection forms and integral structures with the geometric ones. Moreover, the gluing property of the modular functors is recovered geometrically as a K\"unneth formula. The construction is based on the homological models of Felder-Wieczerkowski and Martel.


title: A parabolic free transmission problem: flat free boundaries are smooth

abstract: We study a two-phase parabolic free boundary problem motivated by the jump of conductivity in composite materials that undergo a phase transition. Each phase is governed by a heat equation with distinct thermal conductivity, and a transmission-type condition is imposed on the free interface. We establish strong regularity properties of the free boundary: first, we prove that flat free boundaries are $C^{1,\alpha}$ by means of a linearization technique and compactness arguments. Then we use the Hodograph transform to achieve higher regularity. To this end, we prove a new Harnack-type inequality and develop the Schauder theory for parabolic linear transmission problems.


title: Multi-Human Mesh Recovery with Transformers

abstract: Conventional approaches to human mesh recovery predominantly employ a region-based strategy. This involves initially cropping out a human-centered region as a preprocessing step, with subsequent modeling focused on this zoomed-in image. While effective for single figures, this pipeline poses challenges when dealing with images featuring multiple individuals, as different people are processed separately, often leading to inaccuracies in relative positioning. Despite the advantages of adopting a whole-image-based approach to address this limitation, early efforts in this direction have fallen short in performance compared to recent region-based methods. In this work, we advocate for this under-explored area of modeling all people at once, emphasizing its potential for improved accuracy in multi-person scenarios through considering all individuals simultaneously and leveraging the overall context and interactions. We introduce a new model with a streamlined transformer-based design, featuring three critical design choices: multi-scale feature incorporation, focused attention mechanisms, and relative joint supervision. Our proposed model demonstrates a significant performance improvement, surpassing state-of-the-art region-based and whole-image-based methods on various benchmarks involving multiple individuals.


title: An $^{115}$In$^+$-$^{172}$Yb$^+$ Coulomb crystal clock with $2.5\times10^{-18}$ systematic uncertainty

abstract: We present a scalable mixed-species Coulomb crystal clock based on the $^1S_0$ $\leftrightarrow$ $^3P_0$ transition in $^{115}$In$^+$. $^{172}$Yb$^+$ ions are co-trapped and used for sympathetic cooling. Reproducible interrogation conditions for mixed-species Coulomb crystals are ensured by a conditional preparation sequence with permutation control. We demonstrate clock operation with a 1In$^+$-3Yb$^+$ crystal, achieving a relative systematic uncertainty of $2.5\times10^{-18}$ and a relative frequency instability of $1.6\times10^{-15}/\sqrt{\tau/1\;s}$. We report on an absolute frequency measurement with an uncertainty of $1.3\times10^{-16}$ and optical frequency ratios relative to the $^{171}$Yb$^+$ (E3) and $^{87}$Sr clock transitions with fractional uncertainties of $4.4$ and $4.7$ parts in 10$^{18}$, respectively. The latter are among the most precise measurements of frequency ratios to date and improve upon the previous uncertainty of the $^{115}$In$^+$/$^{87}$Sr ratio by two orders of magnitude. We also demonstrate operation with four $^{115}$In$^+$ clock ions, which reduces the instability to $9.2\times10^{-16}/\sqrt{\tau/1\;s}$.


title: On tori periods of Weil representations of unitary groups

abstract: We determine the restriction of Weil representations of unitary groups to maximal tori. In the local case, we show that the Weil representation contains a pair of compatible characters if and only if a root number condition holds. In the global case, we show that a tori period corresponding to a maximal anisotropic torus of the global theta lift of a character does not vanish if and only if the local condition is satisfied everywhere and a central value of an $L$-function does not vanish. Our proof makes use of the seesaw argument and of the well-known theta lifting results from $\operatorname{U}\left(1\right)$ to $\operatorname{U}\left(1\right)$. Our results are used in other papers to construct Arthur packets for $G_2$.


title: Motion dynamics of two-dimensional fundamental and vortex solitons in the fractional medium with the cubic-quintic nonlinearity

abstract: We report results of systematic investigation of dynamics featured by moving two-dimensional (2D) solitons generated by the fractional nonlinear Schroedinger equation (FNLSE) with the cubic-quintic nonlinearity. The motion of solitons is a nontrivial problem, as the fractional diffraction breaks the Galilean invariance of the underlying equation. The addition of the defocusing quintic term to the focusing cubic one is necessary to stabilize the solitons against the collapse. The setting presented here can be implemented in nonlinear optical waveguides emulating the fractional diffraction. Systematic consideration identifies parameters of moving fundamental and vortex solitons (with vorticities 0 and 1 or 2, respectively) and maximum velocities up to which stable solitons persist, for characteristic values of the Levy index which determines the fractionality of the underlying model. Outcomes of collisions between 2D solitons moving in opposite directions are identified too. These are merger of the solitons, quasi-elastic or destructive collisions, and breakup of the two colliding solitons into a quartet of secondary ones.


title: OncoGPT: A Medical Conversational Model Tailored with Oncology Domain Expertise on a Large Language Model Meta-AI (LLaMA)

abstract: In the past year, there has been a growing trend in applying Large Language Models (LLMs) to the field of medicine, particularly with the advent of advanced language models such as ChatGPT developed by OpenAI. However, there is limited research on LLMs specifically addressing oncology-related queries. The primary aim of this research was to develop a specialized language model that demonstrates improved accuracy in providing advice related to oncology. We performed an extensive data collection of online question-answer interactions centered around oncology, sourced from reputable doctor-patient platforms. Following data cleaning and anonymization, a dataset comprising over 180K+ oncology-related conversations was established. The conversations were categorized and meticulously reviewed by field specialists and clinicians to ensure precision. Employing the LLaMA model and other selected open-source datasets, we conducted iterative fine-tuning to enhance the model's proficiency in basic medical conversation and specialized oncology knowledge. We observed a substantial enhancement in the model's understanding of genuine patient inquiries and its reliability in offering oncology-related advice through the utilization of real online question-answer interactions in the fine-tuning process. We release database and models to the research community (https://github.com/OncoGPT1).


title: Stopping Bayesian Optimization with Probabilistic Regret Bounds

abstract: Bayesian optimization is a popular framework for efficiently finding high-quality solutions to difficult problems based on limited prior information. As a rule, these algorithms operate by iteratively choosing what to try next until some predefined budget has been exhausted. We investigate replacing this de facto stopping rule with an $(\epsilon, \delta)$-criterion: stop when a solution has been found whose value is within $\epsilon > 0$ of the optimum with probability at least $1 - \delta$ under the model. Given access to the prior distribution of problems, we show how to verify this condition in practice using a limited number of draws from the posterior. For Gaussian process priors, we prove that Bayesian optimization with the proposed criterion stops in finite time and returns a point that satisfies the $(\epsilon, \delta)$-criterion under mild assumptions. These findings are accompanied by extensive empirical results which demonstrate the strengths and weaknesses of this approach.


title: Asymptotically non-negative Ricci curvature, elliptic Kato constant and isoperimetric inequalities

abstract: The ABP method for proving isoperimetric inequalities has been first employed by Cabr\'e in $\mathbb{R}^n$, then developed by Brendle, notably in the context of non-compact Riemannian manifolds of non-negative Ricci curvature and positive asymptotic volume ratio. In this paper, we expand upon their approach and prove isoperimetric inequalities (sharp in the limit) in the presence of a small amount of negative curvature. First, we consider smallness of the negative part $\mathrm{Ric}_-$ of the Ricci curvature in terms of its elliptic Kato constant. Indeed, the Kato constant turns out to control the non-negativity of the ($\infty$-)Bakry-\'Emery Ricci-tensor of a suitable conformal deformation of the manifold, and the ABP method can be implemented in this setting. Secondly, we show that the smallness of the Kato constant is implied by a suitable polynomial decay of $\mathrm{Ric}_-$, provided that the asymptotic volume ratio is positive and either (a) $M$ has one end and asymptotically non-negative sectional curvature or (b) the relative volume comparison known as $\textbf{(VC)}$ condition holds. To show this latter fact, we enhance techniques elaborated by Li-Tam and Kasue to obtain new estimates of the Green function valid on the whole manifold.


title: On $e^*$-topological Rings

abstract: The main purpose of this paper is to introduce the concept of $e^*$-topological ring. This class appears as a generalized form of the class of $\beta$-topological rings. In addition, we have discussed the relation between the concept of $e^*$-topological ring and some other types of topological rings existing in the literature. Also, some fundamental results about $e^*$-topological rings are revealed. Furthermore, we give some counterexamples related to our results.


title: Box Facets and Cut Facets of Lifted Multicut Polytopes

abstract: The lifted multicut problem is a combinatorial optimization problem whose feasible solutions relate one-to-one to the decompositions of a graph $G = (V, E)$. Given an augmentation $\widehat{G} = (V, E \cup F)$ of $G$ and given costs $c \in \mathbb{R}^{E \cup F}$, the objective is to minimize the sum of those $c_{uw}$ with $uw \in E \cup F$ for which $u$ and $w$ are in distinct components. For $F = \emptyset$, the problem specializes to the multicut problem, and for $E = \tbinom{V}{2}$ to the clique partitioning problem. We study a binary linear program formulation of the lifted multicut problem. More specifically, we contribute to the analysis of the associated lifted multicut polytopes: Firstly, we establish a necessary, sufficient and efficiently decidable condition for a lower box inequality to define a facet. Secondly, we show that deciding whether a cut inequality of the binary linear program defines a facet is NP-hard.


title: 2+2D Texture for Full Positive Parallax Effect

abstract: The representation of parallax on virtual environment is still a problem to be studied. Common algorithms, such as Bump Mapping, Parallax Mapping and Displacement Mapping, treats this problem for small disparity between a real object and a simplified model. This work will introduce a new texture structure and one possible render algorithm able to display parallax for large disparities, it is an approach based on the four-dimensional representation of the Light Field and was thought to positive parallax and to display the surfaces on the inside of our simplified model. These conditions are imposed to allow the free movement of an observer, if its movement is restrict, these conditions may be loosen. It is a high storage low process approach possible to be used in real time systems. As an example we will develop a scene with several objects and simplified them by a unique sphere that encloses them all, our system was able to run this scene with about 180fps.


title: Multicolor, multipartite Ramsey numbers for quadrilateral

abstract: The $p$-partite Ramsey number for quadrilateral, denoted by $r_p(C_4,k)$, is the least positive integer $n$ such that any coloring of the edges of a complete $p$-partite graph with $n$ vertices in each partition with $k$ colors will result in a monochromatic copy of $C_4$. In this paper, we present an upper bound for $r_p(C_4,k)$ and the exact values of $r_p(C_4,2)$ for all $p\geq2$. In tripartite case we show that $r_3(C_4,k) \leq \lfloor (k+1)^2/2\rfloor-1$ and the exact value of 4-color tripartite Ramsey number $r_3(C_4,4)=11$.


title: Investigating the Effectiveness of HyperTuning via Gisting

abstract: Gisting (Mu et al., 2023) is a simple method for training models to compress information into fewer token representations using a modified attention mask, and can serve as an economical approach to training Transformer-based hypernetworks. We introduce HyperLlama, a set of Gisting-based hypernetworks built on Llama-2 models that generates task-specific soft prefixes based on few-shot inputs. In experiments across P3, Super-NaturalInstructions and Symbol Tuning datasets, we show that HyperLlama models can effectively compress information from few-shot examples into soft prefixes. However, they still underperform multi-task fine-tuned language models with full attention over few-shot in-context examples. We also show that HyperLlama-generated soft prefixes can serve as better initializations for further prefix tuning. Overall, Gisting-based hypernetworks are economical and easy to implement, but have mixed empirical performance.


title: On the maximum number of $r$-cliques in graphs free of complete $r$-partite subgraphs

abstract: We estimate the maximum possible number of cliques of size $r$ in an $n$-vertex graph free of a fixed complete $r$-partite graph $K_{s_1, s_2, \ldots, s_r}$. By viewing every $r$-clique as a hyperedge, the upper bound on the Tur\'an number of the complete $r$-partite hypergraphs gives the upper bound $O\left(n^{r - {1}/{\prod_{i=1}^{r-1}s_i}}\right)$. We improve this to $o\left(n^{r - {1}/{\prod_{i=1}^{r-1}s_i}}\right)$. The main tool in our proof is the graph removal lemma. We also provide several lower bound constructions.


title: Nemotron-4 15B Technical Report

abstract: We introduce Nemotron-4 15B, a 15-billion-parameter large multilingual language model trained on 8 trillion text tokens. Nemotron-4 15B demonstrates strong performance when assessed on English, multilingual, and coding tasks: it outperforms all existing similarly-sized open models on 4 out of 7 downstream evaluation areas and achieves competitive performance to the leading open models in the remaining ones. Specifically, Nemotron-4 15B exhibits the best multilingual capabilities of all similarly-sized models, even outperforming models over four times larger and those explicitly specialized for multilingual tasks.


title: Entropy solutions in $BV^s$ for a class of triangular systems involving a transport equation

abstract: In this article, we consider a class of strictly hyperbolic triangular systems involving a transport equation. Such systems are known to create measure solutions for the initial value problem. Adding a stronger transversality assumption on the fields, we are able to obtain solutions in $L^\infty$ under optimal fractional $BV$ regularity of the initial data. Our results show that the critical fractional regularity is $s=1/3$. We also construct an initial data that is not in $BV^{1/3}$ but for which a blow-up in $L^\infty$ occurs, proving the optimality of our results.


title: Numerical Analysis on Neural Network Projected Schemes for Approximating One Dimensional Wasserstein Gradient Flows

abstract: We provide a numerical analysis and computation of neural network projected schemes for approximating one dimensional Wasserstein gradient flows. We approximate the Lagrangian mapping functions of gradient flows by the class of two-layer neural network functions with ReLU (rectified linear unit) activation functions. The numerical scheme is based on a projected gradient method, namely the Wasserstein natural gradient, where the projection is constructed from the $L^2$ mapping spaces onto the neural network parameterized mapping space. We establish theoretical guarantees for the performance of the neural projected dynamics. We derive a closed-form update for the scheme with well-posedness and explicit consistency guarantee for a particular choice of network structure. General truncation error analysis is also established on the basis of the projective nature of the dynamics. Numerical examples, including gradient drift Fokker-Planck equations, porous medium equations, and Keller-Segel models, verify the accuracy and effectiveness of the proposed neural projected algorithm.


title: Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Prompts

abstract: As large language models (LLMs) become increasingly prevalent across many real-world applications, understanding and enhancing their robustness to user inputs is of paramount importance. Existing methods for identifying adversarial prompts tend to focus on specific domains, lack diversity, or require extensive human annotations. To address these limitations, we present Rainbow Teaming, a novel approach for producing a diverse collection of adversarial prompts. Rainbow Teaming casts adversarial prompt generation as a quality-diversity problem, and uses open-ended search to generate prompts that are both effective and diverse. It can uncover a model's vulnerabilities across a broad range of domains including, in this paper, safety, question answering, and cybersecurity. We also demonstrate that fine-tuning on synthetic data generated by Rainbow Teaming improves the safety of state-of-the-art LLMs without hurting their general capabilities and helpfulness, paving the path to open-ended self-improvement.


title: Language Agents as Optimizable Graphs

abstract: Various human-designed prompt engineering techniques have been proposed to improve problem solvers based on Large Language Models (LLMs), yielding many disparate code bases. We unify these approaches by describing LLM-based agents as computational graphs. The nodes implement functions to process multimodal data or query LLMs, and the edges describe the information flow between operations. Graphs can be recursively combined into larger composite graphs representing hierarchies of inter-agent collaboration (where edges connect operations of different agents). Our novel automatic graph optimizers (1) refine node-level LLM prompts (node optimization) and (2) improve agent orchestration by changing graph connectivity (edge optimization). Experiments demonstrate that our framework can be used to efficiently develop, integrate, and automatically improve various LLM agents. The code can be found at https://github.com/metauto-ai/gptswarm.


title: Quantum correlations in the steady state of light-emitter ensembles from perturbation theory

abstract: The coupling of a quantum system to an environment leads generally to decoherence, and it is detrimental to quantum correlations within the system itself. Yet some forms of quantum correlations can be robust to the presence of an environment - or may even be stabilized by it. Predicting (let alone understanding) them remains arduous, given that the steady state of an open quantum system can be very different from an equilibrium thermodynamic state; and its reconstruction requires generically the numerical solution of the Lindblad equation, which is extremely costly for numerics. Here we focus on the highly relevant situation of ensembles of light emitters undergoing spontaneous decay; and we show that, whenever their Hamiltonian is perturbed away from a U(1) symmetric form, steady-state quantum correlations can be reconstructed via pure-state perturbation theory. Our main result is that in systems of light emitters subject to single-emitter or two-emitter driving, the steady state perturbed away from the U(1) limit generically exhibits spin squeezing; and it has minimal uncertainty for the collective-spin components, revealing that squeezing represents the optimal resource for entanglement-assisted metrology using this state.


title: Weighted Monte Carlo augmented spherical Fourier-Bessel convolutional layers for 3D abdominal organ segmentation

abstract: Filter-decomposition-based group equivariant convolutional neural networks show promising stability and data efficiency for 3D image feature extraction. However, the existing filter-decomposition-based 3D group equivariant neural networks rely on parameter-sharing designs and are mostly limited to rotation transformation groups, where the chosen spherical harmonic filter bases consider only angular orthogonality. These limitations hamper its application to deep neural network architectures for medical image segmentation. To address these issues, this paper describes a non-parameter-sharing affine group equivariant neural network for 3D medical image segmentation based on an adaptive aggregation of Monte Carlo augmented spherical Fourier Bessel filter bases. The efficiency and flexibility of the adopted non-parameter-sharing strategy enable for the first time an efficient implementation of 3D affine group equivariant convolutional neural networks for volumetric data. The introduced spherical Bessel Fourier filter basis combines both angular and radial orthogonality for better feature extraction. The 3D image segmentation experiments on two abdominal medical image sets, BTCV and the NIH Pancreas datasets, show that the proposed methods excel the state-of-the-art 3D neural networks with high training stability and data efficiency. The code will be available at https://github.com/ZhaoWenzhao/WMCSFB.


title: Belyi maps from zeroes of hypergeometric polynomials

abstract: Evaluation of low degree hypergeometric polynomials to zero defines an algebraic hypersurface in the affine space of the free parameters and the argument. This article investigates the algebraic surfaces 2F1(-N,b;c;z)=0 for N=3 and N=4. As a captivating application, these surfaces parametrize certain families of genus 0 Belyi maps.


title: A Survey on Data Selection for Language Models

abstract: A major factor in the recent success of large language models is the use of enormous and ever-growing text datasets for unsupervised pre-training. However, naively training a model on all available data may not be optimal (or feasible), as the quality of available text data can vary. Filtering out data can also decrease the carbon footprint and financial costs of training models by reducing the amount of training required. Data selection methods aim to determine which candidate data points to include in the training dataset and how to appropriately sample from the selected data points. The promise of improved data selection methods has caused the volume of research in the area to rapidly expand. However, because deep learning is mostly driven by empirical evidence and experimentation on large-scale data is expensive, few organizations have the resources for extensive data selection research. Consequently, knowledge of effective data selection practices has become concentrated within a few organizations, many of which do not openly share their findings and methodologies. To narrow this gap in knowledge, we present a comprehensive review of existing literature on data selection methods and related research areas, providing a taxonomy of existing approaches. By describing the current landscape of research, this work aims to accelerate progress in data selection by establishing an entry point for new and established researchers. Additionally, throughout this review we draw attention to noticeable holes in the literature and conclude the paper by proposing promising avenues for future research.


title: Training Neural Networks from Scratch with Parallel Low-Rank Adapters

abstract: The scalability of deep learning models is fundamentally limited by computing resources, memory, and communication. Although methods like low-rank adaptation (LoRA) have reduced the cost of model finetuning, its application in model pre-training remains largely unexplored. This paper explores extending LoRA to model pre-training, identifying the inherent constraints and limitations of standard LoRA in this context. We introduce LoRA-the-Explorer (LTE), a novel bi-level optimization algorithm designed to enable parallel training of multiple low-rank heads across computing nodes, thereby reducing the need for frequent synchronization. Our approach includes extensive experimentation on vision transformers using various vision datasets, demonstrating that LTE is competitive with standard pre-training.


title: GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning

abstract: Embedding models are integral to AI applications like semantic search, personalized recommendations, and retrieval augmented generation for LLMs, necessitating high-quality training data. However, the limited scalability of manual data curation prompts the need for automated methods to ensure data integrity. Traditional unsupervised triplet mining automates training data generation, crucial for embedding model training, yet inadvertently injects biases and noise, thereby degrading model performance. Addressing this, we introduce GISTEmbed, a novel strategy that enhances in-batch negative selection during contrastive training through a guide model. This approach departs from reliance on random sampling and equal utility assumption of batch negatives, significantly reducing noise from data quality issues and improving model fine-tuning. Benchmarked against the Massive Text Embedding Benchmark (MTEB), GISTEmbed showcases consistent performance improvements across various model sizes and achieves state-of-the-art results in select categories. This framework enables significant enhancements for smaller models by leveraging the capabilities of powerful yet resource-intensive large models. GISTEmbed can potentially revolutionize the creation of highly efficient, smaller models, democratizing access to advanced AI technologies. Making these technologies more accessible and cost-effective, especially for applications constrained by resources, significantly expands the impact and accessibility of state-of-the-art AI solutions across diverse sectors.


title: SKILL: Similarity-aware Knowledge distILLation for Speech Self-Supervised Learning

abstract: Self-supervised learning (SSL) has achieved remarkable success across various speech-processing tasks. To enhance its efficiency, previous works often leverage the use of compression techniques. A notable recent attempt is DPHuBERT, which applies joint knowledge distillation (KD) and structured pruning to learn a significantly smaller SSL model. In this paper, we contribute to this research domain by introducing SKILL, a novel method that conducts distillation across groups of layers instead of distilling individual arbitrarily selected layers within the teacher network. The identification of the layers to distill is achieved through a hierarchical clustering procedure applied to layer similarity measures. Extensive experiments demonstrate that our distilled version of WavLM Base+ not only outperforms DPHuBERT but also achieves state-of-the-art results in the 30M parameters model class across several SUPERB tasks.


title: The Physics of (good) LDPC Codes II. Product constructions

abstract: We continue the study of classical and quantum low-density parity check (LDPC) codes from a physical perspective. We focus on constructive approaches and formulate a general framework for systematically constructing codes with various features on generic Euclidean and non-Euclidean graphs. These codes can serve as fixed-point limits for phases of matter. To build our machinery, we unpack various product constructions from the coding literature in terms of physical principles such as symmetries and redundancies, introduce a new cubic product, and combine these products with the ideas of gauging and Higgsing introduced in Part I. We illustrate the usefulness of this approach in finite Euclidean dimensions by showing that using the one-dimensional Ising model as a starting point, we can systematically produce a very large zoo of classical and quantum phases of matter, including type I and type II fractons and SPT phases with generalized symmetries. We also use the balanced product to construct new Euclidean models, including one with topological order enriched by translation symmetry, and another exotic fracton model whose excitations are formed by combining those of a fractal spin liquid with those of a toric code, resulting in exotic mobility constraints. Moving beyond Euclidean models, we give a review of existing constructions of good qLDPC codes and classical locally testable codes and elaborate on the relationship between quantum code distance and classical energy barriers, discussed in Part I, from the perspective of product constructions.


title: Mysterious Projections: Multimodal LLMs Gain Domain-Specific Visual Capabilities Without Richer Cross-Modal Projections

abstract: Multimodal large language models (MLLMs) like LLaVA and GPT-4(V) enable general-purpose conversations about images with the language modality. As off-the-shelf MLLMs may have limited capabilities on images from domains like dermatology and agriculture, they must be fine-tuned to unlock domain-specific applications. The prevalent architecture of current open-source MLLMs comprises two major modules: an image-language (cross-modal) projection network and a large language model. It is desirable to understand the roles of these two modules in modeling domain-specific visual attributes to inform the design of future models and streamline the interpretability efforts on the current models. To this end, via experiments on 4 datasets and under 2 fine-tuning settings, we find that as the MLLM is fine-tuned, it indeed gains domain-specific visual capabilities, but the updates do not lead to the projection extracting relevant domain-specific visual attributes. Our results indicate that the domain-specific visual attributes are modeled by the LLM, even when only the projection is fine-tuned. Through this study, we offer a potential reinterpretation of the role of cross-modal projections in MLLM architectures. Projection webpage: https://claws-lab.github.io/projection-in-MLLMs/


title: Discrete subgroups of semisimple Lie groups, beyond lattices

abstract: Discrete subgroups of SL(2,R) are well understood, and classified by the geometry of the corresponding hyperbolic surfaces. Discrete subgroups of higher-rank semisimple Lie groups, such as SL(n,R) for n>2, remain more mysterious. While lattices in this setting are rigid, there also exist more flexible, "thinner" discrete subgroups, which may have large and interesting deformation spaces, giving rise in particular to so-called higher Teichm\"uller theory. We survey recent progress in constructing and understanding such discrete subgroups from a geometric and dynamical viewpoint.


title: Convergence to stationary measures for the half-space log-gamma polymer

abstract: We consider the point-to-point half-space log-gamma polymer model in the unbound phase. We prove that the free energy increment process on the anti-diagonal path converges to the top marginal of a two-layer Markov chain with an explicit description, which can be interpreted as two random walks conditioned softly never to intersect. This limiting law is a stationary measure for the polymer on the anti-diagonal path. The starting point of our analysis is an embedding of the free energy into the half-space log-gamma line ensemble recently constructed by Barraquand, Corwin, and Das. Given the Gibbsian line ensemble structure, the main contribution of our work lies in developing a route to access and prove convergence to stationary measures via line ensemble techniques. Our argument relies on a description of the limiting behavior of two softly non-intersecting random walk bridges around their starting point, a result established in this paper that may be of independent interest.


title: Eight Methods to Evaluate Robust Unlearning in LLMs

abstract: Machine unlearning can be useful for removing harmful capabilities and memorized text from large language models (LLMs), but there are not yet standardized methods for rigorously evaluating it. In this paper, we first survey techniques and limitations of existing unlearning evaluations. Second, we apply a comprehensive set of tests for the robustness and competitiveness of unlearning in the "Who's Harry Potter" (WHP) model from Eldan and Russinovich (2023). While WHP's unlearning generalizes well when evaluated with the "Familiarity" metric from Eldan and Russinovich, we find i) higher-than-baseline amounts of knowledge can reliably be extracted, ii) WHP performs on par with the original model on Harry Potter Q&A tasks, iii) it represents latent knowledge comparably to the original model, and iv) there is collateral unlearning in related domains. Overall, our results highlight the importance of comprehensive unlearning evaluation that avoids ad-hoc metrics.


title: PhyGrasp: Generalizing Robotic Grasping with Physics-informed Large Multimodal Models

abstract: Robotic grasping is a fundamental aspect of robot functionality, defining how robots interact with objects. Despite substantial progress, its generalizability to counter-intuitive or long-tailed scenarios, such as objects with uncommon materials or shapes, remains a challenge. In contrast, humans can easily apply their intuitive physics to grasp skillfully and change grasps efficiently, even for objects they have never seen before. This work delves into infusing such physical commonsense reasoning into robotic manipulation. We introduce PhyGrasp, a multimodal large model that leverages inputs from two modalities: natural language and 3D point clouds, seamlessly integrated through a bridge module. The language modality exhibits robust reasoning capabilities concerning the impacts of diverse physical properties on grasping, while the 3D modality comprehends object shapes and parts. With these two capabilities, PhyGrasp is able to accurately assess the physical properties of object parts and determine optimal grasping poses. Additionally, the model's language comprehension enables human instruction interpretation, generating grasping poses that align with human preferences. To train PhyGrasp, we construct a dataset PhyPartNet with 195K object instances with varying physical properties and human preferences, alongside their corresponding language descriptions. Extensive experiments conducted in the simulation and on the real robots demonstrate that PhyGrasp achieves state-of-the-art performance, particularly in long-tailed cases, e.g., about 10% improvement in success rate over GraspNet. Project page: https://sites.google.com/view/phygrasp


title: Do Large Language Models Latently Perform Multi-Hop Reasoning?

abstract: We study whether Large Language Models (LLMs) latently perform multi-hop reasoning with complex prompts such as "The mother of the singer of 'Superstition' is". We look for evidence of a latent reasoning pathway where an LLM (1) latently identifies "the singer of 'Superstition'" as Stevie Wonder, the bridge entity, and (2) uses its knowledge of Stevie Wonder's mother to complete the prompt. We analyze these two hops individually and consider their co-occurrence as indicative of latent multi-hop reasoning. For the first hop, we test if changing the prompt to indirectly mention the bridge entity instead of any other entity increases the LLM's internal recall of the bridge entity. For the second hop, we test if increasing this recall causes the LLM to better utilize what it knows about the bridge entity. We find strong evidence of latent multi-hop reasoning for the prompts of certain relation types, with the reasoning pathway used in more than 80% of the prompts. However, the utilization is highly contextual, varying across different types of prompts. Also, on average, the evidence for the second hop and the full multi-hop traversal is rather moderate and only substantial for the first hop. Moreover, we find a clear scaling trend with increasing model size for the first hop of reasoning but not for the second hop. Our experimental findings suggest potential challenges and opportunities for future development and applications of LLMs.


title: On recurrence for $\mathbb{Z}^d$-nilsystems

abstract: We study the topological recurrence phenomenon of actions of locally compact abelian groups on compact metric spaces. We address the popular Katznelson's question in this context and extend recurrence lifting results, known for $\mathbb{Z}$-actions, to this more general context. In the case $H=\mathbb{Z}^d$, we develop new techniques to analyze Bohr recurrence sets, and show that Bohr recurrence implies recurrence for a $\mathbb{Z}^d$-nilsystem $(G/\Gamma,\mathbb{Z}^d)$, under the assumption that the connected component of the identity in $G$ is abelian. This family encompasses, for example, all $\mathbb{Z}^d$-affine nilsystems.


title: Displacing Science

abstract: Recent research on the decline in the paper disruption index (D-index) has sparked heated debates among scholars and garnered significant attention from policymakers and research institution leaders globally. To bridge the gap between policymakers' interest and scholars' skepticism about the D-index, we present this article summarizing key insights from our eight-year investigation, including interviews with scientists across nine disciplines and an analysis of 41 million papers over six decades. Our work confirms the decline in disruptive papers, addresses relevant technical concerns, and makes several original contributions: we clarify that the D-index measures how new ideas render old ones obsolete, suggesting 'Displacing' as an alternative interpretation for 'D'; we show that federal funding agencies like the NIH and NSF are less likely to support disruptive research; and we introduce the 'principle of functional equivalence' to explain the origins of recombining and displacing mechanisms in science, stressing that not all innovation problems are combinatorial, and challenging the belief that AI is the mature solution to scientific innovation. This article aims to promote broader and more accurate use of the D-index in research evaluation and to inspire new funding mechanisms for scientific breakthroughs.


title: MobiLlama: Towards Accurate and Lightweight Fully Transparent GPT

abstract: "Bigger the better" has been the predominant trend in recent Large Language Models (LLMs) development. However, LLMs do not suit well for scenarios that require on-device processing, energy efficiency, low memory footprint, and response efficiency. These requisites are crucial for privacy, security, and sustainable deployment. This paper explores the "less is more" paradigm by addressing the challenge of designing accurate yet efficient Small Language Models (SLMs) for resource constrained devices. Our primary contribution is the introduction of an accurate and fully transparent open-source 0.5 billion (0.5B) parameter SLM, named MobiLlama, catering to the specific needs of resource-constrained computing with an emphasis on enhanced performance with reduced resource demands. MobiLlama is a SLM design that initiates from a larger model and applies a careful parameter sharing scheme to reduce both the pre-training and the deployment cost. Our work strives to not only bridge the gap in open-source SLMs but also ensures full transparency, where complete training data pipeline, training code, model weights, and over 300 checkpoints along with evaluation codes is available at : https://github.com/mbzuai-oryx/MobiLlama.


title: Unveiling Intrinsic Many-Body Complexity by Compressing Single-Body Triviality

abstract: The simultaneous treatment of static and dynamical correlations in strongly-correlated electron systems is a critical challenge. In particular, finding a universal scheme for identifying a single-particle orbital basis that minimizes the representational complexity of the many-body wavefunction is a formidable and longstanding problem. As a substantial contribution towards its solution, we show that the total orbital correlation actually reveals and quantifies the intrinsic complexity of the wavefunction,once it is minimized via orbital rotations. To demonstrate the power of this concept in practice, an iterative scheme is proposed to optimize the orbitals by minimizing the total orbital correlation calculated by the tailored coupled cluster singles and doubles (TCCSD) ansatz. The optimized orbitals enable the limited TCCSD ansatz to capture more non-trivial information of the many-body wavefunction, indicated by the improved wavefunction and energy. An initial application of this scheme shows great improvement of TCCSD in predicting the singlet ground state potential energy curves of the strongly correlated C$_{\rm 2}$ and Cr$_{\rm 2}$ molecule.


title: Asymmetry in Low-Rank Adapters of Foundation Models

abstract: Parameter-efficient fine-tuning optimizes large, pre-trained foundation models by updating a subset of parameters; in this class, Low-Rank Adaptation (LoRA) is particularly effective. Inspired by an effort to investigate the different roles of LoRA matrices during fine-tuning, this paper characterizes and leverages unexpected asymmetry in the importance of low-rank adapter matrices. Specifically, when updating the parameter matrices of a neural network by adding a product $BA$, we observe that the $B$ and $A$ matrices have distinct functions: $A$ extracts features from the input, while $B$ uses these features to create the desired output. Based on this observation, we demonstrate that fine-tuning $B$ is inherently more effective than fine-tuning $A$, and that a random untrained $A$ should perform nearly as well as a fine-tuned one. Using an information-theoretic lens, we also bound the generalization of low-rank adapters, showing that the parameter savings of exclusively training $B$ improves the bound. We support our conclusions with experiments on RoBERTa, BART-Large, LLaMA-2, and ViTs.


title: Multi-LoRA Composition for Image Generation

abstract: Low-Rank Adaptation (LoRA) is extensively utilized in text-to-image models for the accurate rendition of specific elements like distinct characters or unique styles in generated images. Nonetheless, existing methods face challenges in effectively composing multiple LoRAs, especially as the number of LoRAs to be integrated grows, thus hindering the creation of complex imagery. In this paper, we study multi-LoRA composition through a decoding-centric perspective. We present two training-free methods: LoRA Switch, which alternates between different LoRAs at each denoising step, and LoRA Composite, which simultaneously incorporates all LoRAs to guide more cohesive image synthesis. To evaluate the proposed approaches, we establish ComposLoRA, a new comprehensive testbed as part of this research. It features a diverse range of LoRA categories with 480 composition sets. Utilizing an evaluation framework based on GPT-4V, our findings demonstrate a clear improvement in performance with our methods over the prevalent baseline, particularly evident when increasing the number of LoRAs in a composition.


title: Think Big, Generate Quick: LLM-to-SLM for Fast Autoregressive Decoding

abstract: Large language models (LLMs) have become ubiquitous in practice and are widely used for generation tasks such as translation, summarization and instruction following. However, their enormous size and reliance on autoregressive decoding increase deployment costs and complicate their use in latency-critical applications. In this work, we propose a hybrid approach that combines language models of different sizes to increase the efficiency of autoregressive decoding while maintaining high performance. Our method utilizes a pretrained frozen LLM that encodes all prompt tokens once in parallel, and uses the resulting representations to condition and guide a small language model (SLM), which then generates the response more efficiently. We investigate the combination of encoder-decoder LLMs with both encoder-decoder and decoder-only SLMs from different model families and only require fine-tuning of the SLM. Experiments with various benchmarks show substantial speedups of up to $4\times$, with minor performance penalties of $1-2\%$ for translation and summarization tasks compared to the LLM.


title: Neural Operators with Localized Integral and Differential Kernels

abstract: Neural operators learn mappings between function spaces, which is practical for learning solution operators of PDEs and other scientific modeling applications. Among them, the Fourier neural operator (FNO) is a popular architecture that performs global convolutions in the Fourier space. However, such global operations are often prone to over-smoothing and may fail to capture local details. In contrast, convolutional neural networks (CNN) can capture local features but are limited to training and inference at a single resolution. In this work, we present a principled approach to operator learning that can capture local features under two frameworks by learning differential operators and integral operators with locally supported kernels. Specifically, inspired by stencil methods, we prove that we obtain differential operators under an appropriate scaling of the kernel values of CNNs. To obtain local integral operators, we utilize suitable basis representations for the kernels based on discrete-continuous convolutions. Both these approaches preserve the properties of operator learning and, hence, the ability to predict at any resolution. Adding our layers to FNOs significantly improves their performance, reducing the relative L2-error by 34-72% in our experiments, which include a turbulent 2D Navier-Stokes and the spherical shallow water equations.


title: GROUNDHOG: Grounding Large Language Models to Holistic Segmentation

abstract: Most multimodal large language models (MLLMs) learn language-to-object grounding through causal language modeling where grounded objects are captured by bounding boxes as sequences of location tokens. This paradigm lacks pixel-level representations that are important for fine-grained visual understanding and diagnosis. In this work, we introduce GROUNDHOG, an MLLM developed by grounding Large Language Models to holistic segmentation. GROUNDHOG incorporates a masked feature extractor and converts extracted features into visual entity tokens for the MLLM backbone, which then connects groundable phrases to unified grounding masks by retrieving and merging the entity masks. To train GROUNDHOG, we carefully curated M3G2, a grounded visual instruction tuning dataset with Multi-Modal Multi-Grained Grounding, by harvesting a collection of segmentation-grounded datasets with rich annotations. Our experimental results show that GROUNDHOG achieves superior performance on various language grounding tasks without task-specific fine-tuning, and significantly reduces object hallucination. GROUNDHOG also demonstrates better grounding towards complex forms of visual input and provides easy-to-understand diagnosis in failure cases.


title: The Art of Staying Ahead of Deadlines: Improved Algorithms for the Minimum Tardy Processing Time

abstract: We study the fundamental scheduling problem $1\|\sum p_jU_j$. Given a set of $n$ jobs with processing times $p_j$ and deadlines $d_j$, the problem is to select a subset of jobs such that the total processing time is maximized without violating the deadlines. In the midst of a flourishing line of research, Fischer and Wennmann have recently devised the sought-after $\widetilde O(P)$-time algorithm, where $P = \sum p_j$ is the total processing time of all jobs. This running time is optimal as it matches conditional lower bounds based on popular conjectures. However, $P$ is not the sole parameter one could parameterize the running time by. Indeed, they explicitly leave open the question of whether a running time of $\widetilde O(n + \max d_j)$ or even $\widetilde O(n + \max p_j)$ is possible. In this work, we show, somewhat surprisingly, that by a refined implementation of their original algorithm, one can obtain the asked-for $\widetilde O(n + \max d_j)$-time algorithm.


title: InterroGate: Learning to Share, Specialize, and Prune Representations for Multi-task Learning

abstract: Jointly learning multiple tasks with a unified model can improve accuracy and data efficiency, but it faces the challenge of task interference, where optimizing one task objective may inadvertently compromise the performance of another. A solution to mitigate this issue is to allocate task-specific parameters, free from interference, on top of shared features. However, manually designing such architectures is cumbersome, as practitioners need to balance between the overall performance across all tasks and the higher computational cost induced by the newly added parameters. In this work, we propose \textit{InterroGate}, a novel multi-task learning (MTL) architecture designed to mitigate task interference while optimizing inference computational efficiency. We employ a learnable gating mechanism to automatically balance the shared and task-specific representations while preserving the performance of all tasks. Crucially, the patterns of parameter sharing and specialization dynamically learned during training, become fixed at inference, resulting in a static, optimized MTL architecture. Through extensive empirical evaluations, we demonstrate SoTA results on three MTL benchmarks using convolutional as well as transformer-based backbones on CelebA, NYUD-v2, and PASCAL-Context.


title: The dark timbre of gravitational waves

abstract: Gravitational wave timbre, the relative amplitude and phase of the different harmonics, can change due to interactions with low-mass halos. We focus on binaries in the LISA range and find that the integrated lens effect of cold dark matter structures can be used to probe the existence of $M_{\rm v}\lesssim 10\, M_{\odot}$ halos if a single binary with eccentricity $e=0.3-0.6$ is detected with a signal-to-noise ratio $100-10^4$.


title: Linear Magnetoresistance from Glassy Orders

abstract: Several strongly correlated metals display B-linear magnetoresistance (LMR) with a universal slope, in sharp contrast to the $B^2$ scaling predicted by Fermi liquid theory. We provide a unifying explanation of the origin of LMR by focusing on a common feature in their phase diagrams -- proximity to symmetry-breaking orders. Specifically, we demonstrate via two microscopic models that LMR with a universal slope arises ubiquitously near ordered phases, provided the order parameter either (i) has a finite wave-vector, or (ii) has nodes on the Fermi surface. We elucidate the distinct physical mechanisms at play in these two scenarions, and derive upper and lower bounds on the field range for which LMR is observed. Finally, we discuss possible extensions of our picture to strange metal physics at higher temperatures, and argue that our theory provides an understanding of recent experimental results on thin film cuprates and moir\'e materials.


title: Medium-induced photon bremsstrahlung in neutrino-nucleus, antineutrino-nucleus, and electron-nucleus scattering from multiple QED interactions

abstract: Interactions of charged leptons with nuclei and the naive tree-level kinematics of these processes are affected by radiation of photons induced by the QED nuclear medium. We evaluate cross-section modifications at leading orders of the number of correlated interactions inside the nucleus, known as the opacity expansion. We derive results for soft and collinear types of the bremsstrahlung at the first three orders in opacity and generalize them to higher orders. We present the leading in opacity energy spectra of soft and collinear photons and radiative energy loss inside the nucleus for experiments with lepton kinematics in the GeV energy range. At leading power of the Glauber soft-collinear effective field theory, the soft radiation is further resummed to all orders both in opacity and in the electromagnetic coupling constant. We find that the soft and collinear medium-induced radiation is vacuumlike, and additional corrections are power suppressed. Despite the negligible modification to the induced photon spectra, the nuclear medium-induced radiation sizably affects the broadening of charged leptons in the direction orthogonal to their propagation.


title: Characterization of principal bundles: the noncommutative algebraic case

abstract: We review Hopf-Galois extensions, in particular faithfully flat ones, accepted to be the noncommutative algebraic dual of a principal bundle. We also make a short digression into how quantum groups relate to Hopf-Galois extensions. Several examples are given, in order to provide a satisfactory understanding of each topic.


title: PyRQA -- Conducting Recurrence Quantification Analysis on Very Long Time Series Efficiently

abstract: PyRQA is a software package that efficiently conducts recurrence quantification analysis (RQA) on time series consisting of more than one million data points. RQA is a method from non-linear time series analysis that quantifies the recurrent behaviour of systems. Existing implementations to RQA are not capable of analysing such very long time series at all or require large amounts of time to calculate the quantitative measures. PyRQA overcomes their limitations by conducting the RQA computations in a highly parallel manner. Building on the OpenCL framework, PyRQA leverages the computing capabilities of a variety of parallel hardware architectures, such as GPUs. The underlying computing approach partitions the RQA computations and enables to employ multiple compute devices at the same time. The goal of this publication is to demonstrate the features and the runtime efficiency of PyRQA. For this purpose we employ a real-world example, comparing the dynamics of two climatological time series, and a synthetic example, reducing the runtime regarding the analysis of a series consisting of over one million data points from almost eight hours using state-of-the-art RQA software to roughly 69 seconds using PyRQA.


title: Attention Based Molecule Generation via Hierarchical Variational Autoencoder

abstract: Molecule generation is a task made very difficult by the complex ways in which we represent molecules computationally. A common technique used in molecular generative modeling is to use SMILES strings with recurrent neural networks built into variational autoencoders - but these suffer from a myriad of issues: vanishing gradients, long-range forgetting, and invalid molecules. In this work, we show that by combining recurrent neural networks with convolutional networks in a hierarchical manner, we are able to both extract autoregressive information from SMILES strings while maintaining signal and long-range dependencies. This allows for generations with very high validity rates on the order of 95% when reconstructing known molecules. We also observe an average Tanimoto similarity of .6 between test set and reconstructed molecules, which suggests our method is able to map between SMILES strings and their learned representations in a more effective way than prior works using similar methods.


title: MB-RACS: Measurement-Bounds-based Rate-Adaptive Image Compressed Sensing Network

abstract: Conventional compressed sensing (CS) algorithms typically apply a uniform sampling rate to different image blocks. A more strategic approach could be to allocate the number of measurements adaptively, based on each image block's complexity. In this paper, we propose a Measurement-Bounds-based Rate-Adaptive Image Compressed Sensing Network (MB-RACS) framework, which aims to adaptively determine the sampling rate for each image block in accordance with traditional measurement bounds theory. Moreover, since in real-world scenarios statistical information about the original image cannot be directly obtained, we suggest a multi-stage rate-adaptive sampling strategy. This strategy sequentially adjusts the sampling ratio allocation based on the information gathered from previous samplings. We formulate the multi-stage rate-adaptive sampling as a convex optimization problem and address it using a combination of Newton's method and binary search techniques. Additionally, we enhance our decoding process by incorporating skip connections between successive iterations to facilitate a richer transmission of feature information across iterations. Our experiments demonstrate that the proposed MB-RACS method surpasses current leading methods, with experimental evidence also underscoring the effectiveness of each module within our proposed framework.


title: Fabrication of $^{108}$Cd target for the astrophysical p-process studies

abstract: The detailed process of preparing enriched $^{108}$Cd targets on mylar and copper backing using the vacuum evaporation technique is described. These targets were employed in an experiment to measure the proton capture cross-section at energies significantly below the Coulomb barrier, for the astrophysical p-process studies. Due to the low melting point and high vapor pressure of cadmium, some adjustments were implemented in the Telemark multipocket e-beam setup. The target thickness was determined through the measurement of alpha particle energy loss from a triple alpha source and also by RBS measurements. The thickness of the $^{108}$Cd films varies between 290 to 660 $\mu$g/cm$^2$, with a non-uniformity of approximately 10$\%$. X-ray Photoelectron Spectroscopy (XPS) and X-ray Fluorescence (XRF) analyses were conducted to examine the presence of impurities and to assess surface morphology, phase, and chemical composition.


title: A novel method to compute the contact surface area between an organ and cancer tissue

abstract: With "contact surface area" (CSA) we refers to the area of contact between a tumor and an organ. This indicator has been identified as a predictive factor for surgical peri-operative parameters, particularly in the context of kidney cancer. However, state-of-the-art algorithms for computing the CSA rely on assumptions about the tumor shape and require manual human annotation. In this study, we introduce an innovative method that relies on 3D reconstructions of tumors and organs to provide an accurate and objective estimate of the CSA. Our approach consists of a segmentation protocol for reconstructing organs and tumors from Computed Tomography (CT) images and an algorithm leveraging the reconstructed meshes to compute the CSA. With the aim to contributing to the literature with replicable results, we provide an open-source implementation of our algorithm, along with an easy-to-use graphical user interface to support its adoption and widespread use. We evaluated the accuracy of our method using both a synthetic dataset and reconstructions of 87 real tumor-organ pairs.


title: Pragmatic Goal-Oriented Communications under Semantic-Effectiveness Channel Errors

abstract: In forthcoming AI-assisted 6G networks, integrating semantic, pragmatic, and goal-oriented communication strategies becomes imperative. This integration will enable sensing, transmission, and processing of exclusively pertinent task data, ensuring conveyed information possesses understandable, pragmatic semantic significance, aligning with destination needs and goals. Without doubt, no communication is error free. Within this context, besides errors stemming from typical wireless communication dynamics, potential distortions between transmitter-intended and receiver-interpreted meanings can emerge due to limitations in semantic processing capabilities, as well as language and knowledge representation disparities between transmitters and receivers. The main contribution of this paper is two-fold. First, it proposes and details a novel mathematical modeling of errors stemming from language mismatches at both semantic and effectiveness levels. Second, it provides a novel algorithmic solution to counteract these types of errors which leverages optimal transport theory. Our numerical results show the potential of the proposed mechanism to compensate for language mismatches, thereby enhancing the attainability of reliable communication under noisy communication environments.


title: Negative magnetoresistance induced by longitudinal photons in Dirac/Weyl semimetals

abstract: A low-energy model is built to study systems such as Dirac/Weyl semimetals, according to statistical quantum electrodynamics formalism. We report that the introduction of a pseudoscalar, associated to longitudinal photons propagating along a magnetic field B, could transforms a Dirac semimetal into a Weyl semimetal with a pair of Weyl nodes for each point of Dirac. The nodes are separated by a pseudovector electric field induced dynamically along B associated to a chiral effect on the Fermi surface. A topological quantum transition is produced between a chiral-and non chiral symmetry phase. A general expression to the longitudinal magnetoconductivity is found. It provides the possibility of generalizing the usual expressions of the magnetoconductivity reported in the literature. This has a quadratic dependence on B, which is associated with a positive contribution to the magnetoconductivity. This is a prominent signature of the chiral magnetic effect in Dirac/Weyl systems in parallel electric and magnetic fields. We report a chiral effect induced by longitudinal photons associated to a negative longitudinal magnetoresistance in Dirac systems via an axial anomaly relation. We show some numerical results, and reproduced with a high level of accuracy some of the experimental results, in the low temperature region, obtained to the magnetoresistance of ZrTe5 and Na3Bi. We believe that a wide variety of these semimetals can be studied by using our general expression to the negative longitudinal magnetoresistance.


title: Interactive Mars Image Content-Based Search with Interpretable Machine Learning

abstract: The NASA Planetary Data System (PDS) hosts millions of images of planets, moons, and other bodies collected throughout many missions. The ever-expanding nature of data and user engagement demands an interpretable content classification system to support scientific discovery and individual curiosity. In this paper, we leverage a prototype-based architecture to enable users to understand and validate the evidence used by a classifier trained on images from the Mars Science Laboratory (MSL) Curiosity rover mission. In addition to providing explanations, we investigate the diversity and correctness of evidence used by the content-based classifier. The work presented in this paper will be deployed on the PDS Image Atlas, replacing its non-interpretable counterpart.


title: Self-Tuning Network Control Architectures with Joint Sensor and Actuator Selection

abstract: We formulate a mathematical framework for designing a self-tuning network control architecture, and propose a computationally-feasible greedy algorithm for online architecture optimization. In this setting, the locations of active sensors and actuators in the network, as well as the feedback control policy are jointly adapted using all available information about the network states and dynamics to optimize a performance criterion. We show that the case with full-state feedback can be solved with dynamic programming, and in the linear-quadratic setting, the optimal cost functions and policies are piecewise quadratic and piecewise linear, respectively. Our framework is extended for joint sensor and actuator selection for dynamic output feedback control with both control performance and architecture costs. For large networks where exhaustive architecture search is prohibitive, we describe a greedy heuristic for actuator selection and propose a greedy swapping algorithm for joint sensor and actuator selection. Via numerical experiments, we demonstrate a dramatic performance improvement of greedy self-tuning architectures over fixed architectures. Our general formulation provides an extremely rich and challenging problem space with opportunities to apply a wide variety of approximation methods from stochastic control, system identification, reinforcement learning, and static architecture design for practical model-based control.


title: Revisiting Common Randomness, No-signaling and Information Structure in Decentralized Control

abstract: This work revisits the no-signaling condition for decentralized information structures. We produce examples to show that within the no-signaling polytope exist strategies that cannot be achieved by passive common randomness but instead require agents to either share their observations with a mediator or communicate directly with each other. This poses a question mark on whether the no-signaling condition truly captures the decentralized information structure in the strictest sense.


title: Quantum Inspired Chaotic Salp Swarm Optimization for Dynamic Optimization

abstract: Many real-world problems are dynamic optimization problems that are unknown beforehand. In practice, unpredictable events such as the arrival of new jobs, due date changes, and reservation cancellations, changes in parameters or constraints make the search environment dynamic. Many algorithms are designed to deal with stationary optimization problems, but these algorithms do not face dynamic optimization problems or manage them correctly. Although some optimization algorithms are proposed to deal with the changes in dynamic environments differently, there are still areas of improvement in existing algorithms due to limitations or drawbacks, especially in terms of locating and following the previously identified optima. With this in mind, we studied a variant of SSA known as QSSO, which integrates the principles of quantum computing. An attempt is made to improve the overall performance of standard SSA to deal with the dynamic environment effectively by locating and tracking the global optima for DOPs. This work is an extension of the proposed new algorithm QSSO, known as the Quantum-inspired Chaotic Salp Swarm Optimization (QCSSO) Algorithm, which details the various approaches considered while solving DOPs. A chaotic operator is employed with quantum computing to respond to change and guarantee to increase individual searchability by improving population diversity and the speed at which the algorithm converges. We experimented by evaluating QCSSO on a well-known generalized dynamic benchmark problem (GDBG) provided for CEC 2009, followed by a comparative numerical study with well-regarded algorithms. As promised, the introduced QCSSO is discovered as the rival algorithm for DOPs.


title: Joint Resource Allocation and Trajectory Design for Resilient Multi-UAV Communication Networks

abstract: In contrast to terrestrial wireless networks, dynamic Unmanned Aerial Vehicle (UAV) networks are susceptible to unexpected link failures arising from UAV breakdowns or the depletion of its batteries. Drastic user rate fluctuations and sum rate drops can occur due to the unexpected UAV link failures. Previous research has focused primarily on re-establishing these links to maintain service continuity, while neglecting overall system performance, including sum rate and user rate fluctuations. This letter proposes a resilient UAV network design utilizing the modern portfolio theory (MPT), which jointly optimizes the bandwidth allocation, UAV-user association, and UAV trajectories to enhance the overall service stability. Specifically, the design incorporates a novel utility function based on MPT to achieve a better balance between the sum rate and user rate fluctuations. To solve the joint optimization problem, we propose an iterative algorithm based on alternating optimization (AO) and successive convex approximation (SCA). Simulation results show that our scheme outperforms the other two baselines in terms of sum rate and user rate fluctuations. Furthermore, the resilience requirement in terms of sum rate, user rate fluctuations and user fairness can be achieved by flexibly tuning weight factor in our proposed algorithm.


title: Improve Robustness of Eye Disease Detection by including Learnable Probabilistic Discrete Latent Variables into Machine Learning Models

abstract: Ocular diseases, ranging from diabetic retinopathy to glaucoma, present a significant public health challenge due to their prevalence and potential for causing vision impairment. Early and accurate diagnosis is crucial for effective treatment and management.In recent years, deep learning models have emerged as powerful tools for analysing medical images, including ocular imaging . However, challenges persist in model interpretability and uncertainty estimation, which are critical for clinical decision-making. This study introduces a novel application of GFlowOut, leveraging the probabilistic framework of Generative Flow Networks (GFlowNets) to learn the posterior distribution over dropout masks, for the classification and analysis of ocular diseases using eye fundus images. We develop a robust and generalizable method that utilizes GFlowOut integrated with ResNet18 and ViT models as backbone in identifying various ocular conditions. This study employs a unique set of dropout masks - none, random, bottomup, and topdown - to enhance model performance in analyzing ocular images. Our results demonstrate that the bottomup GFlowOut mask significantly improves accuracy, outperforming the traditional dropout approach.


title: Computation Rate Maximization for Wireless Powered Edge Computing With Multi-User Cooperation

abstract: The combination of mobile edge computing (MEC) and radio frequency-based wireless power transfer (WPT) presents a promising technique for providing sustainable energy supply and computing services at the network edge. This study considers a wireless-powered mobile edge computing system that includes a hybrid access point (HAP) equipped with a computing unit and multiple Internet of Things (IoT) devices. In particular, we propose a novel muti-user cooperation scheme to improve computation performance, where collaborative clusters are dynamically formed. Each collaborative cluster comprises a source device (SD) and an auxiliary device (AD), where the SD can partition the computation task into various segments for local processing, offloading to the HAP, and remote execution by the AD with the assistance of the HAP. Specifically, we aims to maximize the weighted sum computation rate (WSCR) of all the IoT devices in the network. This involves jointly optimizing collaboration, time and data allocation among multiple IoT devices and the HAP, while considering the energy causality property and the minimum data processing requirement of each device. Initially, an optimization algorithm based on the interior-point method is designed for time and data allocation. Subsequently, a priority-based iterative algorithm is developed to search for a near-optimal solution to the multi-user collaboration scheme. Finally, a deep learning-based approach is devised to further accelerate the algorithm's operation, building upon the initial two algorithms. Simulation results show that the performance of the proposed algorithms is comparable to that of the exhaustive search method, and the deep learning-based algorithm significantly reduces the execution time of the algorithm.


title: Microscopic Origin of Criticality at Macroscale in QCD Chiral Phase Transition

abstract: We reveal that the criticality of the chiral phase transition in QCD at the macroscale arises from the microscopic energy levels of its fundamental constituents, the quarks. We establish a novel relation between cumulants of the chiral order parameter (i.e., chiral condensate) and correlations among the energy levels of quarks (i.e., eigenspectra of the massless Dirac operator), which naturally leads to a generalization of the Banks-Casher relation. Based on this novel relation and through (2+1)-flavor lattice QCD calculations using the HISQ action with varying light quark masses in the vicinity of the chiral phase transition, we demonstrate that the correlations among the infrared part of the Dirac eigenspectra exhibit same universal scaling behaviors as expected of the cumulants of the chiral condensate. We find that these universal scaling behaviors extend up to the physical values of the up and down quark masses.


title: Codebook-enabled Generative End-to-end Semantic Communication Powered by Transformer

abstract: Codebook-based generative semantic communication attracts increasing attention, since only indices are required to be transmitted when the codebook is shared between transmitter and receiver. However, due to the fact that the semantic relations among code vectors are not necessarily related to the distance of the corresponding code indices, the performance of the codebook-enabled semantic communication system is susceptible to the channel noise. Thus, how to improve the system robustness against the noise requires careful design. This paper proposes a robust codebook-assisted image semantic communication system, where semantic codec and codebook are first jointly constructed, and then vector-to-index transformer is designed guided by the codebook to eliminate the effects of channel noise, and achieve image generation. Thanks to the assistance of the high-quality codebook to the Transformer, the generated images at the receiver outperform those of the compared methods in terms of visual perception. In the end, numerical results and generated images demonstrate the advantages of the generative semantic communication method over JPEG+LDPC and traditional joint source channel coding (JSCC) methods.


title: Considering Fundamental Rights in the European Standardisation of Artificial Intelligence: Nonsense or Strategic Alliance?

abstract: In the European context, both the EU AI Act proposal and the draft Standardisation Request on safe and trustworthy AI link standardisation to fundamental rights. However, these texts do not provide any guidelines that specify and detail the relationship between AI standards and fundamental rights, its meaning or implication. This chapter aims to clarify this critical regulatory blind spot. The main issue tackled is whether the adoption of AI harmonised standards, based on the future AI Act, should take into account fundamental rights. In our view, the response is yes. The high risks posed by certain AI systems relate in particular to infringements of fundamental rights. Therefore, mitigating such risks involves fundamental rights considerations and this is what future harmonised standards should reflect. At the same time, valid criticisms of the European standardisation process have to be addressed. Finally, the practical incorporation of fundamental rights considerations in the ongoing European standardisation of AI systems is discussed.


title: Pioneering Deterministic Scheduling and Network Structure Optimization for Time-Critical Computing Tasks in Industrial IoT

abstract: The Industrial Internet of Things (IIoT) has become a critical technology to accelerate the process of digital and intelligent transformation of industries. As the cooperative relationship between smart devices in IIoT becomes more complex, getting deterministic responses of IIoT periodic time-critical computing tasks becomes a crucial and nontrivial problem. However, few current works in cloud/edge/fog computing focus on this problem. This paper is a pioneer to explore the deterministic scheduling and network structural optimization problems for IIoT periodic time-critical computing tasks. We first formulate the two problems and derive theorems to help quickly identify computation and network resource sharing conflicts. Based on this, we propose a deterministic scheduling algorithm, \textit{IIoTBroker}, which realizes deterministic response for each IIoT task by optimizing the fine-grained computation and network resources allocations, and a network optimization algorithm, \textit{IIoTDeployer}, providing a cost-effective structural upgrade solution for existing IIoT networks. Our methods are illustrated to be cost-friendly, scalable, and deterministic response guaranteed with low computation cost from our simulation results.


title: Bike3S: A Tool for Bike Sharing Systems Simulation

abstract: Vehicle sharing systems are becoming increasingly popular. The effectiveness of such systems depends, among other factors, on different strategic and operational management decisions and policies, like the dimension of the fleet or the distribution of vehicles. It is of foremost importance to be able to anticipate and evaluate the potential effects of such strategies before they can be successfully deployed. In this paper we present Bike3S, a simulator for a station-based bike sharing system. The simulator performs semi-realistic simulations of the operation of a bike sharing system and allows for evaluating and testing different management decisions and strategies. In particular, the simulator has been designed to test different station capacities, station distributions, and balancing strategies. The simulator carries out microscopic agent-based simulations, where users of different types can be defined that act according to their individual goals and objectives which influences the overall dynamics of the whole system.


title: NFT1000: A Visual Text Dataset For Non-Fungible Token Retrieval

abstract: With the rise of 'Metaverse' and 'Web3.0', NFT ( Non-Fungible Token ) has emerged as a kind of pivotal digital asset, garnering significant attention. By the end of November 2023, more than 1.4 billion NFT tokens have been minted across various blockchain platforms. To effectively locate a satisfactory NFT token, conducting searches within the extensive array of NFT data is essential. The challenge in NFT retrieval is heightened due to the high degree of similarity among different NFT tokens, in terms of regional and semantic aspects. Achieving accurate and efficient retrieval within the large-scale, highly similar NFT data presents a formidable challenge for both the academic and industrial communities. In this paper, we will introduce a dataset named 'NFT Top1000 Visual Text Dataset'(henceforth, NFT1000), containing 7.56 million image-text pairs, and being collected from 1000 most famous PFP NFT collections by sales volume on the Ethereum blockchain. Based on the dataset, we test the CLIP (Contrastive Language-Image Pretraining) models as a baseline. Additionally, we also propose a concept of Comprehensive Variance Index (CVI in short), which is a robust metric designed to assess the similarity and retrieval difficulty of visual-text pairs data.


title: Handover Management through Reconfigurable Intelligent Surfaces for VLC under Blockage Conditions

abstract: In this paper, we consider an indoor visible light communication (VLC) system with multiple "white" light emitting diodes serving to form overlapping wireless communication cells. In order to maintain seamless connectivity to mobile users, a handover procedure should be implemented. In particular, practical conditions such as blockages due to obstacles inside the room environment and the mobility of users can affect direct VLC connectivity. The use of reconfigurable intelligent surfaces (RISs) in optical wireless systems allows to exploit non-direct connectivity links, thus providing efficient communication links. In this paper, we present a proactive handover mechanism that exploits the presence of a RIS, in order to redirect the communication links in case of blockages. The proposed approach has been implemented both in hard and soft modes and assessed in terms of achievable data rate and handover latency for a user walking in a given reference room at different user speeds and blockage conditions. Our presented results and comparisons with conventional handover methods (i.e., without RIS) are helpful in showing the superiority of the presented algorithm.


title: Enhancing Retrieval Processes for Language Generation with Augmented Queries

abstract: In the rapidly changing world of smart technology, searching for documents has become more challenging due to the rise of advanced language models. These models sometimes face difficulties, like providing inaccurate information, commonly known as "hallucination." This research focuses on addressing this issue through Retrieval-Augmented Generation (RAG), a technique that guides models to give accurate responses based on real facts. To overcome scalability issues, the study explores connecting user queries with sophisticated language models such as BERT and Orca2, using an innovative query optimization process. The study unfolds in three scenarios: first, without RAG, second, without additional assistance, and finally, with extra help. Choosing the compact yet efficient Orca2 7B model demonstrates a smart use of computing resources. The empirical results indicate a significant improvement in the initial language model's performance under RAG, particularly when assisted with prompts augmenters. Consistency in document retrieval across different encodings highlights the effectiveness of using language model-generated queries. The introduction of UMAP for BERT further simplifies document retrieval while maintaining strong results.


title: Can we predict QPP? An approach based on multivariate outliers

abstract: Query performance prediction (QPP) aims to forecast the effectiveness of a search engine across a range of queries and documents. While state-of-the-art predictors offer a certain level of precision, their accuracy is not flawless. Prior research has recognized the challenges inherent in QPP but often lacks a thorough qualitative analysis. In this paper, we delve into QPP by examining the factors that influence the predictability of query performance accuracy. We propose the working hypothesis that while some queries are readily predictable, others present significant challenges. By focusing on outliers, we aim to identify the queries that are particularly challenging to predict. To this end, we employ multivariate outlier detection method. Our results demonstrate the effectiveness of this approach in identifying queries on which QPP do not perform well, yielding less reliable predictions. Moreover, we provide evidence that excluding these hard-to-predict queries from the analysis significantly enhances the overall accuracy of QPP.


title: Advanced Academic Team Worker Recommendation Models

abstract: Collaborator recommendation is an important task in academic domain. Most of the existing approaches have the assumption that the recommendation system only need to recommend a specific researcher for the task. However, academic successes can be owed to productive collaboration of a whole academic team. In this work, we propose a new task: academic team worker recommendation: with a given status: student, assistant professor or prime professor, research interests and specific task, we can recommend an academic team formed as (prime professor, assistant professor, student). For this task, we propose a model CQBG-R(Citation-Query Blended Graph-Ranking). The key ideas is to combine the context of the query and the papers with the graph topology to form a new graph(CQBG), which can target at the research interests and the specific research task for this time. The experiment results show the effectiveness of the proposed method.


title: Large Language Model Augmented Exercise Retrieval for Personalized Language Learning

abstract: We study the problem of zero-shot exercise retrieval in the context of online language learning, to give learners the ability to explicitly request personalized exercises via natural language. Using real-world data collected from language learners, we observe that vector similarity approaches poorly capture the relationship between exercise content and the language that learners use to express what they want to learn. This semantic gap between queries and content dramatically reduces the effectiveness of general-purpose retrieval models pretrained on large scale information retrieval datasets like MS MARCO. We leverage the generative capabilities of large language models to bridge the gap by synthesizing hypothetical exercises based on the learner's input, which are then used to search for relevant exercises. Our approach, which we call mHyER, overcomes three challenges: (1) lack of relevance labels for training, (2) unrestricted learner input content, and (3) low semantic similarity between input and retrieval candidates. mHyER outperforms several strong baselines on two novel benchmarks created from crowdsourced data and publicly available data.