title: On the Injectivity Radius of the Stiefel Manifold: Numerical investigations and an explicit construction of a cut point at short distance

abstract: Arguably, geodesics are the most important geometric objects on a differentiable manifold. They describe candidates for shortest paths and are guaranteed to be unique shortest paths when the starting velocity stays within the so-called injectivity radius of the manifold. In this work, we investigate the injectivity radius of the Stiefel manifold under the canonical metric. The Stiefel manifold $St(n,p)$ is the set of rectangular matrices of dimension $n$-by-$p$ with orthogonal columns, sometimes also called the space of orthogonal $p$-frames in $\mathbb{R}^n$. Using a standard curvature argument, Rentmeesters has shown in 2013 that the injectivity radius of the Stiefel manifold is bounded by $\sqrt{\frac{4}{5}}\pi$. It is an open question, whether this bound is sharp. With the definition of the injectivity radius via cut points of geodesics, we gain access to the information of the injectivity radius by investigating geodesics. More precisely, we consider the behavior of special variations of geodesics, called Jacobi fields. By doing so, we are able to present an explicit example of a cut point. In addition, since the theoretical analysis of geodesics for cut points and especially conjugate points as a type of cut points is difficult, we investigate the question of the sharpness of the bound by means of numerical experiments.


title: Noise-induced oscillations for the mean-field Dissipative Contact Process

abstract: We study a dissipative version of the contact process, with mean-field interaction, which admits a simple epidemiological interpretation. The propagation of chaos and the corresponding normal fluctuations reveal that the noise present in the finite-size system induces oscillations with a nearly deterministic period and a randomly varying amplitude. This is reminiscent of the emergence of pandemic waves in real epidemics.


title: A quantitative second order Sobolev regularity for (inhmogeneous) normalized $p(\cdot)$-Laplace equations

abstract: Let $\Omega$ be a domain of $\mathbb R^n$ with $n\ge 2$ and $p(\cdot)$ be a local Lipschitz funcion in $\Omega$ with $1<p(x)<\infty$ in $\Omega$. We build up an interior quantitative second order Sobolev regularity for the normalized $p(\cdot)$-Laplace equation $-\Delta^N_{p(\cdot)}u=0$ in $\Omega$ as well as the corresponding inhomogeneous equation $-\Delta^N_{p(\cdot)}u=f$ in $\Omega$ with $f\in C^0(\Omega)$. In particular, given any viscosity solution $u$ to $-\Delta^N_{p(\cdot)}u=0$ in $\Omega$, we prove the following: (i) in dimension $n=2$, for any subdomain $U\Subset\Omega$ and any $\beta\ge 0$, one has $|Du|^\beta Du\in L^{2+\delta}(U)$ locally with a quantitative upper bound, and moreover, the map $(x_1,x_2)\to |Du|^\beta(u_{x_1},-u_{x_2})$ is quasiregular in $U$ in the sense that $$|D[|Du|^\beta Du]|^2\leq -C\det D[|Du|^\beta Du] \quad \mbox{a.e. in $U$}.$$ (ii) in dimension $n\geq3$, for any subdomain $U\Subset\Omega$ with $ \inf_U p(x)>1$ and $\sup_Up(x)<3+\frac2{n-2}$, one has $D^2u\in L^{2+\delta}(U)$ locally with a quantitative upper bound, and also with a pointwise upper bound $$|D^2u|^2\le -C\sum_{1\leq i<j\le n}[u_{x_ix_j}u_{x_jx_i}-u_{x_ix_i}u_{x_jx_j}] \quad \mbox{a.e. in $U$}.$$ Here constants $\delta>0$ and $C\geq 1$ are independent of $u$. These extend the related results obtaind by Adamowicz-H\"ast\"o \cite{AH2010} when $n=2$ and $\beta=0$.


title: A machine learning workflow to address credit default prediction

abstract: Due to the recent increase in interest in Financial Technology (FinTech), applications like credit default prediction (CDP) are gaining significant industrial and academic attention. In this regard, CDP plays a crucial role in assessing the creditworthiness of individuals and businesses, enabling lenders to make informed decisions regarding loan approvals and risk management. In this paper, we propose a workflow-based approach to improve CDP, which refers to the task of assessing the probability that a borrower will default on his or her credit obligations. The workflow consists of multiple steps, each designed to leverage the strengths of different techniques featured in machine learning pipelines and, thus best solve the CDP task. We employ a comprehensive and systematic approach starting with data preprocessing using Weight of Evidence encoding, a technique that ensures in a single-shot data scaling by removing outliers, handling missing values, and making data uniform for models working with different data types. Next, we train several families of learning models, introducing ensemble techniques to build more robust models and hyperparameter optimization via multi-objective genetic algorithms to consider both predictive accuracy and financial aspects. Our research aims at contributing to the FinTech industry in providing a tool to move toward more accurate and reliable credit risk assessment, benefiting both lenders and borrowers.


title: A simple prediction of the non-linear matter power spectrum in Brans-Dicke gravity from linear theory

abstract: Brans-Dicke (BD) was one of the first proposed scalar-tensor theories of gravity, and effectively turns the gravitational constant of General Relativity (GR) time-dependent. Constraints on the BD parameter $\omega$ serve as a benchmark for testing GR, which is recovered in the limit $\omega \rightarrow \infty$. Current small-scale astrophysical constraints $\omega \gtrsim 10^5$ are much tighter than large-scale cosmological constraints $\omega \gtrsim 10^3$, but these decouple if the true theory of gravity features screening. On the largest cosmological scales BD approximates the most general second order scalar-tensor (Horndeski) theory, so constraints here have wider implications. These will improve with upcoming large-scale structure and CMB surveys. To constrain BD with weak gravitational lensing, one needs its non-linear matter power spectrum $P_{\rm BD}$. By comparing the boost $B = P_{\rm BD}/P_{\rm GR}$ from linear theory and non-linear $N$-body simulations, we show that the non-linear boost can simply be predicted from linear theory if the ${\rm BD}$ and ${\rm GR}$ universes are parametrized in a way that makes their early cosmological evolution and quasi-linear power today similar. In particular, they need the same $H_0 / \sqrt{\smash[b]{G_{\rm eff}(a=0)}}$ and $\sigma_8$, where $G_{\rm eff}$ are their (effective) gravitational strengths. Our prediction is $1\%$ accurate for $\omega \geq 100$, $z \leq 3$ and $k \leq 1\,h/\rm{Mpc}$, and $2\%$ further up to $k \leq 5\,h/\rm{Mpc}$. It also holds for $G_{\rm BD}$ that do not match Newton's constant today, so one can study GR with different gravitational constants $G_{\rm GR}$ by sending $\omega \rightarrow \infty$. We provide a code that computes $B$ with the linear Einstein-Boltzmann solver hi_class and multiplies it by the non-linear $P_{\rm GR}$ from EuclidEmulator2 to predict $P_{\rm BD}$.


title: Using Schroedinger cat quantum state for detection of a given phase shift

abstract: We show that injecting a light pulse prepared in the Shroedinger cat quantum state into the dark port of a two-arm interferometer and the strong classical light into the bright one, it is possible, in principle, to detect a given phase shift unambiguously. The value of this phase shift is inversely proportional to the amplitudes of both the classical carrier and Shroedinger cat state. However, an exotic detection procedure is required for this purpose. By measuring the number of photons at the output dark port, it is possible to detect the phase shift with the vanishing "false positive" probability. The "false negative" probability in this case decreases with the increase on the amplitude of the Schroedinger cat state and, for reasonable values of this amplitude, can be made as small as about 0.1.


title: PPTC-R benchmark: Towards Evaluating the Robustness of Large Language Models for PowerPoint Task Completion

abstract: The growing dependence on Large Language Models (LLMs) for finishing user instructions necessitates a comprehensive understanding of their robustness to complex task completion in real-world situations. To address this critical need, we propose the PowerPoint Task Completion Robustness benchmark (PPTC-R) to measure LLMs' robustness to the user PPT task instruction and software version. Specifically, we construct adversarial user instructions by attacking user instructions at sentence, semantic, and multi-language levels. To assess the robustness of Language Models to software versions, we vary the number of provided APIs to simulate both the newest version and earlier version settings. Subsequently, we test 3 closed-source and 4 open-source LLMs using a benchmark that incorporates these robustness settings, aiming to evaluate how deviations impact LLMs' API calls for task completion. We find that GPT-4 exhibits the highest performance and strong robustness in our benchmark, particularly in the version update and the multilingual settings. However, we find that all LLMs lose their robustness when confronted with multiple challenges (e.g., multi-turn) simultaneously, leading to significant performance drops. We further analyze the robustness behavior and error reasons of LLMs in our benchmark, which provide valuable insights for researchers to understand the LLM's robustness in task completion and develop more robust LLMs and agents. We release the code and data at \url{https://github.com/ZekaiGalaxy/PPTCR}.


title: Recovering orthogonality from quasi-nature of Spectral transformations

abstract: In this contribution, quasi-orthogonality of polynomials generated by Geronimus and Uvarov transformations is analyzed. An attempt is made to discuss the recovery of the source orthogonal polynomial from the quasi-Geronimus and quasi-Uvarov polynomials of order one. Moreover, the discussion on the difference equation satisfied by quasi-Geronimus and quasi-Uvarov polynomials is presented. Furthermore, the orthogonality of quasi-Geronimus and quasi-Uvarov polynomials is achieved through the reduction of the degree of coefficients in the difference equation. During this procedure, alternative representations of the parameters responsible for achieving orthogonality are derived. One of these representations involves the Stieltjes transform of the measure. Finally, the recurrence coefficients ensuring the existence of a measure that makes the quasi-Geronimus Laguerre polynomial of order one an orthogonal polynomial are calculated.


title: Popeye: A Unified Visual-Language Model for Multi-Source Ship Detection from Remote Sensing Imagery

abstract: Ship detection needs to identify ship locations from remote sensing (RS) scenes. Due to different imaging payloads, various appearances of ships, and complicated background interference from the bird's eye view, it is difficult to set up a unified paradigm for achieving multi-source ship detection. To address this challenge, in this article, leveraging the large language models (LLMs)'s powerful generalization ability, a unified visual-language model called Popeye is proposed for multi-source ship detection from RS imagery. Specifically, to bridge the interpretation gap between the multi-source images for ship detection, a novel unified labeling paradigm is designed to integrate different visual modalities and the various ship detection ways, i.e., horizontal bounding box (HBB) and oriented bounding box (OBB). Subsequently, the hybrid experts encoder is designed to refine multi-scale visual features, thereby enhancing visual perception. Then, a visual-language alignment method is developed for Popeye to enhance interactive comprehension ability between visual and language content. Furthermore, an instruction adaption mechanism is proposed for transferring the pre-trained visual-language knowledge from the nature scene into the RS domain for multi-source ship detection. In addition, the segment anything model (SAM) is also seamlessly integrated into the proposed Popeye to achieve pixel-level ship segmentation without additional training costs. Finally, extensive experiments are conducted on the newly constructed ship instruction dataset named MMShip, and the results indicate that the proposed Popeye outperforms current specialist, open-vocabulary, and other visual-language models for zero-shot multi-source ship detection.


title: KG-TREAT: Pre-training for Treatment Effect Estimation by Synergizing Patient Data with Knowledge Graphs

abstract: Treatment effect estimation (TEE) is the task of determining the impact of various treatments on patient outcomes. Current TEE methods fall short due to reliance on limited labeled data and challenges posed by sparse and high-dimensional observational patient data. To address the challenges, we introduce a novel pre-training and fine-tuning framework, KG-TREAT, which synergizes large-scale observational patient data with biomedical knowledge graphs (KGs) to enhance TEE. Unlike previous approaches, KG-TREAT constructs dual-focus KGs and integrates a deep bi-level attention synergy method for in-depth information fusion, enabling distinct encoding of treatment-covariate and outcome-covariate relationships. KG-TREAT also incorporates two pre-training tasks to ensure a thorough grounding and contextualization of patient data and KGs. Evaluation on four downstream TEE tasks shows KG-TREAT's superiority over existing methods, with an average improvement of 7% in Area under the ROC Curve (AUC) and 9% in Influence Function-based Precision of Estimating Heterogeneous Effects (IF-PEHE). The effectiveness of our estimated treatment effects is further affirmed by alignment with established randomized clinical trial findings.


title: Neural Exec: Learning (and Learning from) Execution Triggers for Prompt Injection Attacks

abstract: We introduce a new family of prompt injection attacks, termed Neural Exec. Unlike known attacks that rely on handcrafted strings (e.g., "Ignore previous instructions and..."), we show that it is possible to conceptualize the creation of execution triggers as a differentiable search problem and use learning-based methods to autonomously generate them. Our results demonstrate that a motivated adversary can forge triggers that are not only drastically more effective than current handcrafted ones but also exhibit inherent flexibility in shape, properties, and functionality. In this direction, we show that an attacker can design and generate Neural Execs capable of persisting through multi-stage preprocessing pipelines, such as in the case of Retrieval-Augmented Generation (RAG)-based applications. More critically, our findings show that attackers can produce triggers that deviate markedly in form and shape from any known attack, sidestepping existing blacklist-based detection and sanitation approaches.


title: Pseudospin Polarization of Composite Fermions under Uniaxial Strain

abstract: A two dimensional system with extra degrees of freedom, such as spin and valley, is of great interest in the study of quantum phase transitions. The critical condition when a transition between different multicomponent fractional quantum Hall states appears is one of the very few junctions for many body problems between theoretical calculations and experiments. In this work, we present that uniaxial strain induces pseudospin transitions of composite fermions in a two-dimensional hole gas. Determined from transport behavior, strain along <111> effectively changes pseudospin energy levels. We deduce that diagonal strain dominates these variations. Our experiment provides a wedge for manipulating two dimensional interacting systems mechanically.


title: Convergence rate for a regularized scalar conservation law

abstract: This work revisits a recent finding by the first author concerning the local convergence of a regularized scalar conservation law. We significantly improve the original statement by establishing a global convergence result within the Lebesgue spaces $L^\infty_{\mathrm{loc}}(\mathbb{R}^+;L^p(\mathbb{R}))$, for any $p \in [1,\infty)$, as the regularization parameter $\ell$ approaches zero. Notably, we demonstrate that this stability result is accompanied by a quantifiable rate of convergence. A key insight in our proof lies in the observation that the fluctuations of the solutions remain under control in low regularity spaces, allowing for a potential quantification of their behavior in the limit as $\ell\to 0$. This is achieved through a careful asymptotic analysis of the perturbative terms in the regularized equation, which, in our view, constitutes a pivotal contribution to the core findings of this paper.


title: Investigating introductory and advanced students' difficulties with change in internal energy, work and heat transfer using a validated instrument

abstract: We use the Survey of Thermodynamic Processes and First and Second Laws-Long (STPFaSL-Long), a research-based survey instrument with 78 items at the level of introductory physics, to investigate introductory and advanced students' difficulties with internal energy, work, and heat transfer. We present analysis of data from 12 different introductory and advanced physics classes at four different higher education public institutions in the US in which the survey was administered in person to more than 1000 students. We find that not only introductory but also advanced physics students have many common difficulties with these introductory thermodynamic concepts after traditional lecture-based instruction in relevant concepts. We utilize a wide variety of problem types and contexts and our sample includes large numbers of introductory algebra-based, calculus-based, and advanced students. Some of our findings are consistent with prior research in this area, but others expand upon them and reveal previously unreported aspects of students' thinking. Findings related to common difficulties of students before and after traditional lecture-based instruction in college physics courses can help instructors of these courses plan instruction and curricula to improve student understanding. These findings can also be valuable for developing effective research-based curricula and pedagogies to address student difficulties and help students develop a functional understanding of these fundamental thermodynamic concepts.


title: Complete NLO corrections to top-quark pair production with isolated photons

abstract: We compute for the first time the so-called complete NLO corrections to top-quark pair production with one and two isolated photons in the di-lepton top-quark decay channel. The Narrow Width Approximation is used for the modeling of unstable top quarks and $W$ bosons. Higher-order QCD and EW effects as well as photon bremsstrahlung are consistently included at all stages: in production and top-quark decays. We present results at the integrated and differential fiducial cross-section level for both processes for the LHC Run II center-of-mass energy of $\sqrt{s}=13$ TeV. In addition, we investigate the scale choice in photonic observables. Finally, the individual size of each subleading contribution is discussed in detail and the origin of the main subleading corrections is scrutinised. For the latter case, alternative calculations are performed in which the subleading NLO corrections are included only in the production of $t\bar{t}\gamma$ and $t\bar{t}\gamma\gamma$.


title: Modeling thermocapillary microgear rotation and transfer to translational particle propulsion

abstract: In this study, we investigate the thermocapillary rotation of microgears at fluid interfaces and extend the concept of geometric asymmetry to the translational propulsion of micron-sized particles. We introduce a transient numerical model that couples the Navier-Stokes equations with heat transfer, displaying particle motion through a moving mesh interface. The model incorporates absorbed light illumination as a heat source and predicts both rotational and translational speeds of particles. Our simulations explore the influence of microgear design geometry and determine the scale at which thermocapillary Marangoni motion could serve as a viable propulsion method. A clear correlation between Reynolds number and propulsion efficiency can be recognized. To transfer the asymmetry-based propulsion principle from rotational to directed translational motion, various particle geometries are considered. The exploration of breaking geometric symmetry for translational propulsion is mostly ignored in the existing literature, thus warranting further discussion. Therefore, we analyse expected translational speeds in comparison to corresponding microgears to provide insights into this promising propulsion method.


title: Strengthening nuclear symmetry energy constraints using multiple resonant shattering flares of neutron stars with realistic mass uncertainties

abstract: With current and planned gravitational-wave (GW) observing runs, coincident multimessenger timing of Resonant Shattering Flares (RSFs) and GWs may soon allow for neutron star (NS) asteroseismology to be used to constrain the nuclear symmetry energy, an important property of fundamental nuclear physics that influences the composition and equation of state of NSs. In this work we examine the effects of combining multiple RSF detections on these symmetry energy constraints, and consider how realistic uncertainties in the masses of the progenitor NSs may weaken them. We show that the detection of subsequent multimessenger events has the potential to substantially improve constraints beyond those obtained from the first, and that this improvement is insensitive to the mass of the NSs which produce the RSFs and its uncertainty. This sets these asteroseismic constraints apart from bulk NS properties such as radius, for which the NS mass is highly important, meaning that any multimessenger RSF and GW events can equally improve our knowledge of fundamental physics.


title: Cosmological measurements from the CMB and BAO are insensitive to the tail probability in the assumed likelihood

abstract: When fitting cosmological models to data, a Bayesian framework is commonly used, requiring assumptions on the form of the likelihood and model prior. In light of current tensions between different data, it is interesting to investigate the robustness of cosmological measurements to statistical assumptions about the likelihood distribution from which the data was drawn. We consider the impact of changes to the likelihood caused by uncertainties due to the finite number of mock catalogs used to estimate the covariance matrix, leading to the replacement of the standard Gaussian likelihood with a multivariate $t$-distribution. These changes to the likelihood have a negligible impact on recent cosmic microwave background (CMB) lensing and baryon acoustic oscillation (BAO) measurements. We then extend our analysis to perform a sensitivity test on the Gaussian likelihoods typically adopted, considering how increasing the size of the tails of the likelihood (again using a $t$-distribution) affects cosmological inferences. For an open $\Lambda$CDM model constrained by BAO alone, we find that increasing the weight in the tails shifts and broadens the resulting posterior on the parameters, with a $\sim$0.2-0.4$\sigma$ effect on $\Omega_\Lambda$ and $\Omega_{\rm k}$. In contrast, the CMB temperature and polarization constraints in $\Lambda$CDM showed less than 0.03$\sigma$ changes in the parameters, except for $\{\tau$, ln($10^{10}A_{\rm s})$, $\sigma_8$, $S_8$, $\sigma_8\Omega_{\rm m}^{0.25}$, $z_{\rm re}$, $10^9A_{\rm s}e^{-2\tau}\}$ which shifted by around 0.1-0.2$\sigma$. If we use solely $\ell < 30$ data, the amplitude $A_{\rm s} e^{-2\tau}$ varies in the posterior mean by 0.7$\sigma$ and the error bars increase by 6%. We conclude, at least for current-generation CMB and BAO measurements, that uncertainties in the shape and tails of the likelihood do not contribute to current tensions.


title: Direct microwave spectroscopy of Andreev bound states in planar Ge Josephson junctions

abstract: We demonstrate microwave measurements of the Andreev bound state (ABS) spectrum in planar Josephson junctions (JJs) defined in Ge high mobility two-dimensional hole gases contacted by superconducting PtSiGe. The JJs and readout circuitry are located on separate chips and inductively coupled via flip-chip bonding. For a device with $350~\mathrm{nm}$ junction length, spectroscopic signatures were consistent with the short-junction limit, with an induced superconducting gap $\Delta^{*}\approx48~\mathrm{\mu eV}$ and transmission $\tau \approx 0.94$. The interaction between the highest-transmission ABS and the resonator was well described by a Jaynes-Cummings model with a vacuum Rabi splitting of approximately $6~\mathrm{MHz}$. A device with junction length of $1~\mu m$ showed an ABS spectrum consistent with a long junction model. Time-resolved monitoring of the readout resonator in the dispersive regime revealed gate-voltage tunable junction parity fluctuations on the timescale of seconds. Our work indicates a viable path towards hybrid quantum devices based on planar Ge.


title: Realizability of Rectangular Euler Diagrams

abstract: Euler diagrams are a tool for the graphical representation of set relations. Due to their simple way of visualizing elements in the sets by geometric containment, they are easily readable by an inexperienced reader. Euler diagrams where the sets are visualized as aligned rectangles are of special interest. In this work, we link the existence of such rectangular Euler diagrams to the order dimension of an associated order relation. For this, we consider Euler diagrams in one and two dimensions. In the one-dimensional case, this correspondence provides us with a polynomial-time algorithm to compute the Euler diagrams, while the two-dimensional case is linked to an NP-complete problem which we approach with an exponential-time algorithm.


title: Inequalities and bounds for expected order statistics from transform-ordered families

abstract: We introduce a comprehensive method for establishing stochastic orders among order statistics in the i.i.d. case. This approach relies on the assumption that the underlying distribution is linked to a reference distribution through a transform order. Notably, this method exhibits broad applicability, particularly since several well-known nonparametric distribution families can be defined using relevant transform orders, including the convex and the star transform orders. In the context of convex-ordered families, we demonstrate that applying Jensen's inequality enables the derivation of bounds for the probability that a random variable exceeds the expected value of its corresponding order statistic.


title: Resonant switching current detector based on underdamped Josephson junctions

abstract: Current-biased Josephson junctions can act as detectors of electromagnetic radiation. At optimal conditions, their sensitivity is limited by fluctuations causing stochastic switching from the superconducting to the resistive state. This work provides a quantitative description of a stochastic switching current detector, based on an underdamped Josephson junction. It is shown that activation of a Josephson plasma resonance can greatly enhance the detector responsivity in proportion to the quality factor of the junction. The ways of tuning the detector for achieving optimal operation are discussed. For realistic parameters of Nb/AlOx/Nb tunnel junctions, the sensitivity and noise-equivalent power can reach values of $S\simeq 2\times10^{13}$ (V/W) and $NEP\simeq 5\times10^{-24}$ (WHz$^{-1/2}$), respectively. These outstanding characteristics facilitate both bolometric and single-photon detection in microwave and terahertz ranges.


title: Dynamic Scaling of Two-Dimensional Polar Flocks

abstract: We propose a hydrodynamic description of the homogeneous ordered phase of polar flocks. Starting from symmetry principles, we construct the appropriate equation for the dynamics of the Goldstone mode associated with the broken rotational symmetry. We then focus on the two-dimensional case considering both "Malthusian flocks" for which the density field is a fast variable that does not enter the hydrodynamic description and "Vicsek flocks" for which it does. In both cases, we argue in favor of scaling relations that allow to compute exactly the scaling exponents, which are found in excellent agreement with previous simulations of the Vicsek model and with the numerical integration of our hydrodynamic equations.


title: Ultrafast Band Structure Dynamics in Bulk 1$T$-VSe$_2$

abstract: Complex materials encompassing different phases of matter can display new photoinduced metastable states differing from those attainable under equilibrium conditions. These states can be realized when energy is injected in the material following a non-equilibrium pathway, unbalancing the unperturbed energy landscape of the material. Guided by the fact that photoemission experiments allow for detailed insights in the electronic band structure of ordered systems, here we study bulk 1T-VSe$_2$ in its metallic and charge-density-wave phase by time- and angle-resolved photoelectron spectroscopy. After near-infrared optical excitation, the system shows a net increase of the density of states in the energy range of the valence bands, in the vicinity of the Fermi level, lasting for several picoseconds. We discuss possible origins as band shifts or correlation effects on the basis of a band structure analysis. Our results uncover the possibility of altering the electronic band structure of bulk 1T-VSe$_2$ for low excitation fluences, contributing to the understanding of light-induced electronic states.


title: A Precision Drone Landing System using Visual and IR Fiducial Markers and a Multi-Payload Camera

abstract: We propose a method for autonomous precision drone landing with fiducial markers and a gimbal-mounted, multi-payload camera with wide-angle, zoom, and IR sensors. The method has minimal data requirements; it depends primarily on the direction from the drone to the landing pad, enabling it to switch dynamically between the camera's different sensors and zoom factors, and minimizing auxiliary sensor requirements. It eliminates the need for data such as altitude above ground level, straight-line distance to the landing pad, fiducial marker size, and 6 DoF marker pose (of which the orientation is problematic). We leverage the zoom and wide-angle cameras, as well as visual April Tag fiducial markers to conduct successful precision landings from much longer distances than in previous work (168m horizontal distance, 102m altitude). We use two types of April Tags in the IR spectrum - active and passive - for precision landing both at daytime and nighttime, instead of simple IR beacons used in most previous work. The active IR landing pad is heated; the novel, passive one is unpowered, at ambient temperature, and depends on its high reflectivity and an IR differential between the ground and the sky. Finally, we propose a high-level control policy to manage initial search for the landing pad and subsequent searches if it is lost - not addressed in previous work. The method demonstrates successful landings with the landing skids at least touching the landing pad, achieving an average error of 0.19m. It also demonstrates successful recovery and landing when the landing pad is temporarily obscured.


title: Impact of baryonic feedback on HSC Y1 weak lensing non-Gaussian statistics

abstract: Baryonic feedback is a major systematic in weak lensing cosmology. Its most studied effect is the suppression of the lensing power spectrum, a second-order statistic, on small scales. Motivated by the growing interest in statistics beyond the second order, we investigate the effect of baryons on lensing non-Gaussian statistics and the resulting biases in the matter clustering amplitude $S_8 = \sigma_8\sqrt{\Omega_m/0.3}$. We focus on the Subaru Hyper Suprime-Cam Year 1 (HSC-Y1) data which, with its high source number density, closely resembles those expected from the upcoming Euclid and Rubin LSST. We study four non-Gaussian statistics -- peak counts, minimum counts, the probability distribution function, and the scattering transform -- in addition to the usual power spectrum. We first estimate the biases in $S_8$ using mock observations built from the IllustrisTNG and BAHAMAS hydrodynamical simulations and theoretical models built from dark matter-only simulations. We find up to $1\sigma$ bias in $S_8$ when the smallest scales (2 arcmin) and the highest feedback level are considered. We then analyze the HSC-Y1 data and compare the $S_8$ obtained for each statistic with different smoothing scales or scale cuts. As we expect that baryons mostly affect the small scales, comparing the results obtained from including and excluding small scales can indicate the level of impact from baryons. With HSC data, we find only minor ($\leq0.5\sigma$) differences in $S_8$ for all statistics, even when considering very small scales (2 arcmin). Our results suggest that the effect of baryons is insignificant at the level of HSC-Y1 down to 2~arcmin for all statistics examined here, or it is canceled by other scale-dependent systematics.


title: Confidence-Aware Decision-Making and Control for Tool Selection

abstract: Self-reflecting about our performance (e.g., how confident we are) before doing a task is essential for decision making, such as selecting the most suitable tool or choosing the best route to drive. While this form of awareness -- thinking about our performance or metacognitive performance -- is well-known in humans, robots still lack this cognitive ability. This reflective monitoring can enhance their embodied decision power, robustness and safety. Here, we take a step in this direction by introducing a mathematical framework that allows robots to use their control self-confidence to make better-informed decisions. We derive a mathematical closed-form expression for control confidence for dynamic systems (i.e., the posterior inverse covariance of the control action). This control confidence seamlessly integrates within an objective function for decision making, that balances the: i) performance for task completion, ii) control effort, and iii) self-confidence. To evaluate our theoretical account, we framed the decision-making within the tool selection problem, where the agent has to select the best robot arm for a particular control task. The statistical analysis of the numerical simulations with randomized 2DOF arms shows that using control confidence during tool selection improves both real task performance, and the reliability of the tool for performance under unmodelled perturbations (e.g., external forces). Furthermore, our results indicate that control confidence is an early indicator of performance and thus, it can be used as a heuristic for making decisions when computation power is restricted or decision-making is intractable. Overall, we show the advantages of using confidence-aware decision-making and control scheme for dynamic systems.


title: Variational Bayesian Learning based Joint Localization and Channel Estimation with Distance-dependent Noise

abstract: In the Industrial Internet of Things (IIoTs) and Ocean of Things (OoTs), the advent of massive intelligent services has imposed stringent requirements on both communication and localization, particularly emphasizing precise localization and channel information. This paper focuses on the challenge of jointly optimizing localization and communication in IoT networks. Departing from the conventional independent noise model used in localization and channel estimation problems, we consider a more realistic model incorporating distance-dependent noise variance, as revealed in recent theoretical analyses and experimental results. The distance-dependent noise introduces unknown noise power and a complex noise model, resulting in an exceptionally challenging non-convex and nonlinear optimization problem. In this study, we address a joint localization and channel estimation problem encompassing distance-dependent noise, unknown channel parameters, and uncertainties in sensor node locations. To surmount the intractable nonlinear and non-convex objective function inherent in the problem, we introduce a variational Bayesian learning-based framework. This framework enables the joint optimization of localization and channel parameters by leveraging an effective approximation to the true posterior distribution. Furthermore, the proposed joint learning algorithm provides an iterative closed-form solution and exhibits superior performance in terms of computational complexity compared to existing algorithms. Computer simulation results demonstrate that the proposed algorithm approaches the performance of the Bayesian Cramer-Rao bound (BCRB), achieves localization performance comparable to the ML-GMP algorithm, and outperforms the other two comparison algorithms.


title: Quantitative estimates: How well does the discrete Fourier transform approximate the Fourier transform on $\mathbb{R}$

abstract: In order to compute the Fourier transform of a function $f$ on the real line numerically, one samples $f$ on a grid and then takes the discrete Fourier transform. We derive exact error estimates for this procedure in terms of the decay and smoothness of $f$. The analysis provides a new recipe of how to relate the number of samples, the sampling interval, and the grid size.


title: Incentivized Learning in Principal-Agent Bandit Games

abstract: This work considers a repeated principal-agent bandit game, where the principal can only interact with her environment through the agent. The principal and the agent have misaligned objectives and the choice of action is only left to the agent. However, the principal can influence the agent's decisions by offering incentives which add up to his rewards. The principal aims to iteratively learn an incentive policy to maximize her own total utility. This framework extends usual bandit problems and is motivated by several practical applications, such as healthcare or ecological taxation, where traditionally used mechanism design theories often overlook the learning aspect of the problem. We present nearly optimal (with respect to a horizon $T$) learning algorithms for the principal's regret in both multi-armed and linear contextual settings. Finally, we support our theoretical guarantees through numerical experiments.


title: ProbSAINT: Probabilistic Tabular Regression for Used Car Pricing

abstract: Used car pricing is a critical aspect of the automotive industry, influenced by many economic factors and market dynamics. With the recent surge in online marketplaces and increased demand for used cars, accurate pricing would benefit both buyers and sellers by ensuring fair transactions. However, the transition towards automated pricing algorithms using machine learning necessitates the comprehension of model uncertainties, specifically the ability to flag predictions that the model is unsure about. Although recent literature proposes the use of boosting algorithms or nearest neighbor-based approaches for swift and precise price predictions, encapsulating model uncertainties with such algorithms presents a complex challenge. We introduce ProbSAINT, a model that offers a principled approach for uncertainty quantification of its price predictions, along with accurate point predictions that are comparable to state-of-the-art boosting techniques. Furthermore, acknowledging that the business prefers pricing used cars based on the number of days the vehicle was listed for sale, we show how ProbSAINT can be used as a dynamic forecasting model for predicting price probabilities for different expected offer duration. Our experiments further indicate that ProbSAINT is especially accurate on instances where it is highly certain. This proves the applicability of its probabilistic predictions in real-world scenarios where trustworthiness is crucial.


title: Synthesis and Structural Analysis of Multilayered Graphene via Microwave Atmospheric Pressure Plasma

abstract: This study reports the successful synthesis of multilayered graphene sheets via microwave atmospheric pressure plasma. This innovative approach streamlines and expedites graphene production and other carbon nanostructures, eliminating the need for catalysts, solvents, or complex processing conditions. Ethanol is directly injected into a microwave-generated argon plasma plume, leading to the formation of graphene. Raman spectroscopy revealed characteristic peaks (2D, G, and D bands) confirming graphene composition, with defects indicated by the D band. X-ray diffraction analysis supported these findings, indicating a broad peak at 25 degree corresponding to the (002) plane, affirming a multi-layered graphene structure. Scanning electron microscopy exhibited crumpled, randomly oriented graphene sheets, albeit with uneven structures suggesting impurity incorporation. The presence of defects was quantified through the intensity ratio of the D to G band (ID/IG) in Raman spectroscopy, revealing a value of 0.80, signifying the presence of defects in the synthesized graphene. The 2D to G band intensity ratio (I2D/IG) suggested the existence of 7-10 graphene layers, highlighting the need for further optimization for enhanced graphene quality and purity.


title: Evaluating the Elementary Multilingual Capabilities of Large Language Models with MultiQ

abstract: Large language models (LLMs) need to serve everyone, including a global majority of non-English speakers. However, most LLMs today, and open LLMs in particular, are often intended for use in just English (e.g. Llama2, Mistral) or a small handful of high-resource languages (e.g. Mixtral, Qwen). Recent research shows that, despite limits in their intended use, people prompt LLMs in many different languages. Therefore, in this paper, we investigate the basic multilingual capabilities of state-of-the-art open LLMs beyond their intended use. For this purpose, we introduce MultiQ, a new silver standard benchmark for basic open-ended question answering with 27.4k test questions across a typologically diverse set of 137 languages. With MultiQ, we evaluate language fidelity, i.e.\ whether models respond in the prompted language, and question answering accuracy. All LLMs we test respond faithfully and/or accurately for at least some languages beyond their intended use. Most models are more accurate when they respond faithfully. However, differences across models are large, and there is a long tail of languages where models are neither accurate nor faithful. We explore differences in tokenization as a potential explanation for our findings, identifying possible correlations that warrant further investigation.


title: GMRT observations of OHM candidates from the ALFALFA survey

abstract: We present the results of our observations using the Giant Meterwave Radio Telescope (GMRT) to investigate the radio continuum and OH line emission of 10 OHM candidates from the Arecibo Legacy Fast ALFA (ALFALFA) survey. Among these candidates, we have identified two sources, AGC115713 and AGC249507, which display compact OH line emission that are spatially associated with radio continuum emission. These characteristics align with the typical properties of OHM galaxies. Furthermore, the infrared (IR) properties of these two galaxies are consistent with those of known OHM galaxies. %Importantly, these two sources have been independently confirmed by alternative methods. Of the two sources, AGC 249507 has been confirmed through optical redshift, whereas AGC 115713 meets a WISE color selection criterion in the literature, providing additional support for this source being an OHM galaxy rather than a nearby \HI galaxy. On the contrary, no significant spectral line emission were detected in the remaining eight OHM candidates using our full GMRT dataset. This suggests that the spectral line emission initially detected by the ALFALFA survey may have been significantly resolved in our high-resolution observations. Additionally, the absence of radio continuum emission in 6 candidates also distinguishes them from known OHM galaxies documented in the literature. These findings support the notion that OHM emission may be distributed on a subarcsecond scale, underscoring the utility of arcsecond-scale observations in confirming OHM candidates, particularly those lacking optical redshift data.


title: Targeted Variance Reduction: Robust Bayesian Optimization of Black-Box Simulators with Noise Parameters

abstract: The optimization of a black-box simulator over control parameters $\mathbf{x}$ arises in a myriad of scientific applications. In such applications, the simulator often takes the form $f(\mathbf{x},\boldsymbol{\theta})$, where $\boldsymbol{\theta}$ are parameters that are uncertain in practice. Robust optimization aims to optimize the objective $\mathbb{E}[f(\mathbf{x},\boldsymbol{\Theta})]$, where $\boldsymbol{\Theta} \sim \mathcal{P}$ is a random variable that models uncertainty on $\boldsymbol{\theta}$. For this, existing black-box methods typically employ a two-stage approach for selecting the next point $(\mathbf{x},\boldsymbol{\theta})$, where $\mathbf{x}$ and $\boldsymbol{\theta}$ are optimized separately via different acquisition functions. As such, these approaches do not employ a joint acquisition over $(\mathbf{x},\boldsymbol{\theta})$, and thus may fail to fully exploit control-to-noise interactions for effective robust optimization. To address this, we propose a new Bayesian optimization method called Targeted Variance Reduction (TVR). The TVR leverages a novel joint acquisition function over $(\mathbf{x},\boldsymbol{\theta})$, which targets variance reduction on the objective within the desired region of improvement. Under a Gaussian process surrogate on $f$, the TVR acquisition can be evaluated in closed form, and reveals an insightful exploration-exploitation-precision trade-off for robust black-box optimization. The TVR can further accommodate a broad class of non-Gaussian distributions on $\mathcal{P}$ via a careful integration of normalizing flows. We demonstrate the improved performance of TVR over the state-of-the-art in a suite of numerical experiments and an application to the robust design of automobile brake discs under operational uncertainty.


title: On the vacuum energy in the Einstein Universe and the conformal anomaly

abstract: An oldish question is resurrected concerning the significance of the ambiguous `b-type' terms encountered in calculations of the vacuum, Casimir energy on the Einstein Universe for conformally coupled scalar fields. Some remarks in the literature are hopefully clarified and the relevance of much earlier evaluations is pointed out. A consistency principle is suggested.


title: UPCluster-SZ: The Updated Catalog of Galaxy Clusters from the List of Planck Sunyaev-Zeldovich Sources

abstract: We present the updated galaxy cluster catalog of the second Planck catalog of Sunyaev-Zeldovich sources (PSZ2) through the compilation of the data for clusters and galaxies with spectroscopically measured redshifts in the literature. The original version of PSZ2 comprises 1653 SZ sources, of which 1203 have been validated as genuine galaxy clusters, while the remaining 450 sources are yet to be validated. To increase the number of genuine clusters in PSZ2, we first update the validations of the cluster candidates and their redshift information using the data compiled for the confirmed clusters and the member galaxies in the literature. We then use the galaxy redshift data in the fields of the remaining cluster candidates, by searching for possible member galaxies with measured spectroscopic redshifts around the Sunyaev-Zeldovich centroids. In this search process, we classify clusters as strong candidates if they contain more than nine galaxies within a 4500 km s$^{-1}$ velocity range and within 15 arcmin around the Sunyaev-Zeldovich centroids. This process results in the validation of 139 new genuine clusters, the update of redshift information on 399 clusters, and the identification of 10 strong candidates, which increases the number of validated clusters up to 1334 among the 1653 SZ sources. Our updated galaxy cluster catalog will be very useful for the studies of galaxy formation and cosmology through the combination with other all-sky surveys including WISE and SPHEREx.


title: Does Documentation Matter? An Empirical Study of Practitioners' Perspective on Open-Source Software Adoption

abstract: In recent years, open-source software (OSS) has become increasingly prevalent in developing software products. While OSS documentation is the primary source of information provided by the developers' community about a product, its role in the industry's adoption process has yet to be examined. We conducted semi-structured interviews and an online survey to provide insight into this area. Based on interviews and survey insights, we developed a topic model to collect relevant information from OSS documentation automatically. Additionally, according to our survey responses regarding challenges associated with OSS documentation, we propose a novel information augmentation approach, DocMentor, by combining OSS documentation corpus TF-IDF scores and ChatGPT. Through explaining technical terms and providing examples and references, our approach enhances the documentation context and improves practitioners' understanding. Our tool's effectiveness is assessed by surveying practitioners.


title: Continuous and deterministic all-photonic cluster state of indistinguishable photons

abstract: Cluster states are key resources for measurement-based quantum information processing. Photonic cluster and graph states, in particular, play indispensable roles in quantum network and quantum metrology. We demonstrate a semiconductor quantum dot based device in which the confined hole spin acts as a needle in a quantum knitting machine producing continuously and deterministically at sub-Gigahertz repetition rate single indistinguishable photons which are all polarization entangled to each other and to the spin in a one dimensional cluster state. By projecting two nonadjacent photons onto circular polarization bases we disentangle the spin from the photons emitted in between, thus continuously and deterministically preparing all-photonic cluster states for the first time. We use polarization tomography on four sequentially detected photons to demonstrate and to directly quantify the robustness of the cluster's entanglement and the determinism in its photon generation.


title: Identifying Black Holes Through Space Telescopes and Deep Learning

abstract: The EHT has captured a series of images of black holes. These images could provide valuable information about the gravitational environment near the event horizon. However, accurate detection and parameter estimation for candidate black holes are necessary. This paper explores the potential for identifying black holes in the ultraviolet band using space telescopes. We establish a data pipeline for generating simulated observations and present an ensemble neural network model for black hole detection and parameter estimation. The model achieves mean average precision [0.5] values of 0.9176 even when reaching the imaging FWHM ($\theta_c$) and maintains the detection ability until $0.54\theta_c$. The parameter estimation is also accurate. These results indicate that our methodology enables super-resolution recognition. Moreover, the model successfully detects the shadow of M87* from background noise and other celestial bodies and estimates its inclination and positional angle. Our work demonstrates the feasibility of detecting black holes in the ultraviolet band and provides a new method for black hole detection and further parameter estimation.


title: HoLens: A Visual Analytics Design for Higher-order Movement Modeling and Visualization

abstract: Higher-order patterns reveal sequential multistep state transitions, which are usually superior to origin-destination analysis, which depicts only first-order geospatial movement patterns. Conventional methods for higher-order movement modeling first construct a directed acyclic graph (DAG) of movements, then extract higher-order patterns from the DAG. However, DAG-based methods heavily rely on the identification of movement keypoints that are challenging for sparse movements and fail to consider the temporal variants that are critical for movements in urban environments. To overcome the limitations, we propose HoLens, a novel approach for modeling and visualizing higher-order movement patterns in the context of an urban environment. HoLens mainly makes twofold contributions: first, we design an auto-adaptive movement aggregation algorithm that self-organizes movements hierarchically by considering spatial proximity, contextual information, and temporal variability; second, we develop an interactive visual analytics interface consisting of well-established visualization techniques, including the H-Flow for visualizing the higher-order patterns on the map and the higher-order state sequence chart for representing the higher-order state transitions. Two real-world case studies manifest that the method can adaptively aggregate the data and exhibit the process of how to explore the higher-order patterns by HoLens. We also demonstrate our approach's feasibility, usability, and effectiveness through an expert interview with three domain experts.


title: A Modular Approach for Multimodal Summarization of TV Shows

abstract: In this paper we address the task of summarizing television shows, which touches key areas in AI research: complex reasoning, multiple modalities, and long narratives. We present a modular approach where separate components perform specialized sub-tasks which we argue affords greater flexibility compared to end-to-end methods. Our modules involve detecting scene boundaries, reordering scenes so as to minimize the number of cuts between different events, converting visual information to text, summarizing the dialogue in each scene, and fusing the scene summaries into a final summary for the entire episode. We also present a new metric, PREFS (Precision and Recall Evaluation of Summary FactS), to measure both precision and recall of generated summaries, which we decompose into atomic facts. Tested on the recently released SummScreen3D dataset Papalampidi and Lapata (2023), our method produces higher quality summaries than comparison models, as measured with ROUGE and our new fact-based metric.


title: A likelihood framework for cryogenic scintillating calorimeters used in the CRESST dark matter search

abstract: Cryogenic scintillating calorimeters are ultrasensitive particle detectors for rare event searches, particularly for the search for dark matter and the measurement of neutrino properties. These detectors are made from scintillating target crystals generating two signals for each particle interaction. The phonon (heat) signal precisely measures the deposited energy independent of the type of interacting particle. The scintillation light signal yields particle discrimination on an event-by-event basis. This paper presents a likelihood framework modeling backgrounds and a potential dark matter signal in the two-dimensional plane spanned by phonon and scintillation light energies. We apply the framework to data from CaWO$_4$-based detectors operated in the CRESST dark matter search. For the first time, a single likelihood framework is used in CRESST to model the data and extract results on dark matter in one step by using a profile likelihood ratio test. Our framework simultaneously fits (neutron) calibration data and physics (background) data and allows combining data from multiple detectors. Although tailored to CaWO$_4$-targets and the CRESST experiment, the framework can easily be expanded to other materials and experiments using scintillating cryogenic calorimeters for dark matter search and neutrino physics.


title: Temporal Enhanced Floating Car Observers

abstract: Floating Car Observers (FCOs) are an innovative method to collect traffic data by deploying sensor-equipped vehicles to detect and locate other vehicles. We demonstrate that even a small penetration rate of FCOs can identify a significant amount of vehicles at a given intersection. This is achieved through the emulation of detection within a microscopic traffic simulation. Additionally, leveraging data from previous moments can enhance the detection of vehicles in the current frame. Our findings indicate that, with a 20-second observation window, it is possible to recover up to 20\% of vehicles that are not visible by FCOs in the current timestep. To exploit this, we developed a data-driven strategy, utilizing sequences of Bird's Eye View (BEV) representations of detected vehicles and deep learning models. This approach aims to bring currently undetected vehicles into view in the present moment, enhancing the currently detected vehicles. Results of different spatiotemporal architectures show that up to 41\% of the vehicles can be recovered into the current timestep at their current position. This enhancement enriches the information initially available by the FCO, allowing an improved estimation of traffic states and metrics (e.g. density and queue length) for improved implementation of traffic management strategies.


title: Denoising Gradient Descent in Variational Quantum Algorithms

abstract: In this article we introduce an algorithm for mitigating the adverse effects of noise on gradient descent in variational quantum algorithms. This is accomplished by computing a {\emph{regularized}} local classical approximation to the objective function at every gradient descent step. The computational overhead of our algorithm is entirely classical, i.e., the number of circuit evaluations is exactly the same as when carrying out gradient descent using the parameter-shift rules. We empirically demonstrate the advantages offered by our algorithm on randomized parametrized quantum circuits.


title: Linear and nonlinear system identification under $\ell_1$- and group-Lasso regularization via L-BFGS-B

abstract: In this paper, we propose an approach for identifying linear and nonlinear discrete-time state-space models, possibly under $\ell_1$- and group-Lasso regularization, based on the L-BFGS-B algorithm. For the identification of linear models, we show that, compared to classical linear subspace methods, the approach often provides better results, is much more general in terms of the loss and regularization terms used, and is also more stable from a numerical point of view. The proposed method not only enriches the existing set of linear system identification tools but can be also applied to identifying a very broad class of parametric nonlinear state-space models, including recurrent neural networks. We illustrate the approach on synthetic and experimental datasets and apply it to solve the challenging industrial robot benchmark for nonlinear multi-input/multi-output system identification proposed by Weigand et al. (2022). A Python implementation of the proposed identification method is available in the package \texttt{jax-sysid}, available at \url{https://github.com/bemporad/jax-sysid}.


title: From Clicks to Security: Investigating Continuous Authentication via Mouse Dynamics

abstract: In the realm of computer security, the importance of efficient and reliable user authentication methods has become increasingly critical. This paper examines the potential of mouse movement dynamics as a consistent metric for continuous authentication. By analyzing user mouse movement patterns in two contrasting gaming scenarios, "Team Fortress" and Poly Bridge we investigate the distinctive behavioral patterns inherent in high-intensity and low-intensity UI interactions. The study extends beyond conventional methodologies by employing a range of machine learning models. These models are carefully selected to assess their effectiveness in capturing and interpreting the subtleties of user behavior as reflected in their mouse movements. This multifaceted approach allows for a more nuanced and comprehensive understanding of user interaction patterns. Our findings reveal that mouse movement dynamics can serve as a reliable indicator for continuous user authentication. The diverse machine learning models employed in this study demonstrate competent performance in user verification, marking an improvement over previous methods used in this field. This research contributes to the ongoing efforts to enhance computer security and highlights the potential of leveraging user behavior, specifically mouse dynamics, in developing robust authentication systems.


title: CIBRA identifies genomic alterations with a system-wide impact on tumor biology

abstract: Background: Genomic instability is a hallmark of cancer, leading to many somatic alterations. Identifying which alterations have a system-wide impact is a challenging task. Nevertheless, this is an essential first step for prioritizing potential biomarkers. We developed CIBRA (Computational Identification of Biologically Relevant Alterations), a method that determines the system-wide impact of genomic alterations on tumor biology by integrating two distinct omics data types: one indicating genomic alterations (e.g., genomics), and another defining a system-wide expression response (e.g., transcriptomics). CIBRA was evaluated with genome-wide screens in 33 cancer types using primary and metastatic cancer data from the Cancer Genome Atlas and Hartwig Medical Foundation. Results: We demonstrate the capability of CIBRA by successfully confirming the impact of point mutations in experimentally validated oncogenes and tumor suppressor genes. Surprisingly, many genes affected by structural variants were identified to have a strong system-wide impact (30.3%), suggesting that their role in cancer development has thus far been largely underreported. Additionally, CIBRA can identify impact with only ten cases and controls, providing a novel way to prioritize genomic alterations with a prominent role in cancer biology. Conclusions: Our findings demonstrate that CIBRA can identify cancer drivers by combining genomics and transcriptomics data. Moreover, our work shows an unexpected substantial system-wide impact of structural variants in cancer. Hence, CIBRA has the potential to preselect and refine current definitions of genomic alterations to derive more nuanced biomarkers for diagnostics, disease progression, and treatment response. CIBRA is available at https://github.com/AIT4LIFE-UU/CIBRA


title: Parameterized Algorithms for Balanced Cluster Edge Modification Problems

abstract: We introduce Cluster Edge Modification problems with constraints on the size of the clusters and study their complexity. A graph $G$ is a cluster graph if every connected component of $G$ is a clique. In a typical Cluster Edge Modification problem such as the widely studied Cluster Editing, we are given a graph $G$ and a non-negative integer $k$ as input, and we have to decide if we can turn $G$ into a cluster graph by way of at most $k$ edge modifications -- that is, by adding or deleting edges. In this paper, we study the parameterized complexity of such problems, but with an additional constraint: The size difference between any two connected components of the resulting cluster graph should not exceed a given threshold. Depending on which modifications are permissible -- only adding edges, only deleting edges, both adding and deleting edges -- we have three different computational problems. We show that all three problems, when parameterized by $k$, admit single-exponential time FPT algorithms and polynomial kernels. Our problems may be thought of as the size-constrained or balanced counterparts of the typical Cluster Edge Modification problems, similar to the well-studied size-constrained or balanced counterparts of other clustering problems such as $k$-Means Clustering.


title: Formation of super-Mercuries via giant impacts

abstract: During the final stage of planetary formation, different formation pathways of planetary embryos could significantly influence the observed variations in planetary densities. Of the approximately 5,000 exoplanets identified to date, a notable subset exhibit core fractions reminiscent of Mercury, potentially a consequence of high-velocity giant impacts. In order to better understand the influence of such collisions on planetary formation and compositional evolution, we conducted an extensive set of smoothed particle hydrodynamics giant impact simulations between two-layered rocky bodies. These simulations spanned a broad range of impact velocities from one to eleven times the mutual escape velocity. We derived novel scaling laws that estimate the mass and core mass fraction of the largest post-collision remnants. Our findings indicate that the extent of core vaporization markedly influences mantle stripping efficiency at low impact angles. We delineate the distinct roles played by two mechanisms -- kinetic momentum transfer and vaporization-induced ejection -- in mantle stripping. Our research suggests that collisional outcomes for multi-layered planets are more complex than those for undifferentiated planetesimal impacts. Thus, a single universal law may not encompass all collision processes. We found a significant decrease in the mantle stripping efficiency as the impact angle increases. To form a 5 M$_{\oplus}$ super-Mercury at $45^{\circ}$, an impact velocity over 200 km s$^{-1}$ is required. This poses a challenge to the formation of super-Mercuries through a single giant impact, implying that their formation would either favor relatively low-angle single impacts or multiple


title: Your device may know you better than you know yourself -- continuous authentication on novel dataset using machine learning

abstract: This research aims to further understanding in the field of continuous authentication using behavioral biometrics. We are contributing a novel dataset that encompasses the gesture data of 15 users playing Minecraft with a Samsung Tablet, each for a duration of 15 minutes. Utilizing this dataset, we employed machine learning (ML) binary classifiers, being Random Forest (RF), K-Nearest Neighbors (KNN), and Support Vector Classifier (SVC), to determine the authenticity of specific user actions. Our most robust model was SVC, which achieved an average accuracy of approximately 90%, demonstrating that touch dynamics can effectively distinguish users. However, further studies are needed to make it viable option for authentication systems


title: Superfluid dark stars

abstract: We present a superfluid dark star model consisting of relativistic dark bosons with two-body self-interaction. The obtained masses, radii, and tidal deformability depend in a simple way on the boson mass and interaction strength. We report first results on binary mergers: the distinctive amplitude and frequency of the emitted gravitational waves are well within reach of terrestrial interferometers.


title: Second order Sobolev regularity for normalized parabolic $p(x)$-Laplace equations via the algebraic structure

abstract: Denote by $\Delta$ the Laplacian and by $\Delta_\infty$ the $\infty$-Laplacian. A fundamental inequality is proved for the algebraic structure of $\Delta v\Delta_\infty v$: for every $v\in C^{\infty}$, $$\bigg| |D^2vDv|^2-\Delta v\Delta_\infty v-\frac{1}{2}[|D^2v|^2-(\Delta v)^2]|Dv|^2\bigg| \le\frac{n-2}{2}[|D^2v|^2|Dv|^2-|D^2vDv|^2]$$ Based on this, we prove the result: When $n\ge2$ and $p(x)\in(1,2)\cup(2,3+\frac{2}{n-2})$, the viscosity solutions to parabolic normalized $p(x)$-Laplace equation have the $W^{2,2}_{loc}$-regularity in the spatial variable and the $W^{1,2}_{loc}$-regularity in the time variable.


title: Cobweb: An Incremental and Hierarchical Model of Human-Like Category Learning

abstract: Cobweb, a human-like category learning system, differs from most cognitive science models in incrementally constructing hierarchically organized tree-like structures guided by the category utility measure. Prior studies have shown that Cobweb can capture psychological effects such as basic-level, typicality, and fan effects. However, a broader evaluation of Cobweb as a model of human categorization remains lacking. The current study addresses this gap. It establishes Cobweb's alignment with classical human category learning effects. It also explores Cobweb's flexibility to exhibit both exemplar- and prototype-like learning within a single framework. These findings set the stage for further research on Cobweb as a robust model of human category learning.


title: Disorder-to-order transition of long fibers contained in evaporating sessile drops

abstract: A liquid drop containing a long fiber is a complex system whose configuration is determined by an interplay of elastic stresses in the fiber and capillary forces due to the liquid. We study the morphological evolution of fibers that are much longer than the drop diameter in evaporating sessile drops. After insertion, the fibers are either found in an ordered or disordered state, with increasing disorder for increasing fiber length. Upon evaporation, the order increases, in such a way that the final configuration deposited on the solid surface is either a circle, an ellipse, or 8-shaped. The morphology of the deposit depends on the fiber length and the elastocapillary length, both non-dimensionalized with the characteristic drop size, which we classify in a morphology regime map. The disorder-to-order transition allows depositing ordered fiber structures on solid surfaces even in cases of a strongly disordered state after fiber insertion. Combined with technologies such as inkjet printing, this process could open new avenues to decorate surfaces with filamental structures whose morphology can be controlled by varying the fiber length.


title: An Adaptive Multivariate Functional EWMA Control Chart

abstract: In many modern industrial scenarios, the measurements of the quality characteristics of interest are often required to be represented as functional data or profiles. This motivates the growing interest in extending traditional univariate statistical process monitoring (SPM) schemes to the functional data setting. This article proposes a new SPM scheme, which is referred to as adaptive multivariate functional EWMA (AMFEWMA), to extend the well-known exponentially weighted moving average (EWMA) control chart from the univariate scalar to the multivariate functional setting. The favorable performance of the AMFEWMA control chart over existing methods is assessed via an extensive Monte Carlo simulation. Its practical applicability is demonstrated through a case study in the monitoring of the quality of a resistance spot welding process in the automotive industry through the online observations of dynamic resistance curves, which are associated with multiple spot welds on the same car body and recognized as the full technological signature of the process.


title: Feature Selection as Deep Sequential Generative Learning

abstract: Feature selection aims to identify the most pattern-discriminative feature subset. In prior literature, filter (e.g., backward elimination) and embedded (e.g., Lasso) methods have hyperparameters (e.g., top-K, score thresholding) and tie to specific models, thus, hard to generalize; wrapper methods search a feature subset in a huge discrete space and is computationally costly. To transform the way of feature selection, we regard a selected feature subset as a selection decision token sequence and reformulate feature selection as a deep sequential generative learning task that distills feature knowledge and generates decision sequences. Our method includes three steps: (1) We develop a deep variational transformer model over a joint of sequential reconstruction, variational, and performance evaluator losses. Our model can distill feature selection knowledge and learn a continuous embedding space to map feature selection decision sequences into embedding vectors associated with utility scores. (2) We leverage the trained feature subset utility evaluator as a gradient provider to guide the identification of the optimal feature subset embedding;(3) We decode the optimal feature subset embedding to autoregressively generate the best feature selection decision sequence with autostop. Extensive experimental results show this generative perspective is effective and generic, without large discrete search space and expert-specific hyperparameters.


title: How open is the asteroid-mass primordial black hole window?

abstract: Primordial black holes (PBHs) can make up all of the dark matter (DM) if their mass, $m$, is in the so-called 'asteroid-mass window', $10^{17} \, {\rm g} \lesssim m \lesssim 10^{22} \, {\rm g}$. Observational constraints on the abundance of PBHs are usually calculated assuming they all have the same mass, however this is unlikely to be a good approximation. PBHs formed from the collapse of large density perturbations during radiation domination are expected to have an extended mass function (MF), due to the effects of critical collapse. The PBH MF is often assumed to be lognormal, however it has recently been shown that other functions are a better fit to numerically calculated MFs. We recalculate both current and potential future constraints for these improved fitting functions. We find that for current constraints the asteroid-mass window narrows, but remains open (i.e. all of the DM can be in the form of PBHs) unless the PBH MF is wider than expected. Future evaporation and microlensing constraints may together exclude all of the DM being in PBHs, depending on the width of the PBH MF and also the shape of its low and high mass tails.


title: Caloric functions and boundary regularity for the fractional Laplacian in Lipschitz open sets

abstract: We give Martin representation of nonnegative functions caloric with respect to the fractional Laplacian in Lipschitz open sets. The caloric functions are defined in terms of the mean value property for the space-time isotropic $\alpha$-stable L\'evy process. To derive the representation, we first establish the existence of the parabolic Martin kernel. This involves proving new boundary regularity results for both the fractional heat equation and the fractional Poisson equation with Dirichlet exterior conditions. Specifically, we demonstrate that the ratio of the solution and the Green function is H\"older continuous up to the boundary.


title: Loop Corrections in Bispectrum in USR Inflation with PBHs Formation

abstract: We calculate the one-loop corrections in bispectrum of CMB scale perturbations induced from the small scale modes undergoing an intermediate phase of USR inflation in scenarios employed for PBHs formation. Using the formalism of effective field theory of inflation we calculate the cubic and quartic Hamiltonians and perform the in-in analysis for a subset of Feynman diagrams comprising both the cubic and the quartic exchange vertices. We show the one-loop corrections in bispectrum has the local shape with $f_{NL}$ having the same structure as the one-loop correction in power spectrum in their dependence on the duration of the USR phase and the sharpness of the transition to the final attractor phase. It is shown that in the models with a sharp transition the induced loop corrections in bispectrum can quickly violate the observational bounds on $f_{NL}$.


title: Political polarisation in turbulent times: Tracking polarisation trends and partisan news link sharing on Finnish Twitter, 2015-2023

abstract: The study analyses polarisation on Finnish social media with data from the platform X, which was known as Twitter during the time of data collection (during the Sipil\"a and Marin governments, 2015-2023). The users were clustered into three different ideological groups - the Conservative Right, the Moderate Right, and the Liberal Left - based on their retweeting of tweets referring to the different political parties in Finland. Trends in polarisation of several topics encompassing the most recent political crises - immigration, climate change, COVID-19, and security policy - between these ideological groups is analysed using network methods. To what extent the polarisation of each topic aligns with the polarisation of the other topics is also studied. In addition, the sharing of news links is examined in relation to the ideological groups of the users as well as to the sentiment and the virality of the tweets in which news links are shared.


title: The Emerging Stellar Complex in Mon R2: Membership and Optical Variability Classification

abstract: Monoceros R2 (Mon R2) is one of the closest large active star-forming regions. This extremely young and partially embedded region provides an excellent laboratory for studying star formation and the early evolution of young stellar objects (YSOs). In this paper, we conduct an optical study of the greater Mon R2 region. Beginning with 1690 previously identified candidate YSOs, we used 496 sources with good proper motions and parallaxes from Gaia DR3 to determine the astrometric properties for likely members of Mon R2. We then used both astrometric and photometric (isochronal and variability) criteria to determine that 308 of these stars are highly probable members. Using the same criteria, we considered a broad area search around Mon R2 in Gaia DR3, and separated candidate members from field stars. In total, we selected 651 likely new cluster members that had been missed in the previous x-ray and infrared excess selection techniques used in the past to establish cluster membership. Revised astrometric properties of the cluster were found using the combined sample of ~959 highly probable member stars. For the literature plus new candidate member list, optical light curves were compiled from the Zwicky Transient Facility. For 470 identified variable sources, we attempted classification based on the Flux Asymmetry (M) and Quasi-Periodicity (Q) metrics. We find that Mon R2 is dominated by quasi-periodic symmetric variables, with aperiodic sources also a significant population. A few tens of large-amplitude variables are identified that may be of interest for further study.


title: Electromagnetic inverse wave scattering in anisotropic media via reduced order modeling

abstract: The inverse wave scattering problem seeks to estimate a heterogeneous, inaccessible medium, modeled by unknown variable coefficients in wave equations, from transient recordings of waves generated by probing signals. It is a widely studied inverse problem with important applications, that is typically formulated as a nonlinear least squares data fit optimization. For typical measurement setups and band-limited probing signals, the least squares objective function has spurious local minima far and near the true solution, so Newton-type optimization methods fail. We introduce a different approach, for electromagnetic inverse wave scattering in lossless, anisotropic media. Our reduced order model (ROM) is an algebraic, discrete time dynamical system derived from Maxwell's equations with four important properties: (1) It is data driven, without knowledge of the medium. (2) The data to ROM mapping is nonlinear and yet the ROM can be obtained in a non-iterative fashion. (3) It has a special algebraic structure that captures the causal Wave propagation. (4) The ROM interpolates the data on a uniform time grid. We show how to obtain from the ROM an estimate of the wave field at inaccessible points inside the unknown medium. The use of this wave is twofold: First, it defines a computationally inexpensive imaging function designed to estimate the support of reflective structures in the medium, modeled by jump discontinuities of the matrix valued dielectric permittivity. Second, it gives an objective function for quantitative estimation of the dielectric permittivity, that has better behavior than the least squares data fitting objective function. The methodology introduced in this paper applies to Maxwell's equations in three dimensions. To avoid high computational costs, we limit the study to a cylindrical domain filled with an orthotropic medium, so the problem becomes two dimensional.


title: Surveys of clumps, cores, and condensations in Cygnus X: Temperature and nonthermal velocity dispersion revealed by VLA NH3 observations

abstract: The physical properties, evolution, and fragmentation of massive dense cores (MDCs, $\sim$ 0.1 pc) are fundamental pieces in our understanding of high-mass star formation. We aim to characterize the temperature, velocity dispersion, and fragmentation of the MDCs in the Cygnus X giant molecular cloud and to investigate the stability and dynamics of these cores. We present the Karl G. Jansky Very Large Array (VLA) observations of the NH$_3$ (J,K) = (1,1) and (2,2) inversion lines towards 35 MDCs in Cygnus X, from which we calculated the temperature and velocity dispersion. We extracted 202 fragments ($\sim$ 0.02 pc) from the NH$_3$ (1,1) moment-0 maps with the GAUSSCLUMPS algorithm. We analyzed the stability of the MDCs and their NH$_3$ fragments through evaluating the corresponding kinetic, gravitational potential, and magnetic energies and the virial parameters. The MDCs in Cygnus X have a typical mean kinetic temperature T$_K$ of $\sim$ 20 K. Our virial analysis shows that many MDCs are in subvirialized states, indicating that the kinetic energy is insufficient to support these MDCs against their gravity. The calculated nonthermal velocity dispersions of most MDCs are at transonic to mildly supersonic levels, and the bulk motions make only a minor contribution to the velocity dispersion. Regarding the NH$_3$ fragments, with T$_K$ $\sim$ 19 K, their nonthermal velocity dispersions are mostly trans-sonic to subsonic. Unless there is a strong magnetic field, most NH$_3$ fragments are probably not in virialized states. We also find that most of the NH$_3$ fragments are dynamically quiescent, while only a few are active due to star formation activity.


title: On the Effectiveness of Distillation in Mitigating Backdoors in Pre-trained Encoder

abstract: In this paper, we study a defense against poisoned encoders in SSL called distillation, which is a defense used in supervised learning originally. Distillation aims to distill knowledge from a given model (a.k.a the teacher net) and transfer it to another (a.k.a the student net). Now, we use it to distill benign knowledge from poisoned pre-trained encoders and transfer it to a new encoder, resulting in a clean pre-trained encoder. In particular, we conduct an empirical study on the effectiveness and performance of distillation against poisoned encoders. Using two state-of-the-art backdoor attacks against pre-trained image encoders and four commonly used image classification datasets, our experimental results show that distillation can reduce attack success rate from 80.87% to 27.51% while suffering a 6.35% loss in accuracy. Moreover, we investigate the impact of three core components of distillation on performance: teacher net, student net, and distillation loss. By comparing 4 different teacher nets, 3 student nets, and 6 distillation losses, we find that fine-tuned teacher nets, warm-up-training-based student nets, and attention-based distillation loss perform best, respectively.


title: Flexible Optimization for Cyber-Physical and Human Systems

abstract: Can we allow humans to pick among different, yet reasonably similar, decisions? Are we able to construct optimization problems whose outcome are sets of feasible, close-to-optimal decisions for human users to pick from, instead of a single, hardly explainable, do-as-I-say ``optimal'' directive? In this paper, we explore two complementary ways to render optimization problems stemming from cyber-physical applications flexible. In doing so, the optimization outcome is a trade off between engineering best and flexibility for the users to decide to do something slightly different. The first method is based on robust optimization and convex reformulations. The second method is stochastic and inspired from stochastic optimization with decision-dependent distributions.


title: Dexterous Legged Locomotion in Confined 3D Spaces with Reinforcement Learning

abstract: Recent advances of locomotion controllers utilizing deep reinforcement learning (RL) have yielded impressive results in terms of achieving rapid and robust locomotion across challenging terrain, such as rugged rocks, non-rigid ground, and slippery surfaces. However, while these controllers primarily address challenges underneath the robot, relatively little research has investigated legged mobility through confined 3D spaces, such as narrow tunnels or irregular voids, which impose all-around constraints. The cyclic gait patterns resulted from existing RL-based methods to learn parameterized locomotion skills characterized by motion parameters, such as velocity and body height, may not be adequate to navigate robots through challenging confined 3D spaces, requiring both agile 3D obstacle avoidance and robust legged locomotion. Instead, we propose to learn locomotion skills end-to-end from goal-oriented navigation in confined 3D spaces. To address the inefficiency of tracking distant navigation goals, we introduce a hierarchical locomotion controller that combines a classical planner tasked with planning waypoints to reach a faraway global goal location, and an RL-based policy trained to follow these waypoints by generating low-level motion commands. This approach allows the policy to explore its own locomotion skills within the entire solution space and facilitates smooth transitions between local goals, enabling long-term navigation towards distant goals. In simulation, our hierarchical approach succeeds at navigating through demanding confined 3D environments, outperforming both pure end-to-end learning approaches and parameterized locomotion skills. We further demonstrate the successful real-world deployment of our simulation-trained controller on a real robot.


title: MedMamba: Vision Mamba for Medical Image Classification

abstract: Since the era of deep learning, convolutional neural networks (CNNs) and vision transformers (ViTs) have been extensively studied and widely used in medical image classification tasks. Unfortunately, CNN's limitations in modeling long-range dependencies result in poor classification performances. In contrast, ViTs are hampered by the quadratic computational complexity of their self-attention mechanism, making them difficult to deploy in real-world settings with limited computational resources. Recent studies have shown that state space models (SSMs) represented by Mamba can effectively model long-range dependencies while maintaining linear computational complexity. Inspired by it, we proposed MedMamba, the first vision Mamba for generalized medical image classification. Concretely, we introduced a novel hybrid basic block named SS-Conv-SSM, which integrates the convolutional layers for extracting local features with the abilities of SSM to capture long-range dependencies, aiming to model medical images from different image modalities efficiently. By employing the grouped convolution strategy and channel-shuffle operation, MedMamba successfully provides fewer model parameters and a lower computational burden for efficient applications. To demonstrate the potential of MedMamba, we conducted extensive experiments using 16 datasets containing ten imaging modalities and 411,007 images. Experimental results show that the proposed MedMamba demonstrates competitive performance in classifying various medical images compared with the state-of-the-art methods. Our work is aims to establish a new baseline for medical image classification and provide valuable insights for developing more powerful SSM-based artificial intelligence algorithms and application systems in the medical field. The source codes and all pre-trained weights of MedMamba are available at https://github.com/YubiaoYue/MedMamba.


title: Conformal prediction for multi-dimensional time series by ellipsoidal sets

abstract: Conformal prediction (CP) has been a popular method for uncertainty quantification because it is distribution-free, model-agnostic, and theoretically sound. For forecasting problems in supervised learning, most CP methods focus on building prediction intervals for univariate responses. In this work, we develop a sequential CP method called $\texttt{MultiDimSPCI}$ that builds prediction $\textit{regions}$ for a multivariate response, especially in the context of multivariate time series, which are not exchangeable. Theoretically, we estimate $\textit{finite-sample}$ high-probability bounds on the conditional coverage gap. Empirically, we demonstrate that $\texttt{MultiDimSPCI}$ maintains valid coverage on a wide range of multivariate time series while producing smaller prediction regions than CP and non-CP baselines.


title: Numerical study of a viscous breaking water wave and the limit of vanishing viscosity

abstract: We introduce a numerical strategy to study the evolution of 2D water waves in the presence of a plunging jet. The free-surface Navier-Stokes solution is obtained with a finite but small viscosity. We observe the formation of a surface boundary layer where the vorticity is localised. We highlight convergence to the inviscid solution. The effects of dissipation on the development of a singularity at the tip of the wave is also investigated by characterising the vorticity boundary layer appearing near the interface.


title: Accelerating Convergence of Score-Based Diffusion Models, Provably

abstract: Score-based diffusion models, while achieving remarkable empirical performance, often suffer from low sampling speed, due to extensive function evaluations needed during the sampling phase. Despite a flurry of recent activities towards speeding up diffusion generative modeling in practice, theoretical underpinnings for acceleration techniques remain severely limited. In this paper, we design novel training-free algorithms to accelerate popular deterministic (i.e., DDIM) and stochastic (i.e., DDPM) samplers. Our accelerated deterministic sampler converges at a rate $O(1/{T}^2)$ with $T$ the number of steps, improving upon the $O(1/T)$ rate for the DDIM sampler; and our accelerated stochastic sampler converges at a rate $O(1/T)$, outperforming the rate $O(1/\sqrt{T})$ for the DDPM sampler. The design of our algorithms leverages insights from higher-order approximation, and shares similar intuitions as popular high-order ODE solvers like the DPM-Solver-2. Our theory accommodates $\ell_2$-accurate score estimates, and does not require log-concavity or smoothness on the target distribution.

categories: cs.LG cs.AI cs.IT math.IT math.OC stat.ML


title: ShortGPT: Layers in Large Language Models are More Redundant Than You Expect

abstract: As Large Language Models (LLMs) continue to advance in performance, their size has escalated significantly, with current LLMs containing billions or even trillions of parameters. However, in this study, we discovered that many layers of LLMs exhibit high similarity, and some layers play a negligible role in network functionality. Based on this observation, we define a metric called Block Influence (BI) to gauge the significance of each layer in LLMs. We then propose a straightforward pruning approach: layer removal, in which we directly delete the redundant layers in LLMs based on their BI scores. Experiments demonstrate that our method, which we call ShortGPT, significantly outperforms previous state-of-the-art (SOTA) methods in model pruning. Moreover, ShortGPT is orthogonal to quantization-like methods, enabling further reduction in parameters and computation. The ability to achieve better results through simple layer removal, as opposed to more complex pruning techniques, suggests a high degree of redundancy in the model architecture.


title: ECAP: Extensive Cut-and-Paste Augmentation for Unsupervised Domain Adaptive Semantic Segmentation

abstract: We consider unsupervised domain adaptation (UDA) for semantic segmentation in which the model is trained on a labeled source dataset and adapted to an unlabeled target dataset. Unfortunately, current self-training methods are susceptible to misclassified pseudo-labels resulting from erroneous predictions. Since certain classes are typically associated with less reliable predictions in UDA, reducing the impact of such pseudo-labels without skewing the training towards some classes is notoriously difficult. To this end, we propose an extensive cut-and-paste strategy (ECAP) to leverage reliable pseudo-labels through data augmentation. Specifically, ECAP maintains a memory bank of pseudo-labeled target samples throughout training and cut-and-pastes the most confident ones onto the current training batch. We implement ECAP on top of the recent method MIC and boost its performance on two synthetic-to-real domain adaptation benchmarks. Notably, MIC+ECAP reaches an unprecedented performance of 69.1 mIoU on the Synthia->Cityscapes benchmark. Our code is available at https://github.com/ErikBrorsson/ECAP.


title: Cosmic Insights from Galaxy Clusters: Exploring Magnification Bias on Sub-millimeter Galaxies

abstract: Magnification bias, an observational effect of gravitational lensing in the weak regime, allows testing the cosmological model through angular correlations of sources at different redshifts. This effect has been observed in various contexts, particularly with sub-millimeter galaxies (SMGs), offering astrophysical and cosmological insights. The study aims to investigate the magnification bias effect exerted by galaxy clusters on SMGs and its implications for astrophysical and cosmological parameters within the $\Lambda$CDM model. Magnification bias was explored through quantifying the cross-correlation function, utilised to derive constraints on cosmological and astrophysical parameters with a Markov Chain Monte Carlo algorithm. Two distinct galaxy cluster samples were used to assess result robustness and understand the influence of sample characteristics. Cluster samples show higher cross-correlation values than galaxies, with an excess at larger scales suggesting contributions from additional large-scale structures. The parameters obtained, while consistent with galaxies, are less constrained due to broader redshift distributions and limited cluster statistics. Results align with weak lensing studies, hinting at slightly lower $\sigma_8$ and $\Omega_m$ values than \emph{Planck}'s CMB data, emphasizing the need for enhanced precision and alternative low-redshift universe tests. While yielding constraints compatible with the $\Lambda$CDM model, limitations include broader redshift distributions and a limited number of lenses, resulting in less constrained parameters compared to previous galaxy studies. Nonetheless, the study underscores the potential of using galaxy clusters as lenses for magnification bias studies, capitalising on their elevated mass, providing a promising avenue to test current Cosmology theories. Further progress can be made by expanding the lens sample size.


title: Public-data Assisted Private Stochastic Optimization: Power and Limitations

abstract: We study the limits and capability of public-data assisted differentially private (PA-DP) algorithms. Specifically, we focus on the problem of stochastic convex optimization (SCO) with either labeled or unlabeled public data. For complete/labeled public data, we show that any $(\epsilon,\delta)$-PA-DP has excess risk $\tilde{\Omega}\big(\min\big\{\frac{1}{\sqrt{n_{\text{pub}}}},\frac{1}{\sqrt{n}}+\frac{\sqrt{d}}{n\epsilon} \big\} \big)$, where $d$ is the dimension, ${n_{\text{pub}}}$ is the number of public samples, ${n_{\text{priv}}}$ is the number of private samples, and $n={n_{\text{pub}}}+{n_{\text{priv}}}$. These lower bounds are established via our new lower bounds for PA-DP mean estimation, which are of a similar form. Up to constant factors, these lower bounds show that the simple strategy of either treating all data as private or discarding the private data, is optimal. We also study PA-DP supervised learning with \textit{unlabeled} public samples. In contrast to our previous result, we here show novel methods for leveraging public data in private supervised learning. For generalized linear models (GLM) with unlabeled public data, we show an efficient algorithm which, given $\tilde{O}({n_{\text{priv}}}\epsilon)$ unlabeled public samples, achieves the dimension independent rate $\tilde{O}\big(\frac{1}{\sqrt{{n_{\text{priv}}}}} + \frac{1}{\sqrt{{n_{\text{priv}}}\epsilon}}\big)$. We develop new lower bounds for this setting which shows that this rate cannot be improved with more public samples, and any fewer public samples leads to a worse rate. Finally, we provide extensions of this result to general hypothesis classes with finite fat-shattering dimension with applications to neural networks and non-Euclidean geometries.


title: Emojinize: Enriching Any Text with Emoji Translations

abstract: Emoji have become ubiquitous in written communication, on the Web and beyond. They can emphasize or clarify emotions, add details to conversations, or simply serve decorative purposes. This casual use, however, barely scratches the surface of the expressive power of emoji. To further unleash this power, we present Emojinize, a method for translating arbitrary text phrases into sequences of one or more emoji without requiring human input. By leveraging the power of large language models, Emojinize can choose appropriate emoji by disambiguating based on context (eg, cricket-bat vs bat) and can express complex concepts compositionally by combining multiple emoji (eq, "Emojinize" is translated to input-latin-letters right-arrow grinning-face). In a cloze test--based user study, we show that Emojinize's emoji translations increase the human guessability of masked words by 55%, whereas human-picked emoji translations do so by only 29%. These results suggest that emoji provide a sufficiently rich vocabulary to accurately translate a wide variety of words. Moreover, annotating words and phrases with Emojinize's emoji translations opens the door to numerous downstream applications, including children learning how to read, adults learning foreign languages, and text understanding for people with learning disabilities.