title: FourierMamba: Fourier Learning Integration with State Space Models for Image Deraining

abstract: Image deraining aims to remove rain streaks from rainy images and restore clear backgrounds. Currently, some research that employs the Fourier transform has proved to be effective for image deraining, due to it acting as an effective frequency prior for capturing rain streaks. However, despite there exists dependency of low frequency and high frequency in images, these Fourier-based methods rarely exploit the correlation of different frequencies for conjuncting their learning procedures, limiting the full utilization of frequency information for image deraining. Alternatively, the recently emerged Mamba technique depicts its effectiveness and efficiency for modeling correlation in various domains (e.g., spatial, temporal), and we argue that introducing Mamba into its unexplored Fourier spaces to correlate different frequencies would help improve image deraining. This motivates us to propose a new framework termed FourierMamba, which performs image deraining with Mamba in the Fourier space. Owning to the unique arrangement of frequency orders in Fourier space, the core of FourierMamba lies in the scanning encoding of different frequencies, where the low-high frequency order formats exhibit differently in the spatial dimension (unarranged in axis) and channel dimension (arranged in axis). Therefore, we design FourierMamba that correlates Fourier space information in the spatial and channel dimensions with distinct designs. Specifically, in the spatial dimension Fourier space, we introduce the zigzag coding to scan the frequencies to rearrange the orders from low to high frequencies, thereby orderly correlating the connections between frequencies; in the channel dimension Fourier space with arranged orders of frequencies in axis, we can directly use Mamba to perform frequency correlation and improve the channel information representation.


title: On the screened Kratzer potential and its variants

abstract: We argue that several potentials proposed recently for the analysis of the vibrational-rotational spectra of diatomic molecules and their thermodynamic properties exhibit a flaw. One can easily show that the parameters $D_e $ and $r_e$ in those potentials are not the dissociation energy and equilibrium bond length, respectively, as the proposers believe. We show how to overcome the mistake in a simple and quite general way.


title: Gaitor: Learning a Unified Representation Across Gaits for Real-World Quadruped Locomotion

abstract: The current state-of-the-art in quadruped locomotion is able to produce robust motion for terrain traversal but requires the segmentation of a desired robot trajectory into a discrete set of locomotion skills such as trot and crawl. In contrast, in this work we demonstrate the feasibility of learning a single, unified representation for quadruped locomotion enabling continuous blending between gait types and characteristics. We present Gaitor, which learns a disentangled representation of locomotion skills, thereby sharing information common to all gait types seen during training. The structure emerging in the learnt representation is interpretable in that it is found to encode phase correlations between the different gait types. These can be leveraged to produce continuous gait transitions. In addition, foot swing characteristics are disentangled and directly addressable. Together with a rudimentary terrain encoding and a learned planner operating in this structured latent representation, Gaitor is able to take motion commands including desired gait type and characteristics from a user while reacting to uneven terrain. We evaluate Gaitor in both simulated and real-world settings on the ANYmal C platform. To the best of our knowledge, this is the first work learning such a unified and interpretable latent representation for multiple gaits, resulting in on-demand continuous blending between different locomotion modes on a real quadruped robot.


title: Optimizing Split Points for Error-Resilient SplitFed Learning

abstract: Recent advancements in decentralized learning, such as Federated Learning (FL), Split Learning (SL), and Split Federated Learning (SplitFed), have expanded the potentials of machine learning. SplitFed aims to minimize the computational burden on individual clients in FL and parallelize SL while maintaining privacy. This study investigates the resilience of SplitFed to packet loss at model split points. It explores various parameter aggregation strategies of SplitFed by examining the impact of splitting the model at different points-either shallow split or deep split-on the final global model performance. The experiments, conducted on a human embryo image segmentation task, reveal a statistically significant advantage of a deeper split point.


title: Deep Grokking: Would Deep Neural Networks Generalize Better?

abstract: Recent research on the grokking phenomenon has illuminated the intricacies of neural networks' training dynamics and their generalization behaviors. Grokking refers to a sharp rise of the network's generalization accuracy on the test set, which occurs long after an extended overfitting phase, during which the network perfectly fits the training set. While the existing research primarily focus on shallow networks such as 2-layer MLP and 1-layer Transformer, we explore grokking on deep networks (e.g. 12-layer MLP). We empirically replicate the phenomenon and find that deep neural networks can be more susceptible to grokking than its shallower counterparts. Meanwhile, we observe an intriguing multi-stage generalization phenomenon when increase the depth of the MLP model where the test accuracy exhibits a secondary surge, which is scarcely seen on shallow models. We further uncover compelling correspondences between the decreasing of feature ranks and the phase transition from overfitting to the generalization stage during grokking. Additionally, we find that the multi-stage generalization phenomenon often aligns with a double-descent pattern in feature ranks. These observations suggest that internal feature rank could serve as a more promising indicator of the model's generalization behavior compared to the weight-norm. We believe our work is the first one to dive into grokking in deep neural networks, and investigate the relationship of feature rank and generalization performance.


title: Development of the Low Frequency Telescope focal plane detector arrays for LiteBIRD

abstract: LiteBIRD, a forthcoming JAXA mission, aims to accurately study the microwave sky within the 40-400 GHz frequency range divided into 15 distinct nominal bands. The primary objective is to constrain the CMB inflationary signal, specifically the primordial B-modes. LiteBIRD targets the CMB B-mode signal on large angular scales, where the primordial inflationary signal is expected to dominate, with the goal of reaching a tensor-to-scalar ratio sensitivity of $\sigma_r\sim0.001$. LiteBIRD frequency bands will be split among three telescopes, with some overlap between telescopes for better control of systematic effects. Here we report on the development status of the detector arrays for the Low Frequency Telescope (LFT), which spans the 34-161 GHz range, with 12 bands subdivided between four types of trichroic pixels consisting of lenslet-coupled sinuous antennas. The signal from the antenna is bandpass filtered and sensed by AlMn Transition-Edge Sensors (TES). We provide an update on the status of the design and development of LiteBIRD's LFT LF1 (40-60-78 GHz), LF2 (50-68-89 GHz) pixels. We discuss design choices motivated by LiteBIRD scientific goals. In particular we focus on the details of the optimization of the design parameters of the sinuous antenna, on-chip bandpass filters, cross-under and impedance transformers and all the RF components that define the LF1 and LF2 pixel detection chain. We present this work in the context of the technical challenges and physical constraints imposed by the finite size of the instrument.


title: An Automated Startup Evaluation Pipeline: Startup Success Forecasting Framework (SSFF)

abstract: Evaluating startups in their early stages is a complex task that requires detailed analysis by experts. While automating this process on a large scale can significantly impact businesses, the inherent complexity poses challenges. This paper addresses this challenge by introducing the Startup Success Forecasting Framework (SSFF), a new automated system that combines traditional machine learning with advanced language models. This intelligent agent-based architecture is designed to reason, act, synthesize, and decide like a venture capitalist to perform the analysis end-to-end. The SSFF is made up of three main parts: - Prediction Block: Uses random forests and neural networks to make predictions. - Analyst Block: Simulates VC analysis scenario and uses SOTA prompting techniques - External Knowledge Block: Gathers real-time information from external sources. This framework requires minimal input data about the founder and startup description, enhances it with additional data from external resources, and performs a detailed analysis with high accuracy, all in an automated manner


title: Construction of a Byzantine Linearizable SWMR Atomic Register from SWSR Atomic Registers

abstract: The SWMR atomic register is a fundamental building block in shared memory distributed systems and implementing it from SWSR atomic registers is an important problem. While this problem has been solved in crash-prone systems, it has received less attention in Byzantine systems. Recently, Hu and Toueg gave such an implementation of the SWMR register from SWSR registers. While their definition of register linearizability is consistent with the definition of Byzantine linearizability of a concurrent history of Cohen and Keidar, it has these drawbacks. (1) If the writer is Byzantine, the register is linearizable no matter what values the correct readers return. (2) It ignores values written consistently by a Byzantine writer. We need a stronger notion of a {\em correct write operation}. (3) It allows a value written to just one or a few readers' SWSR registers to be returned, thereby not validating the intention of the writer to write that value honestly. (4) Its notion of a ``current'' value returned by a correct reader is not related to the most recent value written by a correct write operation of a Byzantine writer. We need a more up to date version of the value that can be returned by a correct reader. In this paper, we give a stronger definition of a Byzantine linearizable register that overcomes the above drawbacks. Then we give a construction of a Byzantine linearizable SWMR atomic register from SWSR registers that meets our stronger definition. The construction is correct when $n>3f$, where $n$ is the number of readers, $f$ is the maximum number of Byzantine readers, and the writer can also be Byzantine. The construction relies on a public-key infrastructure.


title: MemControl: Mitigating Memorization in Medical Diffusion Models via Automated Parameter Selection

abstract: Diffusion models show a remarkable ability in generating images that closely mirror the training distribution. However, these models are prone to training data memorization, leading to significant privacy, ethical, and legal concerns, particularly in sensitive fields such as medical imaging. We hypothesize that memorization is driven by the overparameterization of deep models, suggesting that regularizing model capacity during fine-tuning could be an effective mitigation strategy. Parameter-efficient fine-tuning (PEFT) methods offer a promising approach to capacity control by selectively updating specific parameters. However, finding the optimal subset of learnable parameters that balances generation quality and memorization remains elusive. To address this challenge, we propose a bi-level optimization framework that guides automated parameter selection by utilizing memorization and generation quality metrics as rewards. Our framework successfully identifies the optimal parameter set to be updated to satisfy the generation-memorization tradeoff. We perform our experiments for the specific task of medical image generation and outperform existing state-of-the-art training-time mitigation strategies by fine-tuning as few as 0.019% of model parameters. Furthermore, we show that the strategies learned through our framework are transferable across different datasets and domains. Our proposed framework is scalable to large datasets and agnostic to the choice of reward functions. Finally, we show that our framework can be combined with existing approaches for further memorization mitigation.


title: Math behind everyday life: on emergence of "black days" and beyond

abstract: In our daily lives, we encounter numerous independent events, each occurring with varying probabilities over time. This letter delves into the scientific background behind the inhomogeneous distribution of these events over time, often resulting in what we refer to as "black days", where multiple events seem to converge at once. In the first part of the work we performed an analysis involving $D$ independent periodic and random sequences of events. Employing the Uniform Manifold Approximation and Projection (UMAP) technique, we observed a clustering of sequences of events on a 2D manifold ${\cal M}$ at some large $D_{cr}$, which we interpret as the manifestation of "black days" and which occurs in a narrow interval around $D_{cr}$. We found that increasing the number of sequences within rather wide interval below $D_{cr}$ leads to a plateau in the clustering on ${\cal M}$. In the second part of the work we examined in detail clustering patterns of independently distributed $N$ points within the corners of a $D$-dimensional cube when $1\ll N<D$. Our findings revealed that a transition to a single-component cluster occurs at a critical dimensionality, $D_{cr}$, via a nearly third-order phase transition. Finally, we have addressed the question "How the infinite-dimensional space could look like?" Considering the eigenvalue problem for the hyperspherical Laplacian $\nabla^2_D$ in the limit $D\to\infty$, we conjectured about the topology of a target space representing the hyperspherical layer.


title: Evaluating Micro Parsons Problems as Exam Questions

abstract: Parsons problems are a type of programming activity that present learners with blocks of existing code and requiring them to arrange those blocks to form a program rather than write the code from scratch. Micro Parsons problems extend this concept by having students assemble segments of code to form a single line of code rather than an entire program. Recent investigations into micro Parsons problems have primarily focused on supporting learners leaving open the question of micro Parsons efficacy as an exam item and how students perceive it when preparing for exams. To fill this gap, we included a variety of micro Parsons problems on four exams in an introductory programming course taught in Python. We use Item Response Theory to investigate the difficulty of the micro Parsons problems as well as the ability of the questions to differentiate between high and low ability students. We then compare these results to results for related questions where students are asked to write a single line of code from scratch. Finally, we conduct a thematic analysis of the survey responses to investigate how students' perceptions of micro Parsons both when practicing for exams and as they appear on exams.


title: Clustering-Based Validation Splits for Domain Generalisation

abstract: This paper considers the problem of model selection under domain shift. In this setting, it is proposed that a high maximum mean discrepancy (MMD) between the training and validation sets increases the generalisability of selected models. A data splitting algorithm based on kernel k-means clustering, which maximises this objective, is presented. The algorithm leverages linear programming to control the size, label, and (optionally) group distributions of the splits, and comes with convergence guarantees. The technique consistently outperforms alternative splitting strategies across a range of datasets and training algorithms, for both domain generalisation (DG) and unsupervised domain adaptation (UDA) tasks. Analysis also shows the MMD between the training and validation sets to be strongly rank-correlated ($\rho=0.63$) with test domain accuracy, further substantiating the validity of this approach.


title: Critical Learning Periods: Leveraging Early Training Dynamics for Efficient Data Pruning

abstract: Neural Machine Translation models are extremely data and compute-hungry. However, not all data points contribute equally to model training and generalization. Data pruning to remove the low-value data points has the benefit of drastically reducing the compute budget without significant drop in model performance. In this paper, we propose a new data pruning technique: Checkpoints Across Time (CAT), that leverages early model training dynamics to identify the most relevant data points for model performance. We benchmark CAT against several data pruning techniques including COMET-QE, LASER and LaBSE. We find that CAT outperforms the benchmarks on Indo-European languages on multiple test sets. When applied to English-German, English-French and English-Swahili translation tasks, CAT achieves comparable performance to using the full dataset, while pruning up to 50% of training data. We inspect the data points that CAT selects and find that it tends to favour longer sentences and sentences with unique or rare words.


title: Stochastic Optimization Algorithms for Instrumental Variable Regression with Streaming Data

abstract: We develop and analyze algorithms for instrumental variable regression by viewing the problem as a conditional stochastic optimization problem. In the context of least-squares instrumental variable regression, our algorithms neither require matrix inversions nor mini-batches and provides a fully online approach for performing instrumental variable regression with streaming data. When the true model is linear, we derive rates of convergence in expectation, that are of order $\mathcal{O}(\log T/T)$ and $\mathcal{O}(1/T^{1-\iota})$ for any $\iota>0$, respectively under the availability of two-sample and one-sample oracles, respectively, where $T$ is the number of iterations. Importantly, under the availability of the two-sample oracle, our procedure avoids explicitly modeling and estimating the relationship between confounder and the instrumental variables, demonstrating the benefit of the proposed approach over recent works based on reformulating the problem as minimax optimization problems. Numerical experiments are provided to corroborate the theoretical results.


title: Leveraging Generative AI for Smart City Digital Twins: A Survey on the Autonomous Generation of Data, Scenarios, 3D City Models, and Urban Designs

abstract: The digital transformation of modern cities by integrating advanced information, communication, and computing technologies has marked the epoch of data-driven smart city applications for efficient and sustainable urban management. Despite their effectiveness, these applications often rely on massive amounts of high-dimensional and multi-domain data for monitoring and characterizing different urban sub-systems, presenting challenges in application areas that are limited by data quality and availability, as well as costly efforts for generating urban scenarios and design alternatives. As an emerging research area in deep learning, Generative Artificial Intelligence (AI) models have demonstrated their unique values in data and code generation. This survey paper aims to explore the innovative integration of generative AI techniques and urban digital twins to address challenges in the realm of smart cities in various urban sectors, such as transportation and mobility management, energy system operations, building and infrastructure management, and urban design. The survey starts with the introduction of popular generative AI models with their application areas, followed by a structured review of the existing urban science applications that leverage the autonomous capability of the generative AI techniques to facilitate (a) data augmentation for promoting urban monitoring and predictive analytics, (b) synthetic data and scenario generation, (c) automated 3D city modeling, and (d) generative urban design and optimization. Based on the review, this survey discusses potential opportunities and technical strategies that integrate generative AI models into the next-generation urban digital twins for more reliable, scalable, and automated management of smart cities.


title: RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adapter

abstract: Text-Video Retrieval (TVR) aims to align relevant video content with natural language queries. To date, most state-of-the-art TVR methods learn image-to-video transfer learning based on large-scale pre-trained visionlanguage models (e.g., CLIP). However, fully fine-tuning these pre-trained models for TVR incurs prohibitively expensive computation costs. To this end, we propose to conduct efficient text-video Retrieval with a sparse-andcorrelated AdaPter (RAP), i.e., fine-tuning the pre-trained model with a few parameterized layers. To accommodate the text-video scenario, we equip our RAP with two indispensable characteristics: temporal sparsity and correlation. Specifically, we propose a low-rank modulation module to refine the per-image features from the frozen CLIP backbone, which accentuates salient frames within the video features while alleviating temporal redundancy. Besides, we introduce an asynchronous self-attention mechanism that first selects the top responsive visual patches and augments the correlation modeling between them with learnable temporal and patch offsets. Extensive experiments on four TVR datasets demonstrate that RAP achieves superior or comparable performance compared to the fully fine-tuned counterpart and other parameter-efficient fine-tuning methods.


title: Posterior Sampling via Autoregressive Generation

abstract: Real-world decision-making requires grappling with a perpetual lack of data as environments change; intelligent agents must comprehend uncertainty and actively gather information to resolve it. We propose a new framework for learning bandit algorithms from massive historical data, which we demonstrate in a cold-start recommendation problem. First, we use historical data to pretrain an autoregressive model to predict a sequence of repeated feedback/rewards (e.g., responses to news articles shown to different users over time). In learning to make accurate predictions, the model implicitly learns an informed prior based on rich action features (e.g., article headlines) and how to sharpen beliefs as more rewards are gathered (e.g., clicks as each article is recommended). At decision-time, we autoregressively sample (impute) an imagined sequence of rewards for each action, and choose the action with the largest average imputed reward. Far from a heuristic, our approach is an implementation of Thompson sampling (with a learned prior), a prominent active exploration algorithm. We prove our pretraining loss directly controls online decision-making performance, and we demonstrate our framework on a news recommendation task where we integrate end-to-end fine-tuning of a pretrained language model to process news article headline text to improve performance.


title: Analysis of the Fractional Relativistic Polytropic Gas Sphere

abstract: Many stellar configurations, including white dwarfs, neutron stars, black holes, supermassive stars, and star clusters, rely on relativistic effects. The Tolman-Oppenheimer-Volkoff (TOV) equation of the polytropic gas sphere is ultimately a hydrostatic equilibrium equation developed from the general relativity framework. In the modified Rieman Liouville (mRL) frame, we formulate the fractional TOV (FTOV) equations and introduce an analytical solution. Using power series expansions to solve the fractional TOV equations yields a limited physical range to the convergent power series solution. Therefore, the two techniques of Euler-Abel transformation and Pade approximation have been combined to improve the convergence of the obtained series solutions. For all possible values of the relativistic parameters (\sigma), we calculated twenty fractional gas models for the polytropic indexes n=0, 0.5, 1, 1.5, 2. Investigating the impacts of fractional and relativistic parameters on the models revealed fascinating phenomena; the two effects for n=0.5 are that the sphere's volume and mass decrease with increasing \sigma and the fractional parameter (\alpha). For n=1, the volume decreases when \sigma=0.1 and then increases when \sigma=0.2 and 0.3. The volume of the sphere reduces as both \sigma and \alpha increase for n=1.5 and n=2. We calculated the maximum mass and the corresponding minimum radius of the white dwarfs modeled with polytropic index n=3 and several fractional and relativistic parameter values. We obtained a mass limit for the white dwarfs somewhat near the Chandrasekhar limit for the integer models with small relativistic parameters (\alpha=1, \sigma=0.001). The situation is altered by lowering the fractional parameter; the mass limit increases to Mlimit=1.63348 M at \alpha=0.95 and \sigma=0.001.


title: On the completed tensor product of two preadic algebras over a field

abstract: In this paper, we study the problem, initiated by Grothendieck, of the transfer of the properties of two preadic noetherian algebras over a field to their completed tensor product.


title: Constraining Inflation with the BICEP/Keck CMB Polarization Experiments

abstract: The BICEP/$\textit{Keck}$ (BK) series of cosmic microwave background (CMB) polarization experiments has, over the past decade and a half, produced a series of field-leading constraints on cosmic inflation via measurements of the "B-mode" polarization of the CMB. Primordial B modes are directly tied to the amplitude of primordial gravitational waves (PGW), their strength parameterized by the tensor-to-scalar ratio, $r$, and thus the energy scale of inflation. Having set the most sensitive constraints to-date on $r$, $\sigma(r)=0.009$ ($r_{0.05}<0.036, 95\%$ C.L.) using data through the 2018 observing season (``BK18''), the BICEP/$\textit{Keck}$ program has continued to improve its dataset in the years since. We give a brief overview of the BK program and the "BK18" result before discussing the program's ongoing efforts, including the deployment and performance of the $\textit{Keck Array}$'s successor instrument, BICEP Array, improvements to data processing and internal consistency testing, new techniques such as delensing, and how those will ultimately serve to allow BK reach $\sigma(r) \lesssim 0.003$ using data through the 2027 observing season.


title: On point spectrum of Jacobi matrices generated by iterations of quadratic polynomials

abstract: In general, point spectrum of an almost periodic Jacobi matrix can depend on the element of the hull. In this paper, we study the hull of the limit-periodic Jacobi matrix corresponding to the equilibrium measure of the Julia set of the polynomial $z^2-\lambda$ with large enough $\lambda$; this is the leading model in inverse spectral theory of ergodic operators with zero measure spectrum. We prove that every element of the hull has empty point spectrum.


title: The Data Minimization Principle in Machine Learning

abstract: The principle of data minimization aims to reduce the amount of data collected, processed or retained to minimize the potential for misuse, unauthorized access, or data breaches. Rooted in privacy-by-design principles, data minimization has been endorsed by various global data protection regulations. However, its practical implementation remains a challenge due to the lack of a rigorous formulation. This paper addresses this gap and introduces an optimization framework for data minimization based on its legal definitions. It then adapts several optimization algorithms to perform data minimization and conducts a comprehensive evaluation in terms of their compliance with minimization objectives as well as their impact on user privacy. Our analysis underscores the mismatch between the privacy expectations of data minimization and the actual privacy benefits, emphasizing the need for approaches that account for multiple facets of real-world privacy risks.


title: Implications of in-ice volume scattering for radio-frequency neutrino experiments

abstract: Over the last three decades, several experimental initiatives have been launched with the goal of observing radio-frequency signals produced by ultra-high energy neutrinos (UHEN) interacting in solid media. Observed neutrino event signatures comprise impulsive signals with duration of order the inverse of the antenna+system bandwidth, superimposed upon an incoherent (typically white noise) thermal noise spectrum. Although bulk volume scattering (VS) of external radio-frequency signals is well-studied within the radar and glaciological communities, and can, in principle, contribute to that background. However, thus far, neutrino experiments have neglected to account for VS when projecting event rates. Herein, we present both model-dependent and model-independent constraints on both coherent, and also incoherent volume scattering, and assess their impact on UHEN experiments. We find that VS contributions are only weakly constrained by extant data; stronger limits may be obtained with dedicated calibration experiments.


title: Bifurcation for a Class of Indefinite Elliptic Systems by Comparison Theory for the Spectral Flow via an Index Theorem

abstract: We consider families of strongly indefinite systems of elliptic PDE and investigate bifurcation from a trivial branch of solutions by using the spectral flow. The novelty in our approach is a refined version of a comparison principle that was originally proved by Pejsachowicz in a joint work with the third author, and which is based on an index theorem for a certain class of Fredholm operators that is of independent interest. Finally, we use our findings for a bifurcation problem on shrinking domains that originates from works of Morse and Smale.


title: An Ultrametric for Cartesian Differential Categories for Taylor Series Convergence

abstract: Cartesian differential categories provide a categorical framework for multivariable differential calculus and also the categorical semantics of the differential $\lambda$-calculus. Taylor series expansion is an important concept for both differential calculus and the differential $\lambda$-calculus. In differential calculus, a function is equal to its Taylor series if its sequence of Taylor polynomials converges to the function in the analytic sense. On the other hand, for the differential $\lambda$-calculus, one works in a setting with an appropriate notion of algebraic infinite sums to formalize Taylor series expansion. In this paper, we provide a formal theory of Taylor series in an arbitrary Cartesian differential category without the need for converging limits or infinite sums. We begin by developing the notion of Taylor polynomials of maps in a Cartesian differential category and then show how comparing Taylor polynomials of maps induces an ultrapseudometric on the homsets. We say that a Cartesian differential category is Taylor if maps are entirely determined by their Taylor polynomials. The main results of this paper are that in a Taylor Cartesian differential category, the induced ultrapseudometrics are ultrametrics and that for every map $f$, its Taylor series converges to $f$ with respect to this ultrametric. This framework recaptures both Taylor series expansion in differential calculus via analytic methods and in categorical models of the differential $\lambda$-calculus (or Differential Linear Logic) via infinite sums.


title: Detection of Low-Energy Electrons with Transition-Edge Sensors

abstract: We present the first detection of electrons with kinetic energy in the 100 eV range with transition-edge sensors (TESs). This has been achieved with a (100 x 100) $\mu$m$^2$ Ti-Au bilayer TES, with a critical temperature of about 84 mK. The electrons are produced directly in the cryostat by a cold-cathode source based on field emission from vertically-aligned multiwall carbon nanotubes. We obtain a Gaussian energy resolution between 0.8 and 1.8 eV for fully-absorbed electrons in the (95-105) eV energy range, which is found to be compatible with the resolution of this same device for photons in the same energy range. This measurement opens new possibilities in the field of electron detection.


title: Development of Cryogenic Scintillation Detectors for the Search of New Physics

abstract: CryoCsI, the proposed prototype, is a cryogenic undoped CsI scintillating detector, which has a much lower energy threshold potentially down to 0.5 keV$_{nr}$ compared to the doped CsI. This enhanced sensitivity of CryoCsI allows for the observation of more Coherent elastic neutrino-nucleus scattering events. Precise measurements of CEvNS can not only validate the predictions of the Standard Model but also explore new physics. In conjunction with other COHERENT detectors, CryoCsI has the potential to achieve world-leading sensitivities in a broad range of physics topics within and beyond the SM. The sensitivities of CryoCsI to hidden-sector dark matter, non-standard neutrino interactions, and neutron radius are explored. This thesis delves into the construction of CryoCsI and efforts to enhance its light yield from 20 to $50 \pm 2$ photoelectrons per keV electron-equivalent (keV$_{ee}$). It will address challenges with cryogenic SiPMs, including inferior energy resolution, optical cross-talk, and potential limitations on detecting rare events. Understanding the light yield of scintillating detectors for nuclear recoils is crucial, as explored through alpha-particle and neutron quenching factor measurements. A QF of approximately 15\% was measured using a neutron beam at the Triangle Universities Nuclear Lab. Proposed solutions to challenges like the overshoot effect observed in PMTs will be discussed. Additionally, the thesis will explore design considerations for minimizing background noise and optimizing the CsI crystal's shape through optical simulations.


title: CHAOS VIII: Far-Ultraviolet Spectra of M101 and The Impact of Wolf-Rayet Stars

abstract: We investigate the stellar and nebular properties of 9 H II regions in the spiral galaxy M101 with far-ultraviolet (FUV; ~900-2000 \r{A}) and optical (~3200-10000 \r{A}) spectra. We detect significant C III] 1907,1909 nebular emission in 7 regions, but O III] 1666 only in the lowest-metallicity region. We produce new analytic functions of the carbon ICF as a function of metallicity in order to perform a preliminary C/O abundance analysis. The FUV spectra also contain numerous stellar emission and P-Cygni features that we fit with luminosity-weighted combinations of single-burst Starburst99 and BPASS models. We find that the best-fit Starburst99 models closely match the observed very-high-ionization P-Cygni features, requiring very-hot, young (~< 3 Myr), metal-enriched massive stars. The youngest stellar populations are strongly correlated with broad He II emission, nitrogen Wolf-Rayet (WR) FUV and optical spectral features, and enhanced N/O gas abundances. Thus, the short-lived WR phase may be driving excess emission in several N P-Cygni wind features (955 \r{A}, 991 \r{A}, 1720 \r{A}) that bias the stellar continuum fits to higher metallicities relative to the gas-phase metallicities. Accurate characterization of these H II regions requires additional inclusion of WR stars in the stellar population synthesis models. Our FUV spectra demonstrate that the ~900-1200 \r{A} FUV can provide a strong test-bed for future WR atmosphere and evolution models.


title: New sector morphologies emerge from anisotropic colony growth

abstract: Competition during range expansions is of great interest from both practical and theoretical view points. Experimentally, range expansions are often studied in homogeneous Petri dishes, which lack spatial anisotropy that might be present in realistic populations. Here, we analyze a model of anisotropic growth, based on coupled Kardar-Parisi-Zhang and Fisher-Kolmogorov-Petrovsky-Piskunov equations that describe surface growth and lateral competition. Compared to a previous study of isotropic growth, anisotropy relaxes a constraint between parameters of the model. We completely characterize spatial patterns and invasion velocities in this generalized model. In particular, we find that strong anisotropy results in a distinct morphology of spatial invasion with a kink in the displaced strain ahead of the boundary between the strains. This morphology of the out-competed strain is similar to a shock wave and serves as a signature of anisotropic growth.


title: Participation in the age of foundation models

abstract: Growing interest and investment in the capabilities of foundation models has positioned such systems to impact a wide array of public services. Alongside these opportunities is the risk that these systems reify existing power imbalances and cause disproportionate harm to marginalized communities. Participatory approaches hold promise to instead lend agency and decision-making power to marginalized stakeholders. But existing approaches in participatory AI/ML are typically deeply grounded in context - how do we apply these approaches to foundation models, which are, by design, disconnected from context? Our paper interrogates this question. First, we examine existing attempts at incorporating participation into foundation models. We highlight the tension between participation and scale, demonstrating that it is intractable for impacted communities to meaningfully shape a foundation model that is intended to be universally applicable. In response, we develop a blueprint for participatory foundation models that identifies more local, application-oriented opportunities for meaningful participation. In addition to the "foundation" layer, our framework proposes the "subfloor'' layer, in which stakeholders develop shared technical infrastructure, norms and governance for a grounded domain, and the "surface'' layer, in which affected communities shape the use of a foundation model for a specific downstream task. The intermediate "subfloor'' layer scopes the range of potential harms to consider, and affords communities more concrete avenues for deliberation and intervention. At the same time, it avoids duplicative effort by scaling input across relevant use cases. Through three case studies in clinical care, financial services, and journalism, we illustrate how this multi-layer model can create more meaningful opportunities for participation than solely intervening at the foundation layer.


title: RANFusion: A Comprehensive Tool for Simulating Handover In Next-G RAN

abstract: The rapid advancement of 5G networks and the upcoming transition to 6G necessitate the use of the Open Radio Access Network (O-RAN) architecture to enable greater flexibility, interoperability, and innovation. This shift towards 6G and O-RAN requires the development of advanced simulation tools for testing, analyzing, and optimizing Radio Access Network (RAN) operations. This need becomes critical due to the complex dynamics of mobility management inherent in the 6G vision and next-generation networks. These networks anticipate advanced handover methods for mobile users, UAVs, IoT devices, and beyond. Addressing this gap, this paper introduces RANFusion: a robust RAN simulator specifically created to explore a variety of handover scenarios and to test and balance resources between users. This tool enables precise simulations for refining handover strategies within RAN and O-RAN environments, thereby ensuring optimal performance and reliability in these advanced network infrastructures.


title: Integrated Communication and Imaging: Design, Analysis, and Performances of COSMIC Waveforms

abstract: This paper proposes a novel waveform design method named COSMIC (Connectivity-Oriented Sensing Method for Imaging and Communication). These waveforms are engineered to convey communication symbols while adhering to an extended orthogonality condition, enabling their use in generating radio images of the environment. A Multiple-Input Multiple-Output (MIMO) Radar-Communication (RadCom) device transmits COSMIC waveforms from each antenna simultaneously within the same time window and frequency band, indicating that orthogonality is not achieved by space, time, or frequency multiplexing. Indeed, orthogonality among the waveforms is achieved by leveraging the degrees of freedom provided by the assumption that the field of view is limited or significantly smaller than the transmitted signals' length. The RadCom device receives and processes the echoes from an infinite number of infinitesimal scatterers within its field of view, constructing an electromagnetic image of the environment. Concurrently, these waveforms can also carry information to other connected network entities. This work provides the algebraic concepts used to generate COSMIC waveforms. Moreover, an opportunistic optimization of the imaging and communication efficiency is discussed. Simulation results demonstrate that COSMIC waveforms enable accurate environmental imaging while maintaining acceptable communication performances.


title: Malliavian differentiablity and smoothness of density for SDES with locally Lipschitz coefficients

abstract: We study Malliavin differentiability for the solutions of a stochastic differential equation with drift of super-linear growth. Assuming we have a monotone drift with polynomial growth, we prove Malliavin differentiability of any order. As a consequence of this result, under the H\"ormander's hypothesis we prove that the density of the solution's law with respect to the Lebesgue measure is infinitely differentiable. To avoid non-integrability problems due to the unbounded drift, we follow an approach based on the concepts of Ray Absolute Continuity and Stochastic Gate\^aux Differentiability.


title: IMEX methods for thin-film equations and Cahn-Hilliard equations with variable mobility

abstract: We explore a class of splitting schemes employing implicit-explicit (IMEX) time-stepping to achieve accurate and energy-stable solutions for thin-film equations and Cahn-Hilliard models with variable mobility. This splitting method incorporates a linear, constant coefficient implicit step, facilitating efficient computational implementation. We investigate the influence of stabilizing splitting parameters on the numerical solution computationally, considering various initial conditions. Furthermore, we generate energy-stability plots for the proposed methods, examining different choices of splitting parameter values and timestep sizes. These methods enhance the accuracy of the original bi-harmonic-modified (BHM) approach, while preserving its energy-decreasing property and achieving second-order accuracy. We present numerical experiments to illustrate the performance of the proposed methods.


title: Caustics of a Paraboloid and Apollonius Problem

abstract: We study caustics of an elliptical paraboloid and the history of their various representations from 3D models in XIX century to the recent computer graphics. In the paper two ways of generating the surface, one with cartesian coordinates using formula for principal curvatures, and the other one with parabolic coordinates using Seidel's formula were demonstrated. By finding the intersection curves of these caustics with the paraboloid we extend the solution of F. Caspari for classical Apollonius problem about the number of concurrent normals to the points of the paraboloid itself. A complete classification of all possible cases of intersections of these caustics with their paraboloid is given.


title: Quantum Algorithms for tensor-SVD

abstract: A promising area of applications for quantum computing is in linear algebra problems. In this work, we introduce two new quantum t-SVD (tensor-SVD) algorithms. The first algorithm is largely based on previous work that proposed a quantum t-SVD algorithm for context-aware recommendation systems. The new algorithm however seeks to address and fix certain drawbacks to the original, and is fundamentally different in its approach compared to the existing work. The second algorithm proposed uses a hybrid variational approach largely based on a known variational quantum SVD algorithm.


title: Online Nonparametric Supervised Learning for Massive Data

abstract: Despite their benefits in terms of simplicity, low computational cost and data requirement, parametric machine learning algorithms, such as linear discriminant analysis, quadratic discriminant analysis or logistic regression, suffer from serious drawbacks including linearity, poor fit of features to the usually imposed normal distribution and high dimensionality. Batch kernel-based nonparametric classifier, which overcomes the linearity and normality of features constraints, represent an interesting alternative for supervised classification problem. However, it suffers from the ``curse of dimension". The problem can be alleviated by the explosive sample size in the era of big data, while large-scale data size presents some challenges in the storage of data and the calculation of the classifier. These challenges make the classical batch nonparametric classifier no longer applicable. This motivates us to develop a fast algorithm adapted to the real-time calculation of the nonparametric classifier in massive as well as streaming data frameworks. This online classifier includes two steps. First, we consider an online principle components analysis to reduce the dimension of the features with a very low computation cost. Then, a stochastic approximation algorithm is deployed to obtain a real-time calculation of the nonparametric classifier. The proposed methods are evaluated and compared to some commonly used machine learning algorithms for real-time fetal well-being monitoring. The study revealed that, in terms of accuracy, the offline (or Batch), as well as, the online classifiers are good competitors to the random forest algorithm. Moreover, we show that the online classifier gives the best trade-off accuracy/computation cost compared to the offline classifier.


title: A Full-duplex Speech Dialogue Scheme Based On Large Language Models

abstract: We present a generative dialogue system capable of operating in a full-duplex manner, allowing for seamless interaction. It is based on a large language model (LLM) carefully aligned to be aware of a perception module, a motor function module, and the concept of a simple finite state machine (called neural FSM) with two states. The perception and motor function modules operate simultaneously, allowing the system to simultaneously speak and listen to the user. The LLM generates textual tokens for inquiry responses and makes autonomous decisions to start responding to, wait for, or interrupt the user by emitting control tokens to the neural FSM. All these tasks of the LLM are carried out as next token prediction on a serialized view of the dialogue in real-time. In automatic quality evaluations simulating real-life interaction, the proposed system reduces the average conversation response latency by more than 3 folds compared with LLM-based half-duplex dialogue systems while responding within less than 500 milliseconds in more than 50% of evaluated interactions. Running a LLM with only 8 billion parameters, our system exhibits a 8% higher interruption precision rate than the best available commercial LLM for voice-based dialogue.


title: Div-curl problem for non-solenoidal flows with infinite energy and no-slip boundary condition

abstract: In the paper we study div-curl problem in exterior domain with given condition on infinity and no-slip boundary condition. We will derive moment relations on vorticity and divergence for uniqueness solvability of the problem and present $L_2$-estimates for solutions.


title: Optimising RF linear Amplifier for maximum efficiency and linearity

abstract: A method for increasing efficiency of radio frequency (RF) amplifier employing laterally diffused metal oxide semiconductor (LDMOS) transistors coupled to an RF exciter depending on the emission mode of modulated RF input signals generated by exciter, if exciter output signal is of a type where modulated RF signals do not have continuously varying envelope, biasing the LDMOS transistor in the RF amplifier with fixed quiescent drain current and fixed drain voltage supply to cause LDMOS transistors to operate in compression and if exciter output signal is of a type where modulated RF signals do have continuously varying envelope, biasing the LDMOS transistors in the RF amplifier for linear operation.


title: Bayesian optimization scheme for the design of a nanofibrous high power target

abstract: High Power Targetry (HPT) R&D is critical in the context of increasing beam intensity and energy for next generation accelerators. Many target concepts and novel materials are being developed and tested for their ability to withstand extreme beam environments; the HPT R&D Group at Fermilab is developing an electrospun nanofiber material for this purpose. The performance of these nanofiber targets is sensitive to their construction parameters, such as the packing density of the fibers. Lowering the density improves the survival of the target, but reduces the secondary particle yield. Optimizing the lifetime and production efficiency of the target poses an interesting design problem, and in this paper we study the applicability of Bayesian optimization to its solution. We first describe how to encode the nanofiber target design problem as the optimization of an objective function, and how to evaluate that function with computer simulations. We then explain the optimization loop setup. Thereafter, we present the optimal design parameters suggested by the algorithm, and close with discussions of limitations and future refinements.


title: Calibration and Validation of a Phase-Field Model of Brittle Fracture within the Damage Mechanics Challenge

abstract: In the context of the Damage Mechanics Challenge, we adopt a phase-field model of brittle fracture to blindly predict the behavior up to failure of a notched three-point-bending specimen loaded under mixed-mode conditions. The beam is additively manufactured using a geo-architected gypsum based on the combination of bassanite and a water-based binder. The calibration of the material parameters involved in the model is based on a set of available independent experimental tests and on a two-stage procedure. In the first stage an estimate of most of the elastic parameters is obtained, whereas the remaining parameters are optimized in the second stage so as to minimize the discrepancy between the numerical predictions and a set of experimental results on notched three-point-bending beams. The good agreement between numerical predictions and experimental results in terms of load-displacement curves and crack paths demonstrates the predictive ability of the model and the reliability of the calibration procedure.


title: TotalSegmentator MRI: Sequence-Independent Segmentation of 59 Anatomical Structures in MR images

abstract: Purpose: To develop an open-source and easy-to-use segmentation model that can automatically and robustly segment most major anatomical structures in MR images independently of the MR sequence. Materials and Methods: In this study we extended the capabilities of TotalSegmentator to MR images. 298 MR scans and 227 CT scans were used to segment 59 anatomical structures (20 organs, 18 bones, 11 muscles, 7 vessels, 3 tissue types) relevant for use cases such as organ volumetry, disease characterization, and surgical planning. The MR and CT images were randomly sampled from routine clinical studies and thus represent a real-world dataset (different ages, pathologies, scanners, body parts, sequences, contrasts, echo times, repetition times, field strengths, slice thicknesses and sites). We trained an nnU-Net segmentation algorithm on this dataset and calculated Dice similarity coefficients (Dice) to evaluate the model's performance. Results: The model showed a Dice score of 0.824 (CI: 0.801, 0.842) on the test set, which included a wide range of clinical data with major pathologies. The model significantly outperformed two other publicly available segmentation models (Dice score, 0.824 versus 0.762; p<0.001 and 0.762 versus 0.542; p<0.001). On the CT image test set of the original TotalSegmentator paper it almost matches the performance of the original TotalSegmentator (Dice score, 0.960 versus 0.970; p<0.001). Conclusion: Our proposed model extends the capabilities of TotalSegmentator to MR images. The annotated dataset (https://zenodo.org/doi/10.5281/zenodo.11367004) and open-source toolkit (https://www.github.com/wasserth/TotalSegmentator) are publicly available.


title: Fast Gaussian Distributed Pseudorandom Number Generation in Java via the Ziggurat Algorithm

abstract: We report on experiments with the ziggurat algorithm for generating Gaussian distributed random numbers. The study utilizes our open source Java implementation that was introduced originally for Java 11 at a time when the Java API only provided the much slower polar method. Our Java implementation of the ziggurat algorithm is a port of the GNU Scientific Library's C implementation. Java 17 introduced a significant overhaul of pseudorandom number generation, including several modern pseudorandom number generators (PRNGs) as well as additional functionality, among which includes switching from the polar method to a modified ziggurat algorithm. In the experiments of this paper, we explore whether there is still a need for our implementation for Java 17+ applications. Our results show that Java 17's modified ziggurat is faster than our implementation for the PRNGs that support it. However, Java 17+ continues to use the polar method for the legacy PRNGs Random, SecureRandom, and ThreadLocalRandom. The linear congruential method of Java's Random class lacks the statistical properties required by Java's modified ziggurat implementation; and SecureRandom and ThreadLocalRandom unfortunately use the polar method as a side-effect of extending Random. Our implementation of the original ziggurat algorithm does not require the same statistical properties of the underlying PRNG as Java 17's optimized version, and can be used with any of these PRNGs, and is especially relevant where pre-Java 17 support is required.


title: Optomechanical entanglement induced by backward stimulated Brillouin scattering

abstract: We propose a scheme to generate robust optomechanical entanglement. This scheme is based on a Backward Stimulated Brillouin Scattering (BSBS) process, which is hosted within an optomechanical structure. Our benchmark system consists of an acoustic (mechanical) mode coupled to two optical modes through the BSBS (radiation pressure) process. For a moderate values of the effective mechanical coupling, the BSBS induces a relatively weak entanglement. This entanglement is greatly enhanced, for at least up to one order of magnitude, when the mechanical coupling strength is strong enough. The generated entanglement is robust enough against thermal fluctuation. Our work provides a new scheme for entanglement generation based on BSBS effect, and can be extended to microwaves and hybrid optomechanical structures. Such a generated entangled states can be used for quantum information processing, quantum sensing, and quantum computing.


title: Qiskit Code Assistant: Training LLMs for generating Quantum Computing Code

abstract: Code Large Language Models (Code LLMs) have emerged as powerful tools, revolutionizing the software development landscape by automating the coding process and reducing time and effort required to build applications. This paper focuses on training Code LLMs to specialize in the field of quantum computing. We begin by discussing the unique needs of quantum computing programming, which differ significantly from classical programming approaches or languages. A Code LLM specializing in quantum computing requires a foundational understanding of quantum computing and quantum information theory. However, the scarcity of available quantum code examples and the rapidly evolving field, which necessitates continuous dataset updates, present significant challenges. Moreover, we discuss our work on training Code LLMs to produce high-quality quantum code using the Qiskit library. This work includes an examination of the various aspects of the LLMs used for training and the specific training conditions, as well as the results obtained with our current models. To evaluate our models, we have developed a custom benchmark, similar to HumanEval, which includes a set of tests specifically designed for the field of quantum computing programming using Qiskit. Our findings indicate that our model outperforms existing state-of-the-art models in quantum computing tasks. We also provide examples of code suggestions, comparing our model to other relevant code LLMs. Finally, we introduce a discussion on the potential benefits of Code LLMs for quantum computing computational scientists, researchers, and practitioners. We also explore various features and future work that could be relevant in this context.


title: Multiphysics Simulations of Thermal Shock Testing of Nanofibrous High Power Targets

abstract: Increase of primary beam power for neutrino beam-lines leads to a reduced lifespan for production targets. New concepts for robust targets are emerging from the field of High Power Targetry (HPT); one idea being investigated by the HPT R&D Group at Fermilab is an electrospun nanofiber target. As part of their evaluation, samples with different densities were sent to the HiRadMat facility at CERN for thermal shock tests. The samples with the higher density, irradiated under a high intensity beam pulse, exhibit major damage at the impact site whereas those with the lower density show no apparent damage. The exact cause of this failure was unclear at the time. In this paper, we present the results of multiphysics simulations of the thermal shock experienced by the nanofiber targets that suggest the failure originates from the reduced permeability of the high density sample to air flow. The air present in the porous target expands due to heating from the beam, but is unable to flow freely in the high density sample, resulting in a larger back pressure that blows apart the nanofiber mat. We close with a discussion on how to further validate this hypothesis.


title: Gaussian Flow Bridges for Audio Domain Transfer with Unpaired Data

abstract: Audio domain transfer is the process of modifying audio signals to match characteristics of a different domain, while retaining the original content. This paper investigates the potential of Gaussian Flow Bridges, an emerging approach in generative modeling, for this problem. The presented framework addresses the transport problem across different distributions of audio signals through the implementation of a series of two deterministic probability flows. The proposed framework facilitates manipulation of the target distribution properties through a continuous control variable, which defines a certain aspect of the target domain. Notably, this approach does not rely on paired examples for training. To address identified challenges on maintaining the speech content consistent, we recommend a training strategy that incorporates chunk-based minibatch Optimal Transport couplings of data samples and noise. Comparing our unsupervised method with established baselines, we find competitive performance in tasks of reverberation and distortion manipulation. Despite encoutering limitations, the intriguing results obtained in this study underscore potential for further exploration.


title: Machine Psychology: Integrating Operant Conditioning with the Non-Axiomatic Reasoning System for Advancing Artificial General Intelligence Research

abstract: This paper introduces an interdisciplinary framework called Machine Psychology, which merges principles from operant learning psychology with a specific Artificial Intelligence model, the Non-Axiomatic Reasoning System (NARS), to enhance Artificial General Intelligence (AGI) research. The core premise of this framework is that adaptation is crucial to both biological and artificial intelligence and can be understood through operant conditioning principles. The study assesses this approach via three operant learning tasks using OpenNARS for Applications (ONA): simple discrimination, changing contingencies, and conditional discrimination tasks. In the simple discrimination task, NARS demonstrated rapid learning, achieving perfect accuracy during both training and testing phases. The changing contingencies task showcased NARS's adaptability, as it successfully adjusted its behavior when task conditions were reversed. In the conditional discrimination task, NARS handled complex learning scenarios effectively, achieving high accuracy by forming and utilizing intricate hypotheses based on conditional cues. These findings support the application of operant conditioning as a framework for creating adaptive AGI systems. NARS's ability to operate under conditions of insufficient knowledge and resources, coupled with its sensorimotor reasoning capabilities, establishes it as a robust model for AGI. The Machine Psychology framework, by incorporating elements of natural intelligence such as continuous learning and goal-driven behavior, offers a scalable and flexible approach for real-world applications. Future research should investigate using enhanced NARS systems, more advanced tasks, and applying this framework to diverse, complex challenges to further progress the development of human-level AI.


title: Momentum for the Win: Collaborative Federated Reinforcement Learning across Heterogeneous Environments

abstract: We explore a Federated Reinforcement Learning (FRL) problem where $N$ agents collaboratively learn a common policy without sharing their trajectory data. To date, existing FRL work has primarily focused on agents operating in the same or ``similar" environments. In contrast, our problem setup allows for arbitrarily large levels of environment heterogeneity. To obtain the optimal policy which maximizes the average performance across all potentially completely different environments, we propose two algorithms: FedSVRPG-M and FedHAPG-M. In contrast to existing results, we demonstrate that both FedSVRPG-M and FedHAPG-M, both of which leverage momentum mechanisms, can exactly converge to a stationary point of the average performance function, regardless of the magnitude of environment heterogeneity. Furthermore, by incorporating the benefits of variance-reduction techniques or Hessian approximation, both algorithms achieve state-of-the-art convergence results, characterized by a sample complexity of $\mathcal{O}\left(\epsilon^{-\frac{3}{2}}/N\right)$. Notably, our algorithms enjoy linear convergence speedups with respect to the number of agents, highlighting the benefit of collaboration among agents in finding a common policy.


title: The Numerical Solution of the External Dirichlet Generalized Harmonic Problem for a Sphere by the Method of Probabilistic Solution

abstract: In the present paper, an algorithm for the numerical solution of the external Dirichlet generalized harmonic problem for a sphere by the method of probabilistic solution (MPS) is given, where generalized indicates that a boundary function has a finite number of first kind discontinuity curves. The algorithm consists of the following main stages: (1) the transition from an infinite domain to a finite domain by an inversion; (2) the consideration of a new Dirichlet generalized harmonic problem on the basis of Kelvin theorem for the obtained finite domain; (3) the numerical solution of the new problem for the finite domain by the MPS, which in turn is based on a computer simulation of the Weiner process; (4) finding the probabilistic solution of the posed generalized problem at any fixed points of the infinite domain by the solution of the new problem. For illustration, numerical examples are considered and results are presented.


title: MDS-ViTNet: Improving saliency prediction for Eye-Tracking with Vision Transformer

abstract: In this paper, we present a novel methodology we call MDS-ViTNet (Multi Decoder Saliency by Vision Transformer Network) for enhancing visual saliency prediction or eye-tracking. This approach holds significant potential for diverse fields, including marketing, medicine, robotics, and retail. We propose a network architecture that leverages the Vision Transformer, moving beyond the conventional ImageNet backbone. The framework adopts an encoder-decoder structure, with the encoder utilizing a Swin transformer to efficiently embed most important features. This process involves a Transfer Learning method, wherein layers from the Vision Transformer are converted by the Encoder Transformer and seamlessly integrated into a CNN Decoder. This methodology ensures minimal information loss from the original input image. The decoder employs a multi-decoding technique, utilizing dual decoders to generate two distinct attention maps. These maps are subsequently combined into a singular output via an additional CNN model. Our trained model MDS-ViTNet achieves state-of-the-art results across several benchmarks. Committed to fostering further collaboration, we intend to make our code, models, and datasets accessible to the public.


title: Vacuum Polarization Effects of Pointlike Impurity

abstract: We develop precise formulation for the effects of vacuum polarization near a pointlike source with a zero-range ($\delta$-like) potential in three spatial dimensions. There are different ways of introducing $\delta$-interaction in the framework of quantum theory. We discuss the approach based on the concept of self-adjoint extensions of densely defined symmetric operators. Within this approach we consider the real massive scalar field in three-dimensional Euclidean space with a single extracted point. Appropriate boundary conditions imposed at this point enable one to consider all self-adjoint extensions of $- \Delta$ as operators which can describe a pointlike source with a zero-range potential. In this framework we compute the renormalized vacuum expectation value of the field square $\langle \phi^{ 2}(x)\rangle_{\rm ren}$ and the renormalized vacuum average of the scalar-field's energy-momentum tensor $\langle T_{\mu\nu}(x)\rangle_{\rm ren}$. Asymptotic cases are discussed in detail.


title: Rearrangement of single atoms in a 2000-site optical tweezers array at cryogenic temperatures

abstract: We report on the trapping of single rubidium atoms in large arrays of optical tweezers comprising up to 2088 sites in a cryogenic environment at 6 K. Our approach relies on the use of microscope objectives that are in-vacuum but at room temperature, in combination with windowless thermal shields into which the objectives are protruding to ensure a cryogenic environment for the trapped atoms. To achieve enough optical power for efficient trapping, we combine two lasers at slightly different wavelengths. We discuss the performance and limitations of our design. Finally, we demonstrate atom-by-atom rearrangement of an 828-atom target array using moving optical tweezers controlled by a field-programmable gate array.


title: MUVERA: Multi-Vector Retrieval via Fixed Dimensional Encodings

abstract: Neural embedding models have become a fundamental component of modern information retrieval (IR) pipelines. These models produce a single embedding $x \in \mathbb{R}^d$ per data-point, allowing for fast retrieval via highly optimized maximum inner product search (MIPS) algorithms. Recently, beginning with the landmark ColBERT paper, multi-vector models, which produce a set of embedding per data point, have achieved markedly superior performance for IR tasks. Unfortunately, using these models for IR is computationally expensive due to the increased complexity of multi-vector retrieval and scoring. In this paper, we introduce MUVERA (MUlti-VEctor Retrieval Algorithm), a retrieval mechanism which reduces multi-vector similarity search to single-vector similarity search. This enables the usage of off-the-shelf MIPS solvers for multi-vector retrieval. MUVERA asymmetrically generates Fixed Dimensional Encodings (FDEs) of queries and documents, which are vectors whose inner product approximates multi-vector similarity. We prove that FDEs give high-quality $\epsilon$-approximations, thus providing the first single-vector proxy for multi-vector similarity with theoretical guarantees. Empirically, we find that FDEs achieve the same recall as prior state-of-the-art heuristics while retrieving 2-5$\times$ fewer candidates. Compared to prior state of the art implementations, MUVERA achieves consistently good end-to-end recall and latency across a diverse set of the BEIR retrieval datasets, achieving an average of 10$\%$ improved recall with $90\%$ lower latency.


title: A Sixteen Multiple-Amplifier-Sensing CCD and Characterization Techniques Targeting The Next Generation of Astronomical Instruments

abstract: This work presents a candidate sensor for future spectroscopic applications, such as a Stage-5 Spectroscopic Survey Experiment or the Habitable Worlds Observatory. This new type of CCD sensor features multiple in-line amplifiers at its output stage allowing multiple measurements of the same charge packet, either in each amplifier and/or in the different amplifiers. Recently, the operation of an 8-amplifier sensor has been experimentally demonstrated, and the operation of a 16-amplifier sensor is presented in this work. This new sensor enables a noise level of approximately $1^e_{\rm rms}$ with a single sample per amplifier. Additionally, it is shown that sub-electron noise can be achieved using multiple samples per amplifier. In addition to demonstrating the performance of the 16-amplifier sensor, this work aims to create a framework for future analysis and performance optimization of this type of detectors. New models and techniques are presented to characterize specific parameters, which are absent in conventional CCDs and Skipper-CCDs: charge transfer between amplifiers and independent and common noise in the amplifiers, and their processing.


title: Towards higher Frobenius functors for symmetric tensor categories

abstract: We develop theory and examples of monoidal functors on tensor categories in positive characteristic that generalise the Frobenius functor from \cite{Os, EOf, Tann}. The latter has proved to be a powerful tool in the ongoing classification of tensor categories of moderate growth, and we demonstrate the similar potential of the generalisations. More explicitly, we describe a new construction of the generalised Verlinde categories $Ver_{p^n}$ in terms of representation categories of elementary abelian $p$-groups. This leads to families of functors relating to $Ver_{p^n}$ that we conjecture, and partially show, to exhibit the characteristic properties of the Frobenius functor relating to $Ver_p$.


title: Data-Efficient Discovery of Hyperelastic TPMS Metamaterials with Extreme Energy Dissipation

abstract: Triply periodic minimal surfaces (TPMS) are a class of metamaterials with a variety of applications and well-known primitives. We present a new method for discovering novel microscale TPMS structures with exceptional energy-dissipation capabilities, achieving double the energy absorption of the best existing TPMS primitive structure. Our approach employs a parametric representation, allowing seamless interpolation between structures and representing a rich TPMS design space. We show that simulations are intractable for optimizing microscale hyperelastic structures, and instead propose a sample-efficient computational strategy for rapidly discovering structures with extreme energy dissipation using limited amounts of empirical data from 3D-printed and tested microscale metamaterials. This strategy ensures high-fidelity results but involves time-consuming 3D printing and testing. To address this, we leverage an uncertainty-aware Deep Ensembles model to predict microstructure behaviors and identify which structures to 3D-print and test next. We iteratively refine our model through batch Bayesian optimization, selecting structures for fabrication that maximize exploration of the performance space and exploitation of our energy-dissipation objective. Using our method, we produce the first open-source dataset of hyperelastic microscale TPMS structures, including a set of novel structures that demonstrate extreme energy dissipation capabilities. We show several potential applications of these structures in protective equipment and bone implants.


title: The hot spots conjecture for some non-convex polygons

abstract: We give an elementary new proof of the hot spots conjecture for L-shaped domains. This result, in addition to a new eigenvalue inequality, allows us to locate the hot spots in Swiss cross translation surfaces. We then prove, in several cases, that first mixed Dirichlet-Neumann eigenfunctions of the Laplacian on L-shaped domains also have no interior critical points. As a combination of these results, we prove the hot spots conjecture for five classes of domains tiled by L-shaped domains, including a class of non-simply connected domains. An interesting feature of the proofs is that we make positive use of the lack of regularity of eigenfunctions on non-convex polygons.


title: Leveraging partial stragglers within gradient coding

abstract: Within distributed learning, workers typically compute gradients on their assigned dataset chunks and send them to the parameter server (PS), which aggregates them to compute either an exact or approximate version of $\nabla L$ (gradient of the loss function $L$). However, in large-scale clusters, many workers are slower than their promised speed or even failure-prone. A gradient coding solution introduces redundancy within the assignment of chunks to the workers and uses coding theoretic ideas to allow the PS to recover $\nabla L$ (exactly or approximately), even in the presence of stragglers. Unfortunately, most existing gradient coding protocols are inefficient from a computation perspective as they coarsely classify workers as operational or failed; the potentially valuable work performed by slow workers (partial stragglers) is ignored. In this work, we present novel gradient coding protocols that judiciously leverage the work performed by partial stragglers. Our protocols are efficient from a computation and communication perspective and numerically stable. For an important class of chunk assignments, we present efficient algorithms for optimizing the relative ordering of chunks within the workers; this ordering affects the overall execution time. For exact gradient reconstruction, our protocol is around $2\times$ faster than the original class of protocols and for approximate gradient reconstruction, the mean-squared-error of our reconstructed gradient is several orders of magnitude better.


title: Significant mutual inclinations between the stellar spin and the orbits of both planets in the HAT-P-11 system

abstract: Planet-star and planet-planet obliquity encode a planetary system's dynamical history, but both obliquities are hard to measure for misaligned systems with close-in companions. HAT-P-11 is a K4 star with two known planets: a close-in, misaligned super-Neptune with a approx 5-day orbit, and an outer super-Jupiter with a approx 10-year orbit. In this work we present a joint orbit fit of HAT-P-11 system with astrometry and RV data. By combining our results with previous constraints on the orientation of the star and the inner planet, we find that all three angular momenta -- those of the star, planet b, and planet c -- are significantly misaligned. We confirm the status of planet c as a super-Jupiter, with 3.06 pm 0.42 Jupiter mass, at a semimajor axis of 4.192 pm 0.07 AU, and planet b's minimum mass of 0.073 pm 0.0053 Jupiter mass. We present the posterior probability distribution of obliquity between star A and planet c, and between planet b and planet c.


title: Planet-Planet Scattering and ZLK Migration -- The Dynamical History of HAT-P-11

abstract: The two planets of the HAT-P-11 system represent fascinating dynamical puzzles due to their significant eccentricities and orbital misalignments. In particular, HAT-P-11 b is on a close-in orbit that tides should have circularized well within the age of the system. Here we propose a two-step dynamical process that can reproduce all intriguing aspects of the system. We first invoke planet-planet scattering to generate significant eccentricities and mutual inclinations between the planets. We then propose that this misalignment initiated von-Zeipel-Lidov-Kozai cycles and high-eccentricity migration that ultimately brought HAT-P-11 b to its present-day orbit. We find that this scenario is fully consistent only when significant tidally-driven radius inflation is accounted for during the tidal migration. We present a suite of N-body simulations exploring each phase of evolution and show that this scenario is consistent with all observational posteriors and the reported age of the system.


title: Phase-sensitive pump-probe measurement of the complex nonlinear susceptibility of silicon across the direct band edge

abstract: Pump-probe supercontinuum (SC) spectral interferometry in reflection is used to measure time-dependent variations in the complex dielectric function ($n$, $k$) over the visible wavelength range in bulk silicon. Changes in $n$ ($\Delta n$) due to a near infrared pump pulse are derived from transient fluctuations in the reflected SC probe amplitude, as is measured in conventional pump-probe experiments. Additionally, modifications to $k$ ($\Delta k$) are derived from phase shifts in the reflected SC. The ultrafast response is attributed to two-photon absorption ($\Delta k$) and the optical Kerr effect ($\Delta n$), enabling measurement of effective two-photon ($\beta$) and Kerr ($n_2$) coefficients. The onset of strong two-photon absorption as the two-photon energy is tuned through the $E_1$ = 3.4 eV direct band edge of silicon is observed for the first time to our knowledge. These constitute the first measurements of the complex nonlinear response of a bulk medium from reflectivity alone. The technique allows straightforward spectroscopic measurements of the $\chi^{(3)}$ nonlinear response at the surface of absorbing materials.


title: Decentralized Optimization in Time-Varying Networks with Arbitrary Delays

abstract: We consider a decentralized optimization problem for networks affected by communication delays. Examples of such networks include collaborative machine learning, sensor networks, and multi-agent systems. To mimic communication delays, we add virtual non-computing nodes to the network, resulting in directed graphs. This motivates investigating decentralized optimization solutions on directed graphs. Existing solutions assume nodes know their out-degrees, resulting in limited applicability. To overcome this limitation, we introduce a novel gossip-based algorithm, called DT-GO, that does not need to know the out-degrees. The algorithm is applicable in general directed networks, for example networks with delays or limited acknowledgment capabilities. We derive convergence rates for both convex and non-convex objectives, showing that our algorithm achieves the same complexity order as centralized Stochastic Gradient Descent. In other words, the effects of the graph topology and delays are confined to higher-order terms. Additionally, we extend our analysis to accommodate time-varying network topologies. Numerical simulations are provided to support our theoretical findings.

categories: cs.LG cs.DC cs.SY eess.SY math.OC stat.ML


title: Wavefront Threading Enables Effective High-Level Synthesis

abstract: Digital systems are growing in importance and computing hardware is growing more heterogeneous. Hardware design, however, remains laborious and expensive, in part due to the limitations of conventional hardware description languages (HDLs) like VHDL and Verilog. A longstanding research goal has been programming hardware like software, with high-level languages that can generate efficient hardware designs. This paper describes Kanagawa, a language that takes a new approach to combine the programmer productivity benefits of traditional High-Level Synthesis (HLS) approaches with the expressibility and hardware efficiency of Register-Transfer Level (RTL) design. The language's concise syntax, matched with a hardware design-friendly execution model, permits a relatively simple toolchain to map high-level code into efficient hardware implementations.


title: Space charge dominated momentum spread and compensation strategies in the post-linac section of Proton Improvement Plan-II at Fermilab

abstract: The upcoming Proton Improvement Plan-II (PIP-II), designated for enhancements to the Fermilab accelerator complex, features a new 800 MeV superconducting linac and a Beam Transfer Line (BTL) to transport the beam to the existing Booster synchrotron. To mitigate the space charge tune shift associated with a high intensity accumulated beam, the low emittance linac beam is used to paint the ring phase space both transversely and longitudinally. To prevent losses caused by particles injected outside the rf separatrix while painting longitudinal phase space, the momentum spread of the incoming beam should not exceed 2.1 x 10^-4. Detailed simulations showed that due to space charge, the rms momentum spread increases to 4 x 10^-4 while it is transported in the BTL --about twice the allowable limit. In this paper, we outline a mitigation strategy involving a debuncher cavity. We discuss location, operating frequency, and gap voltage under both nominal and perturbed beam conditions, specifically accounting for momentum jitter. The impact of cavity misalignments is also assessed. The paper concludes by recommending an optimized configuration.


title: Enabling Visual Recognition at Radio Frequency

abstract: This paper introduces PanoRadar, a novel RF imaging system that brings RF resolution close to that of LiDAR, while providing resilience against conditions challenging for optical signals. Our LiDAR-comparable 3D imaging results enable, for the first time, a variety of visual recognition tasks at radio frequency, including surface normal estimation, semantic segmentation, and object detection. PanoRadar utilizes a rotating single-chip mmWave radar, along with a combination of novel signal processing and machine learning algorithms, to create high-resolution 3D images of the surroundings. Our system accurately estimates robot motion, allowing for coherent imaging through a dense grid of synthetic antennas. It also exploits the high azimuth resolution to enhance elevation resolution using learning-based methods. Furthermore, PanoRadar tackles 3D learning via 2D convolutions and addresses challenges due to the unique characteristics of RF signals. Our results demonstrate PanoRadar's robust performance across 12 buildings.


title: High-pressure characterization of Ag$_3$AuTe$_2$: Implications for strain-induced band tuning

abstract: Recent band structure calculations have suggested the potential for band tuning in a chiral semiconductor, Ag$_3$AuTe$_2$, to zero upon application of negative strain. In this study, we report on the synthesis of polycrystalline Ag$_3$AuTe$_2$ and investigate its transport, optical properties, and pressure compatibility. Transport measurements reveal the semiconducting behavior of Ag$_3$AuTe$_2$ with high resistivity and an activation energy $E_a$ of 0.2 eV. The optical band gap determined by diffuse reflectance measurements is about three times wider than the experimental $E_a$. Despite the difference, both experimental gaps fall within the range of predicted band gaps by our first-principles DFT calculations employing the PBE and mBJ methods. Furthermore, our DFT simulations predict a progressive narrowing of the band gap under compressive strain, with a full closure expected at a strain of -4% relative to the lattice parameter. To evaluate the feasibility of gap tunability at such substantial strain, the high-pressure behavior of Ag$_3$AuTe$_2$ was investigated by $in$ $situ$ high-pressure X-ray diffraction up to 47 GPa. Mechanical compression beyond 4% resulted in a pressure-induced structural transformation, indicating the possibilities of substantial gap modulation under extreme compression conditions.


title: Exploring the Potential of Hybrid Machine-Learning/Physics-Based Modeling for Atmospheric/Oceanic Prediction Beyond the Medium Range

abstract: This paper explores the potential of a hybrid modeling approach that combines machine learning (ML) with conventional physics-based modeling for weather prediction beyond the medium range. It extends the work of Arcomano et al. (2022), which tested the approach for short- and medium-range weather prediction, and the work of Arcomano et al. (2023), which investigated its potential for climate modeling. The hybrid model used for the forecast experiments of the paper is based on the low-resolution, simplified parameterization atmospheric general circulation model (AGCM) SPEEDY. In addition to the hybridized prognostic variables of SPEEDY, the current version of the model has three purely ML-based prognostic variables. One of these is 6~h cumulative precipitation, another is the sea surface temperature, while the third is the heat content of the top 300 m deep layer of the ocean. The model has skill in predicting the El Ni\~no cycle and its global teleconnections with precipitation for 3-7 months depending on the season. The model captures equatorial variability of the precipitation associated with Kelvin and Rossby waves and MJO. Predictions of the precipitation in the equatorial region have skill for 15 days in the East Pacific and 11.5 days in the West Pacific. Though the model has low spatial resolution, for these tasks it has prediction skill comparable to what has been published for high-resolution, purely physics-based, conventional operational forecast models.


title: Two-layer retrieval augmented generation framework for low-resource medical question-answering: proof of concept using Reddit data

abstract: Retrieval augmented generation (RAG) provides the capability to constrain generative model outputs, and mitigate the possibility of hallucination, by providing relevant in-context text. The number of tokens a generative large language model (LLM) can incorporate as context is finite, thus limiting the volume of knowledge from which to generate an answer. We propose a two-layer RAG framework for query-focused answer generation and evaluate a proof-of-concept for this framework in the context of query-focused summary generation from social media forums, focusing on emerging drug-related information. The evaluations demonstrate the effectiveness of the two-layer framework in resource constrained settings to enable researchers in obtaining near real-time data from users.


title: MXene's Surface Functionalization Patterns and Their Impacts on Magnetism

abstract: Two-dimensional transition metal carbides and nitrides (MXenes) are a perspective group of materials with a broad palette of applications. Surface terminations are a product of the MXene preparation, and post-processing can also lead to partial coverage. Despite applicability and fundamental properties being driven by termination patterns, it is not fully clear, how they behave on MXene surfaces with various degrees of surface coverage. Here, as the first step, we used density functional theory to predict possible patterns in prototypic Ti$_2$C MXene, demonstrating the different behavior of the two most frequent terminal atoms, oxygen, and fluorine. Oxygen (with formal charge -2$e$) prefers a zigzag line both-side adsorption pattern on bare Ti$_2$C, attracting the next adsorbent to a minimal distance. Oxygen defects in fully O-terminated MXene tend to form similar zigzag line vacancy patterns. On the other hand, fluorine (with a formal charge of -1$e$) prefers one-side flake (island) adsorption on bare Ti$_2$C and a similar desorption style from fully fluorinated Ti$_2$C. MXene magnetic behavior is subsequently driven by the patterns, either compensating locally and holding the global magnetic state of the MXene until some limit (oxygen case) or gradually increasing total magnetism by summing of local effects (fluorine case). The systematic combinatoric study of Ti$_2$CT$_x$ with various coverages ($0 \leq x \leq 2$) of distinct terminal atoms T = O or F brings encouraging possibilities of tunable behavior of MXenes and provides useful guidance for its modeling towards electronic nanodevices.


title: Crowdsourcing with Difficulty: A Bayesian Rating Model for Heterogeneous Items

abstract: In applied statistics and machine learning, the "gold standards" used for training are often biased and almost always noisy. Dawid and Skene's justifiably popular crowdsourcing model adjusts for rater (coder, annotator) sensitivity and specificity, but fails to capture distributional properties of rating data gathered for training, which in turn biases training. In this study, we introduce a general purpose measurement-error model with which we can infer consensus categories by adding item-level effects for difficulty, discriminativeness, and guessability. We further show how to constrain the bimodal posterior of these models to avoid (or if necessary, allow) adversarial raters. We validate our model's goodness of fit with posterior predictive checks, the Bayesian analogue of $\chi^2$ tests. Dawid and Skene's model is rejected by goodness of fit tests, whereas our new model, which adjusts for item heterogeneity, is not rejected. We illustrate our new model with two well-studied data sets, binary rating data for caries in dental X-rays and implication in natural language.


title: Artificial Intelligence Index Report 2024

abstract: The 2024 Index is our most comprehensive to date and arrives at an important moment when AI's influence on society has never been more pronounced. This year, we have broadened our scope to more extensively cover essential trends such as technical advancements in AI, public perceptions of the technology, and the geopolitical dynamics surrounding its development. Featuring more original data than ever before, this edition introduces new estimates on AI training costs, detailed analyses of the responsible AI landscape, and an entirely new chapter dedicated to AI's impact on science and medicine. The AI Index report tracks, collates, distills, and visualizes data related to artificial intelligence (AI). Our mission is to provide unbiased, rigorously vetted, broadly sourced data in order for policymakers, researchers, executives, journalists, and the general public to develop a more thorough and nuanced understanding of the complex field of AI. The AI Index is recognized globally as one of the most credible and authoritative sources for data and insights on artificial intelligence. Previous editions have been cited in major newspapers, including the The New York Times, Bloomberg, and The Guardian, have amassed hundreds of academic citations, and been referenced by high-level policymakers in the United States, the United Kingdom, and the European Union, among other places. This year's edition surpasses all previous ones in size, scale, and scope, reflecting the growing significance that AI is coming to hold in all of our lives.


title: Comparison of Point Process Learning and its special case Takacs-Fiksel estimation

abstract: Recently, Cronie et al. (2024) introduced the notion of cross-validation for point processes and a new statistical methodology called Point Process Learning (PPL). In PPL one splits a point process/pattern into a training and a validation set, and then predicts the latter from the former through a parametrised Papangelou conditional intensity. The model parameters are estimated by minimizing a point process prediction error; this notion was introduced as the second building block of PPL. It was shown that PPL outperforms the state-of-the-art in both kernel intensity estimation and estimation of the parameters of the Gibbs hard-core process. In the latter case, the state-of-the-art was represented by pseudolikelihood estimation. In this paper we study PPL in relation to Takacs-Fiksel estimation, of which pseudolikelihood is a special case. We show that Takacs-Fiksel estimation is a special case of PPL in the sense that PPL with a specific loss function asymptotically reduces to Takacs-Fiksel estimation if we let the cross-validation regime tend to leave-one-out cross-validation. Moreover, PPL involves a certain type of hyperparameter given by a weight function which ensures that the prediction errors have expectation zero if and only if we have the correct parametrisation. We show that the weight function takes an explicit but intractable form for general Gibbs models. Consequently, we propose different approaches to estimate the weight function in practice. In order to assess how the general PPL setup performs in relation to its special case Takacs-Fiksel estimation, we conduct a simulation study where we find that for common Gibbs models we can find loss functions and hyperparameters so that PPL typically outperforms Takacs-Fiksel estimation significantly in terms of mean square error. Here, the hyperparameters are the cross-validation parameters and the weight function estimate.


title: AI Risk Management Should Incorporate Both Safety and Security

abstract: The exposure of security vulnerabilities in safety-aligned language models, e.g., susceptibility to adversarial attacks, has shed light on the intricate interplay between AI safety and AI security. Although the two disciplines now come together under the overarching goal of AI risk management, they have historically evolved separately, giving rise to differing perspectives. Therefore, in this paper, we advocate that stakeholders in AI risk management should be aware of the nuances, synergies, and interplay between safety and security, and unambiguously take into account the perspectives of both disciplines in order to devise mostly effective and holistic risk mitigation approaches. Unfortunately, this vision is often obfuscated, as the definitions of the basic concepts of "safety" and "security" themselves are often inconsistent and lack consensus across communities. With AI risk management being increasingly cross-disciplinary, this issue is particularly salient. In light of this conceptual challenge, we introduce a unified reference framework to clarify the differences and interplay between AI safety and AI security, aiming to facilitate a shared understanding and effective collaboration across communities.


title: Lifelong Learning Using a Dynamically Growing Tree of Sub-networks for Domain Generalization in Video Object Segmentation

abstract: Current state-of-the-art video object segmentation models have achieved great success using supervised learning with massive labeled training datasets. However, these models are trained using a single source domain and evaluated using videos sampled from the same source domain. When these models are evaluated using videos sampled from a different target domain, their performance degrades significantly due to poor domain generalization, i.e., their inability to learn from multi-domain sources simultaneously using traditional supervised learning. In this paper, We propose a dynamically growing tree of sub-networks (DGT) to learn effectively from multi-domain sources. DGT uses a novel lifelong learning technique that allows the model to continuously and effectively learn from new domains without forgetting the previously learned domains. Hence, the model can generalize to out-of-domain videos. The proposed work is evaluated using single-source in-domain (traditional video object segmentation), multi-source in-domain, and multi-source out-of-domain video object segmentation. The results of DGT show a single source in-domain performance gain of 0.2% and 3.5% on the DAVIS16 and DAVIS17 datasets, respectively. However, when DGT is evaluated using in-domain multi-sources, the results show superior performance compared to state-of-the-art video object segmentation and other lifelong learning techniques with an average performance increase in the F-score of 6.9% with minimal catastrophic forgetting. Finally, in the out-of-domain experiment, the performance of DGT is 2.7% and 4% better than state-of-the-art in 1 and 5-shots, respectively.


title: On decay and regularity of solutions to the modified 2D Zakharov-Kuznetsov equation

abstract: This work is devoted to study the relation between regularity and decay for solutions of the two-dimensional modified Zakharov-Kuznetsov equation in the weighted Sobolev spaces $Z_{s,(r_1,r_2)}:=H^s(\R^2)\cap L^2((1+|x|^{2r_1}+|y|^{2r_2})dxdy)$.