title: AT2018fyk: Candidate Tidal Disruption Event by a (Super)massive Black Hole Binary

abstract: The tidal disruption event (TDE) AT2018fyk has unusual X-ray, UV, and optical light curves that decay over the first $\sim$600d, rebrighten, and decay again around 1200d. We explain this behavior as a one-off TDE associated with a massive black hole (BH) \emph{binary}. The sharp drop-offs from $t^{-5/3}$ power laws at around 600d naturally arise when one BH interrupts the debris fallback onto the other BH. The BH mass $M_\bullet$ derived from fitting X-ray spectra with a slim disk accretion model and, independently, from fitting the early UV/optical light curves, is smaller by two orders of magnitude than predicted from the $M_\bullet$--$\sigma_*$ host galaxy relation, suggesting that the debris is accreted onto the secondary, with fallback cut off by the primary. Furthermore, if the rebrightening were associated with the primary, it should occur around 5000d, not the observed 1200d. The secondary's mass and dimensionless spin is $M_{\bullet,{\rm s}}=2.7^{+0.5}_{-1.5} \times 10^5 M_\odot$ and $a_{\bullet,{\rm s}}>0.3$ (X-ray spectral fitting), while the primary's mass is $M_{\bullet,{\rm p}}=10^{7.7\pm0.4}M_\odot$ ($M_\bullet$-$\sigma_*$ relation). An intermediate mass BH secondary is consistent with the observed UV/optical light curve decay, i.e., the secondary's outer accretion disk is too faint to produce a detectable emission floor. The time of the first accretion cutoff constrains the binary separation to be $(6.7\pm 1.2) \times 10^{-3}~{\rm pc}$. X-ray spectral fitting and timing analysis indicate that the hard X-rays arise from a corona above the secondary's disk. The early UV/optical emission, suggesting a super-Eddington phase for the secondary, possibly originates from shocks arising from debris circularization.


title: Racial and Ethnic Disparities in Mortgage Lending: New Evidence from Expanded HMDA Data

abstract: This paper investigates gaps in access to and the cost of housing credit by race and ethnicity using the near universe of U.S. mortgage applications. Our data contain borrower creditworthiness variables that have historically been absent from industry-wide application data and that are likely to affect application approval and loan pricing. We find large unconditional disparities in approval and pricing between racial and ethnic groups. After conditioning on key elements of observable borrower creditworthiness, these disparities are smaller but remain economically meaningful. Sensitivity analysis indicates that omitted factors as predictive of approval/pricing and race/ethnicity as credit score can explain some of the pricing disparities but cannot explain the approval disparities. Taken together, our results suggest that credit score, income, and down payment requirements significantly contribute to disparities in mortgage access and affordability but that other systemic barriers are also responsible for a large share of disparate outcomes in the mortgage market.


title: Higher-order asymptotic profiles of solutions to the Cauchy problem for the convection-diffusion equation with variable diffusion

abstract: We consider the asymptotic behavior of solutions to the convection-diffusion equation: \[ \partial_t u - \mathrm{div}\left(a(x)\nabla u\right) = d\cdot\nabla \left(\left\lvert u\right\rvert ^{q-1}u\right), \ \ x \in \mathbb{R}^n, \ t>0 \] with an integrable initial data $u_{0}(x)$, where $n\ge1$, $q>1+\frac{1}{n}$ and $d\in \mathbb{R}^{n}$. Moreover, we take $a(x)=1+b(x)>0$, where $b(x)$ is smooth and decays fast enough at spatial infinity. It is known that the asymptotic profile of the solution to this problem can be given by the heat kernel. Moreover, the second asymptotic profile of the solution have already been studied. In particular, the following three cases are distinguished: $1+\frac{1}{n}<q<1+\frac{2}{n}$; $q=1+\frac{2}{n}$; $q>1+\frac{2}{n}$. More precisely, the second asymptotic profile has different properties in each of these three cases. In this paper, we focus on the critical case of $q=1+\frac{2}{n}$. By analyzing the corresponding integral equation in details, we have succeeded to give the more higher-order asymptotic expansion of the solution, which generalizes the previous works.


title: Data-driven modeling of the aerodynamic deformation and drag for a freely moving drop in the sub-critical Weber number regime

abstract: Accurate prediction of the dynamics and deformation of freely moving drops is crucial for numerous droplet applications. When the Weber number is finite but below a critical value, the drop deviates from its spherical shape and deforms as it is accelerated by the gas stream. Since aerodynamic drag on the drop depends on its shape oscillation, accurately modeling the drop shape evolution is essential for predicting the drop's velocity and position. In this study, 2D axisymmetric interface-resolved simulations were performed to provide a comprehensive dataset for developing a data-driven model. Parametric simulations were conducted by systematically varying the drop diameter and free-stream velocity, achieving wide ranges of Weber and Reynolds numbers. The instantaneous drop shapes obtained in simulations are characterized by spherical harmonics. Temporal data of the drag and modal coefficients are collected from the simulation data to train a Nonlinear Auto-Regressive models with eXogenous inputs (NARX) neural network model. The overall model consists of two multi-layer perceptron networks, which predict the modal coefficients and the drop drag, respectively. The drop shape can be reconstructed with the predicted modal coefficients. The model predictions are validated against the simulation data in the testing set, showing excellent agreement for the evolutions of both the drop shape and drag.


title: Controllability of the Periodic Quantum Ising Spin Chain

abstract: In this paper, we present a controllability analysis of the quantum Ising periodic chain of n spin 1/2 particles where the interpolating parameter between the two Hamiltonians plays the role of the control. A fundamental result in the control theory of quantum systems states that the set of achievable evolutions is (dense in) the Lie group corresponding to the Lie algebra generated by the Hamiltonians of the system. Such a dynamical Lie algebra therefore characterizes all the state transitions available for a given system. For the Ising spin periodic chain we characterize such a dynamical Lie algebra and therefore the set of all reachable states. In particular, we prove that the dynamical Lie algebra is a (3n-1)-dimensional Lie sub-algebra of su(2^n) which is a direct sum of a two dimensional center and a (3n-3)-dimensional semisimple Lie subalgebra. This in turn is the direct sum of n-1 Lie algebras isomorphic to su(2) parametrized by the eigenvalues of a fixed matrix. We display the basis for each of these Lie subalgebras. Therefore the problem of control for the Ising spin periodic chain is, modulo the two dimensional center, a problem of simultaneous control of n-1 spin 1/2 particles. In the process of proving this result, we develop some tools which are of general interest for the controllability analysis of quantum systems with symmetry.


title: Characterising the Creative Process in Humans and Large Language Models

abstract: Large language models appear quite creative, often performing on par with the average human on creative tasks. However, research on LLM creativity has focused solely on \textit{products}, with little attention on the creative \textit{process}. Process analyses of human creativity often require hand-coded categories or exploit response times, which do not apply to LLMs. We provide an automated method to characterise how humans and LLMs explore semantic spaces on the Alternate Uses Task, and contrast with behaviour in a Verbal Fluency Task. We use sentence embeddings to identify response categories and compute semantic similarities, which we use to generate jump profiles. Our results corroborate earlier work in humans reporting both persistent (deep search in few semantic spaces) and flexible (broad search across multiple semantic spaces) pathways to creativity, where both pathways lead to similar creativity scores. LLMs were found to be biased towards either persistent or flexible paths, that varied across tasks. Though LLMs as a population match human profiles, their relationship with creativity is different, where the more flexible models score higher on creativity. Our dataset and scripts are available on \href{https://github.com/surabhisnath/Creative_Process}{GitHub}.


title: LidaRF: Delving into Lidar for Neural Radiance Field on Street Scenes

abstract: Photorealistic simulation plays a crucial role in applications such as autonomous driving, where advances in neural radiance fields (NeRFs) may allow better scalability through the automatic creation of digital 3D assets. However, reconstruction quality suffers on street scenes due to largely collinear camera motions and sparser samplings at higher speeds. On the other hand, the application often demands rendering from camera views that deviate from the inputs to accurately simulate behaviors like lane changes. In this paper, we propose several insights that allow a better utilization of Lidar data to improve NeRF quality on street scenes. First, our framework learns a geometric scene representation from Lidar, which is fused with the implicit grid-based representation for radiance decoding, thereby supplying stronger geometric information offered by explicit point cloud. Second, we put forth a robust occlusion-aware depth supervision scheme, which allows utilizing densified Lidar points by accumulation. Third, we generate augmented training views from Lidar points for further improvement. Our insights translate to largely improved novel view synthesis under real driving scenes.


title: Using Schema to Inform Method Design Practices

abstract: There are many different forms of design knowledge that guide and shape a designer's ability to act and realize potential realities. Methods and schemas are examples of design knowledge commonly used by design researchers and designers alike. In this pictorial, we explore, engage, and describe the role of schemas as tools that can support design researchers in formulating methods to support design action, with our framing of method design specifically focused on ethical design complexity. We present four ways for method designers to engage with schema: 1) Systems to operationalize complex design constructs such as ethical design complexity through an A.E.I.O.YOU schema; 2) Classifiers to map existing methods and identify the possibility for new methods through descriptive semantic differentials; 3) Tools that enable the creation of methods that relate to one or more elements of the schema through creative departures from research to design; and 4) Interactive channels to playfully engage potential and new opportunities through schema interactivity.


title: MESA: Cooperative Meta-Exploration in Multi-Agent Learning through Exploiting State-Action Space Structure

abstract: Multi-agent reinforcement learning (MARL) algorithms often struggle to find strategies close to Pareto optimal Nash Equilibrium, owing largely to the lack of efficient exploration. The problem is exacerbated in sparse-reward settings, caused by the larger variance exhibited in policy learning. This paper introduces MESA, a novel meta-exploration method for cooperative multi-agent learning. It learns to explore by first identifying the agents' high-rewarding joint state-action subspace from training tasks and then learning a set of diverse exploration policies to "cover" the subspace. These trained exploration policies can be integrated with any off-policy MARL algorithm for test-time tasks. We first showcase MESA's advantage in a multi-step matrix game. Furthermore, experiments show that with learned exploration policies, MESA achieves significantly better performance in sparse-reward tasks in several multi-agent particle environments and multi-agent MuJoCo environments, and exhibits the ability to generalize to more challenging tasks at test time.


title: A Named Entity Recognition and Topic Modeling-based Solution for Locating and Better Assessment of Natural Disasters in Social Media

abstract: Over the last decade, similar to other application domains, social media content has been proven very effective in disaster informatics. However, due to the unstructured nature of the data, several challenges are associated with disaster analysis in social media content. To fully explore the potential of social media content in disaster informatics, access to relevant content and the correct geo-location information is very critical. In this paper, we propose a three-step solution to tackling these challenges. Firstly, the proposed solution aims to classify social media posts into relevant and irrelevant posts followed by the automatic extraction of location information from the posts' text through Named Entity Recognition (NER) analysis. Finally, to quickly analyze the topics covered in large volumes of social media posts, we perform topic modeling resulting in a list of top keywords, that highlight the issues discussed in the tweet. For the Relevant Classification of Twitter Posts (RCTP), we proposed a merit-based fusion framework combining the capabilities of four different models namely BERT, RoBERTa, Distil BERT, and ALBERT obtaining the highest F1-score of 0.933 on a benchmark dataset. For the Location Extraction from Twitter Text (LETT), we evaluated four models namely BERT, RoBERTa, Distil BERTA, and Electra in an NER framework obtaining the highest F1-score of 0.960. For topic modeling, we used the BERTopic library to discover the hidden topic patterns in the relevant tweets. The experimental results of all the components of the proposed end-to-end solution are very encouraging and hint at the potential of social media content and NLP in disaster management.


title: Adjoint-based goal-oriented implicit shock tracking using full space mesh optimization

abstract: Solutions to the governing partial differential equations obtained from a discrete numerical scheme can have significant errors, especially near shocks when the discrete representation of the solution cannot fully capture the discontinuity in the solution. A recent approach to shock tracking [1, 2] has been to implicitly align the faces of mesh elements with the shock, yielding accurate solutions on coarse meshes. In engineering applications, the solution field is often used to evaluate a scalar functional of interest, such as lift or drag over an airfoil. While functionals are sensitive to errors in the flow solution, certain regions in the domain are more important for accurate evaluation of the functional than the rest. Using this fact, we formulate a goal-oriented implicit shock tracking approach that captures a segment of the shock that is important for evaluating the functional. Shock tracking is achieved using Lagrange-Newton-Krylov-Schur (LNKS) full space optimizer, with the objective of minimizing the adjoint-weighted residual error indicator. We also present a method to evaluate the sensitivity and the Hessian of the functional error. Using available block preconditioners for LNKS [3, 4] makes the full space approach scalable. The method is applied to test cases of two-dimensional advection and inviscid compressible flows to demonstrate functional-dependent shock tracking. Tracking the entire shock without using artificial dissipation results in the error converging at the orders of $\mathcal{O}(h^{p+1})$.


title: Properties of Charge Recombination in Liquid Argon

abstract: Liquid argon is an excellent medium for detecting particles, given its yields and transport properties of light and charge. The technology of liquid argon time projection chambers has reached its full maturity after four decades of continuous developments and is, or will be, used in world class experiments for neutrino and dark matter searches. The collection of ionization charge in these detectors allows to perform a complete tridimensional reconstruction of the tracks of charged particles, calorimetric measurements, particle identification. This work proposes a novel approach to the problem of charge recombination in liquid argon which moves from a microscopic model and is applied to the cases of low energy electrons, alpha particles and nuclear recoils. The model is able to describe precisely several sets of experimental data available in the literature, over wide ranges of electric field strengths and kinetic energies and can be easily extended to other particles.


title: LOTUS: Improving Transformer Efficiency with Sparsity Pruning and Data Lottery Tickets

abstract: Vision transformers have revolutionized computer vision, but their computational demands present challenges for training and deployment. This paper introduces LOTUS (LOttery Transformers with Ultra Sparsity), a novel method that leverages data lottery ticket selection and sparsity pruning to accelerate vision transformer training while maintaining accuracy. Our approach focuses on identifying and utilizing the most informative data subsets and eliminating redundant model parameters to optimize the training process. Through extensive experiments, we demonstrate the effectiveness of LOTUS in achieving rapid convergence and high accuracy with significantly reduced computational requirements. This work highlights the potential of combining data selection and sparsity techniques for efficient vision transformer training, opening doors for further research and development in this area.


title: Angular momentum gain by electrons under action of intense structured light

abstract: The problem of light waves interaction with charged particles becomes more and more complex starting with the case of plane waves, where the analytical solution is well known, to more natural, though more complicated situations which include focused or structured laser beams. Internal structure may introduce a new degree of freedom and qualitatively change the dynamics of interacting particles. For certain conditions, namely for the dilute plasma, description of single-particle dynamics in the focused structured laser beams is the first step and may serve as a good approximation on the way of understanding the global plasma response. Moreover, the general problem of integrability in complex systems starts from consideration of the integrals of motion for a single particle. The primary goal of this work is an understanding of the physics of the orbital angular momentum (OAM) absorption by a single particle in a focused structured light. A theoretical model of the process, including solutions of Maxwell equations with the required accuracy and a high-order perturbative approach to electron motion in external electromagnetic fields, is developed and its predictions are examined with numerical simulations for several exemplary electromagnetic field configurations. In particular, it was found that for the particles distributed initially with the azimuthal symmetry around the beam propagation direction, the transferred OAM has a smallness of the fourth order of the applied field amplitude, and requires an accurate consideration of the temporal laser pulse envelope.


title: Transformer-Based Self-Supervised Learning for Histopathological Classification of Ischemic Stroke Clot Origin

abstract: Background and Purpose: Identifying the thromboembolism source in ischemic stroke is crucial for treatment and secondary prevention yet is often undetermined. This study describes a self-supervised deep learning approach in digital pathology of emboli for classifying ischemic stroke clot origin from histopathological images. Methods: The dataset included whole slide images (WSI) from the STRIP AI Kaggle challenge, consisting of retrieved clots from ischemic stroke patients following mechanical thrombectomy. Transformer-based deep learning models were developed using transfer learning and self-supervised pretraining for classifying WSI. Customizations included an attention pooling layer, weighted loss function, and threshold optimization. Various model architectures were tested and compared, and model performances were primarily evaluated using weighted logarithmic loss. Results: The model achieved a logloss score of 0.662 in cross-validation and 0.659 on the test set. Different model backbones were compared, with the swin_large_patch4_window12_384 showed higher performance. Thresholding techniques for clot origin classification were employed to balance false positives and negatives. Conclusion: The study demonstrates the extent of efficacy of transformer-based deep learning models in identifying ischemic stroke clot origins from histopathological images and emphasizes the need for refined modeling techniques specifically adapted to thrombi WSI. Further research is needed to improve model performance, interpretability, validate its effectiveness. Future enhancement could include integrating larger patient cohorts, advanced preprocessing strategies, and exploring ensemble multimodal methods for enhanced diagnostic accuracy.


title: Quantum Federated Learning Experiments in the Cloud with Data Encoding

abstract: Quantum Federated Learning (QFL) is an emerging concept that aims to unfold federated learning (FL) over quantum networks, enabling collaborative quantum model training along with local data privacy. We explore the challenges of deploying QFL on cloud platforms, emphasizing quantum intricacies and platform limitations. The proposed data-encoding-driven QFL, with a proof of concept (GitHub Open Source) using genomic data sets on quantum simulators, shows promising results.


title: De-Biasing Models of Biased Decisions: A Comparison of Methods Using Mortgage Application Data

abstract: Prediction models can improve efficiency by automating decisions such as the approval of loan applications. However, they may inherit bias against protected groups from the data they are trained on. This paper adds counterfactual (simulated) ethnic bias to real data on mortgage application decisions, and shows that this bias is replicated by a machine learning model (XGBoost) even when ethnicity is not used as a predictive variable. Next, several other de-biasing methods are compared: averaging over prohibited variables, taking the most favorable prediction over prohibited variables (a novel method), and jointly minimizing errors as well as the association between predictions and prohibited variables. De-biasing can recover some of the original decisions, but the results are sensitive to whether the bias is effected through a proxy.


title: Stabilization of infinite-dimensional systems under quantization and packet loss

abstract: We study the problem of stabilizing infinite-dimensional systems with input and output quantization. The closed-loop system we consider is subject to packet loss in the sensor-to-controller channels, whose duration is assumed to be averagely bounded. Given a bound on the initial state, we propose design methods for dynamic quantizers with zoom parameters. We show that the closed-loop state staring in a given region exponentially converges to zero if the bounds of quantization errors and packet-loss duration satisfy suitable conditions. Since the norms of the operators representing the system dynamics are used in the proposed quantization schemes, we also present methods for approximately computing the operator norms.


title: Unification in the description logic $\mathcal{FL}_\bot$

abstract: Description Logics are a formalism used in the knowledge representation, where the knowledge is captured in the form of concepts constructed in a controlled way from a restricted vocabulary. This allows one to test effectively for consistency of and the subsumption between the concepts. Unification of concepts may likewise become a useful tool in analysing the relations between concepts. The unification problem has been solved for the description logics $\mathcal{FL}_0$ and $\mathcal{EL}$. These small logics do not provide any means to express negation. Here we show an algorithm solving unification in $\mathcal{FL}_\bot$, the logic that extends $\mathcal{FL}_0$ with the bottom concept. Bottom allows one to express that two concepts are disjoint. Our algorithm runs in exponential time, with respect to the size of the problem.


title: Laser Pulse Induced Second- and Third-Harmonic Generation of Gold Nanorods with Real-Time Time-Dependent Density Functional Tight Binding (RT-TDDFTB) Method

abstract: In this study, we investigate second- and third-harmonic generation processes in Au nanorod systems using the real-time time-dependent density functional tight binding (RT-TDDFTB) method. Our study focuses on computation of nonlinear signals based on the time dependent dipole response induced by linearly polarized laser pulses interacting with nanoparticles. We systematically explore the influence of various laser parameters, including pump intensity, duration, frequency, and polarization directions, on the harmonic generation. We demonstrate all the results using Au nanorod dimer systems arranged in end-to-end configurations, and disrupting the spatial symmetry of regular single nanorod systems crucial for second harmonic generation processes. Furthermore, we study the impact of nanorod lengths, which lead to variable plasmon energies, on the harmonic generation, and estimates of polarizabilities and hyper-polarizabilities are provided.


title: Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization

abstract: This paper presents a new algorithm member for accelerating first-order methods for bilevel optimization, namely the \emph{(Perturbed) Restarted Accelerated Fully First-order methods for Bilevel Approximation}, abbreviated as \texttt{(P)RAF${}^2$BA}. The algorithm leverages \emph{fully} first-order oracles and seeks approximate stationary points in nonconvex-strongly-convex bilevel optimization, enhancing oracle complexity for efficient optimization. Theoretical guarantees for finding approximate first-order stationary points and second-order stationary points at the state-of-the-art query complexities are established, showcasing their effectiveness in solving complex optimization tasks. Empirical studies for real-world problems are provided to further validate the outperformance of our proposed algorithms. The significance of \texttt{(P)RAF${}^2$BA} in optimizing nonconvex-strongly-convex bilevel optimization problems is underscored by its state-of-the-art convergence rates and computational efficiency.


title: EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusion

abstract: We present EchoScene, an interactive and controllable generative model that generates 3D indoor scenes on scene graphs. EchoScene leverages a dual-branch diffusion model that dynamically adapts to scene graphs. Existing methods struggle to handle scene graphs due to varying numbers of nodes, multiple edge combinations, and manipulator-induced node-edge operations. EchoScene overcomes this by associating each node with a denoising process and enables collaborative information exchange, enhancing controllable and consistent generation aware of global constraints. This is achieved through an information echo scheme in both shape and layout branches. At every denoising step, all processes share their denoising data with an information exchange unit that combines these updates using graph convolution. The scheme ensures that the denoising processes are influenced by a holistic understanding of the scene graph, facilitating the generation of globally coherent scenes. The resulting scenes can be manipulated during inference by editing the input scene graph and sampling the noise in the diffusion model. Extensive experiments validate our approach, which maintains scene controllability and surpasses previous methods in generation fidelity. Moreover, the generated scenes are of high quality and thus directly compatible with off-the-shelf texture generation. Code and trained models are open-sourced.


title: Finite generation properties of the pro-$p$ Iwahori-Hecke $\operatorname{Ext}$-algebra

abstract: The pro-$p$ Iwahori-Hecke $\operatorname{Ext}$-algebra $E^\ast$ is a graded algebra that has been introduced and studied by Ollivier-Schneider, with the long-term goal of investigating the category of smooth mod-$p$ representations of $p$-adic reductive groups and its derived category. Its $0$th graded piece is the pro-$p$ Iwahori-Hecke algebra studied by Vign\'eras and others. In the present article, we first show that the $\operatorname{Ext}$-algebra $E^\ast$ associated with the group $\operatorname{SL}_2(\mathfrak{F})$, $\operatorname{PGL}_2(\mathfrak{F})$ or $\operatorname{GL}_2(\mathfrak{F})$, where $\mathfrak{F}$ is an unramified extension of $\mathbb{Q}_p$ with $p \neq 2,3$, is finitely generated as a (non-commutative) algebra. We then specialize to the case of the group $\operatorname{SL}_2(\mathbb{Q}_p)$, with $p \neq 2,3$, and we show that in this case the natural multiplication map from the tensor algebra $T^\ast_{E^0} E^1$ to $E^\ast$ is surjective and that its kernel is finitely generated as a two-sided ideal. Using this fact as main input, we then show that $E^\ast$ is finitely presented as an algebra. We actually compute an explicit presentation.


title: Semiparametric mean and variance joint models with clipped-Laplace link functions for bounded integer-valued time series

abstract: We present a novel approach for modeling bounded count time series data, by deriving accurate upper and lower bounds for the variance of a bounded count random variable while maintaining a fixed mean. Leveraging these bounds, we propose semiparametric mean and variance joint (MVJ) models utilizing a clipped-Laplace link function. These models offer a flexible and feasible structure for both mean and variance, accommodating various scenarios of under-dispersion, equi-dispersion, or over-dispersion in bounded time series. The proposed MVJ models feature a linear mean structure with positive regression coefficients summing to one and allow for negative regression cefficients and autocorrelations. We demonstrate that the autocorrelation structure of MVJ models mirrors that of an autoregressive moving-average (ARMA) process, provided the proposed clipped-Laplace link functions with nonnegative regression coefficients summing to one are utilized. We establish conditions ensuring the stationarity and ergodicity properties of the MVJ process, along with demonstrating the consistency and asymptotic normality of the conditional least squares estimators. To aid model selection and diagnostics, we introduce two model selection criteria and apply two model diagnostics statistics. Finally, we conduct simulations and real data analyses to investigate the finite-sample properties of the proposed MVJ models, providing insights into their efficacy and applicability in practical scenarios.


title: Confronting MSSM flat direction inflation with Planck/BICEP data

abstract: We study the scenario of inflection point inflation where a flat direction of the minimal supersymmetric standard model (MSSM) is identified with the inflaton. Specifically, we consider in full generality the cases where a MSSM flat direction is lifted by a higher-dimensional superpotential whose dimension is n = 4, 5, 6, 7, 9. We confront the inflection point inflation scenarios with various n with the Planck and BICEP data, and thereby constrain the soft SUSY breaking mass and the coefficient of the higher-dimensional operator that lifts the flat direction.


title: Generalized group designs: overcoming the 4-design-barrier and constructing novel unitary 2-designs in arbitrary dimensions

abstract: Unitary designs are essential tools in several quantum information protocols. Similarly to other design concepts, unitary designs are mainly used to facilitate averaging over a relevant space, in this case, the unitary group $\mathrm{U}(d)$. While it is known that exact unitary $t$-designs exist for any degree $t$ and dimension $d$, the most appealing type of designs, group designs (in which the elements of the design form a group), can provide at most $3$-designs. Moreover, even group $2$-designs can only exist in limited dimensions. In this paper, we present novel construction methods for creating exact generalized group designs based on the representation theory of the unitary group and its finite subgroups that overcome the $4$-design-barrier of unitary group designs. Furthermore, a construction is presented for creating generalized group $2$-designs in arbitrary dimensions.


title: Identifying Halos in Cosmological Simulations with Continuous Wavelet Analysis: The 2D Case

abstract: Continuous wavelet analysis is gaining popularity in science and engineering for its ability to analyze data across spatial and scale domain simultaneously. In this study, we introduce a wavelet-based method to identify halos and assess its feasibility in two-dimensional (2D) scenarios. We begin with the generation of four pseudo-2D datasets from the SIMBA dark matter simulation by compressing thin slices of three-dimensional (3D) data into 2D. We then calculate the continuous wavelet transform (CWT) directly from the particle distributions, identify local maxima that represent actual halos, and segment the CWT to delineate halo boundaries. A comparison with the traditional Friends-of-Friends (FOF) method shows that our CWT-identified halos, while containing slightly fewer particles, have smoother boundaries and are more compact in dense regions. In contrast, the CWT method can link particles over greater distances to form halos in sparse regions due to its spatial segmentation scheme. The spatial distribution and halo power spectrum of both CWT and FOF halos demonstrate substantial consistency, validating the 2D applicability of CWT for halo detection. Our identification scheme operates with a linear time complexity of $\mathcal{O}(N)$, suggesting its suitability for analyzing significantly larger datasets in the future.


title: Verification of Population Protocols with Unordered Data

abstract: Population protocols are a well-studied model of distributed computation in which a group of anonymous finite-state agents communicates via pairwise interactions. Together they decide whether their initial configuration, that is, the initial distribution of agents in the states, satisfies a property. As an extension in order to express properties of multisets over an infinite data domain, Blondin and Ladouceur (ICALP'23) introduced population protocols with unordered data (PPUD). In PPUD, each agent carries a fixed data value, and the interactions between agents depend on whether their data are equal or not. Blondin and Ladouceur also identified the interesting subclass of immediate observation PPUD (IOPPUD), where in every transition one of the two agents remains passive and does not move, and they characterised its expressive power. We study the decidability and complexity of formally verifying these protocols. The main verification problem for population protocols is well-specification, that is, checking whether the given PPUD computes some function. We show that well-specification is undecidable in general. By contrast, for IOPPUD, we exhibit a large yet natural class of problems, which includes well-specification among other classic problems, and establish that these problems are in EXPSPACE. We also provide a lower complexity bound, namely coNEXPTIME-hardness.


title: MTDT: A Multi-Task Deep Learning Digital Twin

abstract: Traffic congestion has significant impacts on both the economy and the environment. Measures of Effectiveness (MOEs) have long been the standard for evaluating the level of service and operational efficiency of traffic intersections. However, the scarcity of traditional high-resolution loop detector data (ATSPM) presents challenges in accurately measuring MOEs or capturing the intricate temporospatial characteristics inherent in urban intersection traffic. In response to this challenge, we have introduced the Multi-Task Deep Learning Digital Twin (MTDT) as a solution for multifaceted and precise intersection traffic flow simulation. MTDT enables accurate, fine-grained estimation of loop detector waveform time series for each lane of movement, alongside successful estimation of several MOEs for each lane group associated with a traffic phase concurrently and for all approaches of an arbitrary urban intersection. Unlike existing deep learning methodologies, MTDT distinguishes itself through its adaptability to local temporal and spatial features, such as signal timing plans, intersection topology, driving behaviors, and turning movement counts. While maintaining a straightforward design, our model emphasizes the advantages of multi-task learning in traffic modeling. By consolidating the learning process across multiple tasks, MTDT demonstrates reduced overfitting, increased efficiency, and enhanced effectiveness by sharing representations learned by different tasks. Furthermore, our approach facilitates sequential computation and lends itself to complete parallelization through GPU implementation. This not only streamlines the computational process but also enhances scalability and performance.


title: Caps and Wickets

abstract: Let $H_n^{(3)}$ be a 3-uniform linear hypergraph, i.e. any two edges have at most one vertex common. A special hypergraph, {\em wicket}, is formed by three rows and two columns of a $3 \times 3$ point matrix. In this note, we give a new lower bound on the Tur\'an number of wickets using estimates on cap sets. We also show that this problem is closely connected to important questions in additive combinatorics.


title: Zonotope-based Symbolic Controller Synthesis for Linear Temporal Logic Specifications

abstract: This paper studies the controller synthesis problem for nonlinear control systems under linear temporal logic (LTL) specifications using zonotope techniques. A local-to-global control strategy is proposed for the desired specification expressed as an LTL formula. First, a novel approach is developed to divide the state space into finite zonotopes and constrained zonotopes, which are called cells and allowed to intersect with the neighbor cells. Second, from the intersection relation, a graph among all cells is generated to verify the realization of the accepting path for the LTL formula. The realization verification determines if there is a need for the control design, and also results in finite local LTL formulas. Third, once the accepting path is realized, a novel abstraction-based method is derived for the controller design. In particular, we only focus on the cells from the realization verification and approximate each cell thanks to properties of zonotopes. Based on local symbolic models and local LTL formulas, an iterative synthesis algorithm is proposed to design all local abstract controllers, whose existence and combination establish the global controller for the LTL formula. Finally, the proposed framework is illustrated via a path planning problem of mobile robots.


title: A Python code for calculating the mean-value (Baldereschi's) point for any crystal structure

abstract: A python code (mvp.py) is presented for computing the mean-value point (MVP) in the Brillouin zone first introduced by Baldereschi [1]. The code allows calculations of the MVP for any input crystal structure. Having MVP allows approximating the Brillouin zone integrals of relatively smooth, periodic functions defined in the reciprocal space by the value of the same function at only one, mean-value, k-point. This approximation decreases computational cost at a relatively small decrease in accuracy. The MVP coordinates for the 14 Bravais lattices are evaluated and the underlying theory is discussed.


title: Covariant Schr\"odinger Operator and $L^2$-Vanishing Property on Riemannian Manifolds

abstract: Let $M$ be a complete Riemannian manifold satisfying a weighted Poincar\'e inequality, and let $\mathcal{E}$ be a Hermitian vector bundle over $M$ equipped with a metric covariant derivative $\nabla$. We consider the operator $H_{X,V}=\nabla^{\dagger}\nabla+\nabla_{X}+ V$, where $\nabla^{\dagger}$ is the formal adjoint of $\nabla$ with respect to the inner product in the space of square-integrable sections of $\mathcal{E}$, $X$ is a smooth (real) vector field on $M$, and $V$ is a fiberwise self-adjoint, smooth section of the endomorphism bundle $\textrm{End }\mathcal{E}$. We give a sufficient condition for the triviality of the $L^2$-kernel of $H_{X,V}$. As a corollary, putting $X\equiv 0$ and working in the setting of a Clifford bundle equipped with a Clifford connection $\nabla$, we obtain the triviality of the $L^2$-kernel of $D^2$, where $D$ is the Dirac operator corresponding to $\nabla$. In particular, when $\mathcal{E}=\Lambda^{k}T^*M$ and $D^2$ is the Hodge--deRham Laplacian on $k$-forms, we recover some recent vanishing results for $L^2$-harmonic $k$-forms.


title: High repetition rate ultrafast electron diffraction with direct electron detection

abstract: Ultrafast electron diffraction (UED) instruments typically operate at kHz or lower repetition rates and rely on indirect detection of electrons. However, these experiments encounter limitations because they are required to use electron beams containing a relatively large number of electrons (>>100 electrons/pulse), leading to severe space-charge effects. Consequently, electron pulses with long durations and large transverse diameters are used to interrogate the sample. Here, we introduce a novel UED instrument operating at a high repetition rate and employing direct electron detection. We operate significantly below the severe space-charge regime by using electron beams containing 55 to 140 electrons per pulse at 30-kHz. We demonstrate the ability to detect time-resolved signals from thin film solid samples with a difference contrast signal, {\Delta}I/I0, and an instrument response function as low as 10-5 and 243-fs (FWHM), respectively, without temporal compression. Overall, our findings underscore the importance of increasing the repetition rate of UED experiments and adopting a direct electron detection scheme. Our newly developed scheme enables more efficient and sensitive investigations of ultrafast dynamics in photoexcited samples using ultrashort electron beams.


title: Nearly Optimum Properties of Certain Multi-Decision Sequential Rules for General Non-i.i.d. Stochastic Models

abstract: Dedicated to the memory of Professor Tze Leung Lai, this paper introduces three multi-hypothesis sequential tests. These tests are derived from one-sided versions of the sequential probability ratio test and its modifications. They are proven to be first-order asymptotically optimal for testing simple and parametric composite hypotheses when error probabilities are small. These tests exhibit near optimality properties not only in classical i.i.d. observation models but also in general non-i.i.d. models, provided that the log-likelihood ratios between hypotheses converge r-completely to positive and finite numbers. These findings extend the seminal work of Lai (1981) on two hypotheses.


title: Quantum wave packet transforms with compact frequency support

abstract: Different kinds of wave packet transforms are widely used for extracting multi-scale structures in signal processing tasks. This paper introduces the quantum circuit implementation of a broad class of wave packets, including Gabor atoms and wavelets, with compact frequency support. Our approach operates in the frequency space, involving reallocation and reshuffling of signals tailored for manipulation on quantum computers. The resulting implementation is different from the existing quantum algorithms for spatially compactly supported wavelets and can be readily extended to quantum transforms of other wave packets with compact frequency support.


title: MAIN-VC: Lightweight Speech Representation Disentanglement for One-shot Voice Conversion

abstract: One-shot voice conversion aims to change the timbre of any source speech to match that of the unseen target speaker with only one speech sample. Existing methods face difficulties in satisfactory speech representation disentanglement and suffer from sizable networks as some of them leverage numerous complex modules for disentanglement. In this paper, we propose a model named MAIN-VC to effectively disentangle via a concise neural network. The proposed model utilizes Siamese encoders to learn clean representations, further enhanced by the designed mutual information estimator. The Siamese structure and the newly designed convolution module contribute to the lightweight of our model while ensuring performance in diverse voice conversion tasks. The experimental results show that the proposed model achieves comparable subjective scores and exhibits improvements in objective metrics compared to existing methods in a one-shot voice conversion scenario.


title: Milankovi\'c Forcing in Deep Time

abstract: Astronomical (or Milankovi\'c) forcing of the Earth system is key to understanding rhythmic climate change on time scales >~ 10 kyr. Paleoceanographic and paleoclimatological applications concerned with past astronomical forcing rely on astronomical calculations (solutions), which represent the backbone of cyclostratigraphy and astrochronology. Here we present state-of-the-art astronomical solutions over the past 3.5 Gyr. Our goal is to provide tuning targets and templates for interpreting deep-time cyclostratigraphic records and designing external forcing functions in climate models. Our approach yields internally consistent orbital and precession-tilt solutions, including fundamental solar system frequencies, orbital eccentricity and inclination, lunar distance, luni-solar precession rate, Earth's obliquity, and climatic precession. Contrary to expectations, we find that the long eccentricity cycle (previously assumed stable and labeled ''metronome'', recent period ~405 kyr), can become unstable on long time scales. Our results reveal episodes during which the long eccentricity cycle is very weak or absent and Earth's orbital eccentricity and climate-forcing spectrum are unrecognizable compared to the recent past. For the ratio of eccentricity-to-inclination amplitude modulation (frequently observable in paleorecords) we find a wide distribution around the recent 2:1 ratio, i.e., the system is not restricted to a 2:1 or 1:1 resonance state. Our computations show that Earth's obliquity was lower and its amplitude (variation around the mean) significantly reduced in the past. We therefore predict weaker climate forcing at obliquity frequencies in deep time and a trend toward reduced obliquity power with age in stratigraphic records. For deep-time stratigraphic and modeling applications, the orbital parameters of our 3.5-Gyr integrations are made available at 400-year resolution.


title: Homotopy rigidity for quasitoric manifolds over a product of $d$-simplices

abstract: For a fixed integer $d\geq 1$, we show that two quasitoric manifolds over a product of $d$-simplices are homotopy equivalent after appropriate localization, provided that their integral cohomology rings are isomorphic.


title: Efficient Computation for Invertibility Sequence of Banded Toeplitz Matrices

abstract: When solving systems of banded Toeplitz equations or calculating their inverses, it is necessary to determine the invertibility of the matrices beforehand. In this paper, we equate the invertibility of an $n$-order banded Toeplitz matrix with bandwidth $2k+1$ to that of a small $k*k$ matrix. By utilizing a specially designed algorithm, we compute the invertibility sequence of a class of banded Toeplitz matrices with a time complexity of $5k^2n/2+kn$ and a space complexity of $3k^2$ where $n$ is the size of the largest matrix. This enables efficient preprocessing when solving equation systems and inverses of banded Toeplitz matrices.


title: Benchmarking Representations for Speech, Music, and Acoustic Events

abstract: Limited diversity in standardized benchmarks for evaluating audio representation learning (ARL) methods may hinder systematic comparison of current methods' capabilities. We present ARCH, a comprehensive benchmark for evaluating ARL methods on diverse audio classification domains, covering acoustic events, music, and speech. ARCH comprises 12 datasets, that allow us to thoroughly assess pre-trained SSL models of different sizes. ARCH streamlines benchmarking of ARL techniques through its unified access to a wide range of domains and its ability to readily incorporate new datasets and models. To address the current lack of open-source, pre-trained models for non-speech audio, we also release new pre-trained models that demonstrate strong performance on non-speech datasets. We argue that the presented wide-ranging evaluation provides valuable insights into state-of-the-art ARL methods, and is useful to pinpoint promising research directions.


title: Efficient Internal Strategies in Quantum Relaxation based Branch-and-Bound

abstract: A combinatorial optimization problem is to find an optimal solution under the constraints. This is one of the potential applications for quantum computers. Quantum Random Access Optimization (QRAO) is the quantum optimization algorithm that encodes multiple classical variables into a single qubit to construct a quantum Hamiltonian, thereby reducing the number of qubits required. The ground energy of the QRAO Hamiltonian provides a lower bound on the original problem's optimal value before encoding. This property allows the QRAO Hamiltonian to be used as a relaxation of the original problem, and it is thus referred to as a quantum relaxed Hamiltonian. In the Branch-and-Bound method, solving the relaxation problem plays a significant role. In this study, we developed Quantum Relaxation based Branch-and-Bound (QR-BnB), a method incorporating quantum relaxation into the Branch-and-Bound framework. We solved the MaxCut Problem and the Travelling Salesman Problem in our experiments. In all instances in this study, we obtained the optimal solution whenever we successfully computed the exact lower bound through quantum relaxation. Internal strategies, such as relaxation methods and variable selection, influence the convergence of the Branch-and-Bound. Thus, we have further developed the internal strategies for QR-BnB and examined how these strategies influence its convergence. We show that our variable selection strategy via the expectation value of the Pauli operators gives better convergence than the naive random choice. QRAO deals with only unconstrained optimization problems, but QR-BnB can handle constraints more flexibly because of the Branch-and-Bound processes on the classical computing part. We demonstrate that in our experiments with the Travelling Salesman Problem, the convergence of QR-BnB became more than three times faster by using the information in the constraints.


title: Gravitational collapse and gravitational wave in Einstein--Gauss-Bonnet theory with two scalar fields

abstract: In this paper, we investigate the gravitational collapse to form the black hole in the acceleratingly expanding universe in the frame of Einstein--Gauss-Bonnet theory having two scalar fields and we study the propagation of the gravitational wave (GW). The collapsing spacetime can be obtained by using the formulation of the ``reconstruction'', that is, we find a model that realises the desired or given geometry. In the reconstructed models, ghosts often appear, which could be eliminated by imposing constraints. We show that the standard cosmological solutions or self-gravitating objects such as a planet, the Sun, various types of stars, etc., in Einstein's gravity, are also solutions in this model. Using the dynamical value of Gauss-Bonnet coupling, the propagation of the high-frequency GW is investigated. The propagating speed changes due to the coupling during the period of the black hole formation. The speed at which the GW propagates The speed at which the GW propagates going into the black hole is different from that of the wave going out.


title: New bounds on the cohesion of complete-link and other linkage methods for agglomeration clustering

abstract: Linkage methods are among the most popular algorithms for hierarchical clustering. Despite their relevance the current knowledge regarding the quality of the clustering produced by these methods is limited. Here, we improve the currently available bounds on the maximum diameter of the clustering obtained by complete-link for metric spaces. One of our new bounds, in contrast to the existing ones, allows us to separate complete-link from single-link in terms of approximation for the diameter, which corroborates the common perception that the former is more suitable than the latter when the goal is producing compact clusters. We also show that our techniques can be employed to derive upper bounds on the cohesion of a class of linkage methods that includes the quite popular average-link.


title: Virtual Psychedelia

abstract: We present an approach to designing 3D Iterated Function Systems (IFS) within the Unity Editor and rendered to VR in real-time. Objects are modeled as a hierarchical tree of primitive shapes and operators, editable using a graphical user interface allowing artists to develop psychedelic scenes with little to no coding knowledge, and is easily extensible for more advanced users to add their own primitive shapes and operators.


title: On the solitary wave configurations of nonlinear Schr\"odinger equation under the effect of L\'evy noise

abstract: This study aims to examine the effect of L\'evy noise on the solutions of the nonlinear Schr\"odinger equation. An improved diversity of stochastic solutions is instinctively located discretely on certain conditions by applying the generalized Kudryashov method. Moreover, the dynamical behaviors of these exact results of the nonlinear Schr\"odinger equation are interpreted in the context of the effect of L\'evy noise. Even mathematical evaluations have been conducted and presented.


title: Computing Threshold Circuits with Bimolecular Void Reactions in Step Chemical Reaction Networks

abstract: Step Chemical Reaction Networks (step CRNs) are an augmentation of the Chemical Reaction Network (CRN) model where additional species may be introduced to the system in a sequence of ``steps.'' We study step CRN systems using a weak subset of reaction rules, \emph{void} rules, in which molecular species can only be deleted. We demonstrate that step CRNs with only void rules of size (2,0) can simulate threshold formulas (TFs) under linear resources. These limited systems can also simulate threshold \emph{circuits} (TCs) by modifying the volume of the system to be exponential. We then prove a matching exponential lower bound on the required volume for simulating threshold circuits in a step CRN with (2,0)-size rules under a restricted \emph{gate-wise} simulation, thus showing our construction is optimal for simulating circuits in this way.


title: Gagliardo-Nirenberg inequality with H\"older norms

abstract: The classical Gagliardo-Nirenberg inequality, known as an interpolation inequality, involves Lebesgue norms of functions and their derivatives. We established an interpolation lemma to connect Lebesgue and H\"older spaces, thus extending the Gagliardo-Nirenberg inequality. This extension involved substituting arbitrary Sobolev norms with appropriate H\"older norms, allowing for a wider range of applicable parameters in the inequality.


title: LLaVA Finds Free Lunch: Teaching Human Behavior Improves Content Understanding Abilities Of LLMs

abstract: Communication is defined as "Who says what to whom with what effect." A message from a communicator generates downstream receiver effects, also known as behavior. Receiver behavior, being a downstream effect of the message, carries rich signals about it. Even after carrying signals about the message, the behavior data is often ignored while training large language models. We show that training LLMs on receiver behavior can actually help improve their content-understanding abilities. Specifically, we show that training LLMs to predict the receiver behavior of likes and comments improves the LLM's performance on a wide variety of downstream content understanding tasks. We show this performance increase over 40 video and image understanding tasks over 23 benchmark datasets across both 0-shot and fine-tuning settings, outperforming many supervised baselines. Moreover, since receiver behavior, such as likes and comments, is collected by default on the internet and does not need any human annotations to be useful, the performance improvement we get after training on this data is essentially free-lunch. We release the receiver behavior cleaned comments and likes of 750k images and videos collected from multiple platforms along with our instruction-tuning data.


title: Space Debris Reliable Capturing by a Dual-Arm Orbital Robot: Detumbling and Caging

abstract: A chaser satellite equipped with robotic arms can capture space debris and manipulate it for use in more advanced missions such as refueling and deorbiting. To facilitate capturing, a caging-based strategy has been proposed to simplify the control system. Caging involves geometrically constraining the motion of the target debris, and is achieved via position control. However, if the target is spinning at a high speed, direct caging may result in unsuccessful constraints or hardware destruction; therefore, the target should be de-tumbled before capture. To address this problem, this study proposes a repeated contact-based method that uses impedance control to mitigate the momentum of the target. In this study, we analyzed the proposed detumbling technique from the perspective of impedance parameters. We investigated their effects through a parametric analysis and demonstrated the successful detumbling and caging sequence of a microsatellite as representative of space debris. The contact forces decreased during the detumbling sequence compared with direct caging. Further, the proposed detumbling and caging sequence was validated through simulations and experiments using a dual-arm air-floating robot in two-dimensional microgravity emulating testbed.


title: Repainting the colour-mass diagrams by unearthing the green mountain: dust-rich S0 galaxies in the colour-(galaxy stellar mass) diagram, and the colour-(black hole mass) relations for dust-poor versus dust-rich galaxies

abstract: Lenticular galaxies are notoriously misclassified as elliptical galaxies and, as such, a (disc inclination)-dependent correction for dust is often not applied to the magnitudes of dusty lenticular galaxies. This results in overly red galaxy colours, impacting their distribution in the colour-magnitude diagram. It is revealed how this has led to an underpopulation of the `green valley' by hiding a `green mountain' of massive dust-rich lenticular galaxies - known to be built from gas-rich major mergers - within the `red sequence' of colour-(stellar mass) diagrams. Correcting for dust, a `green mountain' appears at $M_{\rm *,gal}\sim10^{11}$ M$_\odot$, along with signs of an extension to lower masses producing a `green range' or `green ridge' on the green side of the `red sequence' and `blue cloud.' The `red sequence' is shown to be comprised of two components: a red plateau defined by elliptical galaxies with a near-constant colour and by lower-mass dust-poor lenticular galaxies, which are mostly a primordial population but may include faded/transformed spiral galaxies. The quasi-triangular-shaped galaxy evolution sequence, previously called the `Triangal', is revealed in the galaxy colour-(stellar mass) diagram. It tracks the speciation of galaxies and their associated migration through the diagram. The connection of the `Triangal' to previous galaxy morphology sequences (Fork, Trident, Comb) is also shown herein. Finally, the colour-(black hole mass) diagram is revisited, revealing how the dust correction generates a blue-green sequence for the spiral $and$ dust-rich lenticular galaxies that is offset from a green-red sequence defined by the dust-poor lenticular and elliptical galaxies.


title: Can FSK Be Optimised for Integrated Sensing and Communications?

abstract: Motivated by the ideal peak-to-average-power ratio and radar sensing capability of traditional frequency-coded radar waveforms, this paper considers the frequency shift keying (FSK) based waveform for joint communications and radar (JCR). An analysis of the probability distributions of its ambiguity function (AF) sidelobe levels (SLs) and peak sidelobe level (PSL) is conducted to study the radar sensing capability of random FSK. Numerical results show that the independent frequency modulation introduces uncontrollable AF PSLs. In order to address this problem, the initial phases of waveform sub-pulses are designed by solving a min-max optimisation problem. Numerical results indicate that the optimisation-based phase design can effectively reduce the AF PSL to a level close to well-designed radar waveforms while having no impact on the data rate and the receiver complexity. For large numbers of waveform sub-pulses and modulation orders, the impact on the error probability is also insignificant.


title: SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameters

abstract: This paper introduces SparseTSF, a novel, extremely lightweight model for Long-term Time Series Forecasting (LTSF), designed to address the challenges of modeling complex temporal dependencies over extended horizons with minimal computational resources. At the heart of SparseTSF lies the Cross-Period Sparse Forecasting technique, which simplifies the forecasting task by decoupling the periodicity and trend in time series data. This technique involves downsampling the original sequences to focus on cross-period trend prediction, effectively extracting periodic features while minimizing the model's complexity and parameter count. Based on this technique, the SparseTSF model uses fewer than *1k* parameters to achieve competitive or superior performance compared to state-of-the-art models. Furthermore, SparseTSF showcases remarkable generalization capabilities, making it well-suited for scenarios with limited computational resources, small samples, or low-quality data. The code is publicly available at this repository: https://github.com/lss-1138/SparseTSF.


title: Co-Optimization of EV Charging Control and Incentivization for Enhanced Power System Stability

abstract: We study how high charging rate demands from electric vehicles (EVs) in a power distribution grid may collectively cause its dynamic instability, and, accordingly, how a price incentivization strategy can be used to steer customers to settle for lesser charging rate demands so that these instabilities can be avoided. We pose the problem as a joint optimization and optimal control formulation. The optimization determines the optimal charging setpoints for EVs to minimize the $\mathcal{H}_2$-norm of the transfer function of the grid model, while the optimal control simultaneously develops a linear quadratic regulator (LQR) based state-feedback control signal for the battery-currents of those EVs to jointly minimize the risk of grid instability. A subsequent algorithm is developed to determine how much customers may be willing to sacrifice their intended charging rate demands in return for financial incentives. Results are derived for both unidirectional and bidirectional charging, and validated using numerical simulations of multiple EV charging stations in the IEEE 33-bus power distribution model.


title: Modeling Empathetic Alignment in Conversation

abstract: Empathy requires perspective-taking: empathetic responses require a person to reason about what another has experienced and communicate that understanding in language. However, most NLP approaches to empathy do not explicitly model this alignment process. Here, we introduce a new approach to recognizing alignment in empathetic speech, grounded in Appraisal Theory. We introduce a new dataset of over 9.2K span-level annotations of different types of appraisals of a person's experience and over 3K empathetic alignments between a speaker's and observer's speech. Through computational experiments, we show that these appraisals and alignments can be accurately recognized. In experiments in over 9.2M Reddit conversations, we find that appraisals capture meaningful groupings of behavior but that most responses have minimal alignment. However, we find that mental health professionals engage with substantially more empathetic alignment.


title: The Role of Model Architecture and Scale in Predicting Molecular Properties: Insights from Fine-Tuning RoBERTa, BART, and LLaMA

abstract: This study introduces a systematic framework to compare the efficacy of Large Language Models (LLMs) for fine-tuning across various cheminformatics tasks. Employing a uniform training methodology, we assessed three well-known models-RoBERTa, BART, and LLaMA-on their ability to predict molecular properties using the Simplified Molecular Input Line Entry System (SMILES) as a universal molecular representation format. Our comparative analysis involved pre-training 18 configurations of these models, with varying parameter sizes and dataset scales, followed by fine-tuning them on six benchmarking tasks from DeepChem. We maintained consistent training environments across models to ensure reliable comparisons. This approach allowed us to assess the influence of model type, size, and training dataset size on model performance. Specifically, we found that LLaMA-based models generally offered the lowest validation loss, suggesting their superior adaptability across tasks and scales. However, we observed that absolute validation loss is not a definitive indicator of model performance - contradicts previous research - at least for fine-tuning tasks: instead, model size plays a crucial role. Through rigorous replication and validation, involving multiple training and fine-tuning cycles, our study not only delineates the strengths and limitations of each model type but also provides a robust methodology for selecting the most suitable LLM for specific cheminformatics applications. This research underscores the importance of considering model architecture and dataset characteristics in deploying AI for molecular property prediction, paving the way for more informed and effective utilization of AI in drug discovery and related fields.


title: Provably Efficient Reinforcement Learning for Adversarial Restless Multi-Armed Bandits with Unknown Transitions and Bandit Feedback

abstract: Restless multi-armed bandits (RMAB) play a central role in modeling sequential decision making problems under an instantaneous activation constraint that at most B arms can be activated at any decision epoch. Each restless arm is endowed with a state that evolves independently according to a Markov decision process regardless of being activated or not. In this paper, we consider the task of learning in episodic RMAB with unknown transition functions and adversarial rewards, which can change arbitrarily across episodes. Further, we consider a challenging but natural bandit feedback setting that only adversarial rewards of activated arms are revealed to the decision maker (DM). The goal of the DM is to maximize its total adversarial rewards during the learning process while the instantaneous activation constraint must be satisfied in each decision epoch. We develop a novel reinforcement learning algorithm with two key contributors: a novel biased adversarial reward estimator to deal with bandit feedback and unknown transitions, and a low-complexity index policy to satisfy the instantaneous activation constraint. We show $\tilde{\mathcal{O}}(H\sqrt{T})$ regret bound for our algorithm, where $T$ is the number of episodes and $H$ is the episode length. To our best knowledge, this is the first algorithm to ensure $\tilde{\mathcal{O}}(\sqrt{T})$ regret for adversarial RMAB in our considered challenging settings.


title: Hyperspectral Band Selection based on Generalized 3DTV and Tensor CUR Decomposition

abstract: Hyperspectral Imaging (HSI) serves as an important technique in remote sensing. However, high dimensionality and data volume typically pose significant computational challenges. Band selection is essential for reducing spectral redundancy in hyperspectral imagery while retaining intrinsic critical information. In this work, we propose a novel hyperspectral band selection model by decomposing the data into a low-rank and smooth component and a sparse one. In particular, we develop a generalized 3D total variation (G3DTV) by applying the $\ell_1^p$-norm to derivatives to preserve spatial-spectral smoothness. By employing the alternating direction method of multipliers (ADMM), we derive an efficient algorithm, where the tensor low-rankness is implied by the tensor CUR decomposition. We demonstrate the effectiveness of the proposed approach through comparisons with various other state-of-the-art band selection techniques using two benchmark real-world datasets. In addition, we provide practical guidelines for parameter selection in both noise-free and noisy scenarios.


title: Free group of Hamel bijections of big size

abstract: A $f\colon\mathbb{R}\to\mathbb{R}$ is called Hamel function if its graph is a Hamel basis of the linear space $\mathbb{R}^2$ over rationals. We construct, assuming CH, a free group of the size $2^\mathfrak{c}$ contained in the class of all Hamel functions, with the indentity function included. This answers, consistently, a question posed recently by M. Lichman, M. Pawlikowski, S. Smolarek, and J. Swaczyna.


title: Asymptotic Properties of the Distributional Synthetic Controls

abstract: This paper enhances our comprehension of the Distributional Synthetic Control (DSC) proposed by Gunsilius (2023), focusing on its asymptotic properties. We first establish the DSC estimator's asymptotic optimality. The essence of this optimality lies in the treatment effect estimator given by DSC achieves the lowest possible squared prediction error among all potential treatment effect estimators that depend on an average of quantiles of control units. We also establish the convergence of the DSC weights when some requirements are met, as well as the convergence rate. A significant aspect of our research is that we find DSC synthesis forms an optimal weighted average, particularly in situations where it is impractical to perfectly fit the treated unit's quantiles through the weighted average of the control units' quantiles. To corroborate our theoretical insights, we provide empirical evidence derived from simulations.


title: X-Oscar: A Progressive Framework for High-quality Text-guided 3D Animatable Avatar Generation

abstract: Recent advancements in automatic 3D avatar generation guided by text have made significant progress. However, existing methods have limitations such as oversaturation and low-quality output. To address these challenges, we propose X-Oscar, a progressive framework for generating high-quality animatable avatars from text prompts. It follows a sequential Geometry->Texture->Animation paradigm, simplifying optimization through step-by-step generation. To tackle oversaturation, we introduce Adaptive Variational Parameter (AVP), representing avatars as an adaptive distribution during training. Additionally, we present Avatar-aware Score Distillation Sampling (ASDS), a novel technique that incorporates avatar-aware noise into rendered images for improved generation quality during optimization. Extensive evaluations confirm the superiority of X-Oscar over existing text-to-3D and text-to-avatar approaches. Our anonymous project page: https://xmu-xiaoma666.github.io/Projects/X-Oscar/.


title: Recovering Labels from Local Updates in Federated Learning

abstract: Gradient inversion (GI) attacks present a threat to the privacy of clients in federated learning (FL) by aiming to enable reconstruction of the clients' data from communicated model updates. A number of such techniques attempts to accelerate data recovery by first reconstructing labels of the samples used in local training. However, existing label extraction methods make strong assumptions that typically do not hold in realistic FL settings. In this paper we present a novel label recovery scheme, Recovering Labels from Local Updates (RLU), which provides near-perfect accuracy when attacking untrained (most vulnerable) models. More significantly, RLU achieves high performance even in realistic real-world settings where the clients in an FL system run multiple local epochs, train on heterogeneous data, and deploy various optimizers to minimize different objective functions. Specifically, RLU estimates labels by solving a least-square problem that emerges from the analysis of the correlation between labels of the data points used in a training round and the resulting update of the output layer. The experimental results on several datasets, architectures, and data heterogeneity scenarios demonstrate that the proposed method consistently outperforms existing baselines, and helps improve quality of the reconstructed images in GI attacks in terms of both PSNR and LPIPS.


title: Efficient Data-driven Scene Simulation using Robotic Surgery Videos via Physics-embedded 3D Gaussians

abstract: Surgical scene simulation plays a crucial role in surgical education and simulator-based robot learning. Traditional approaches for creating these environments with surgical scene involve a labor-intensive process where designers hand-craft tissues models with textures and geometries for soft body simulations. This manual approach is not only time-consuming but also limited in the scalability and realism. In contrast, data-driven simulation offers a compelling alternative. It has the potential to automatically reconstruct 3D surgical scenes from real-world surgical video data, followed by the application of soft body physics. This area, however, is relatively uncharted. In our research, we introduce 3D Gaussian as a learnable representation for surgical scene, which is learned from stereo endoscopic video. To prevent over-fitting and ensure the geometrical correctness of these scenes, we incorporate depth supervision and anisotropy regularization into the Gaussian learning process. Furthermore, we apply the Material Point Method, which is integrated with physical properties, to the 3D Gaussians to achieve realistic scene deformations. Our method was evaluated on our collected in-house and public surgical videos datasets. Results show that it can reconstruct and simulate surgical scenes from endoscopic videos efficiently-taking only a few minutes to reconstruct the surgical scene-and produce both visually and physically plausible deformations at a speed approaching real-time. The results demonstrate great potential of our proposed method to enhance the efficiency and variety of simulations available for surgical education and robot learning.


title: IntraMix: Intra-Class Mixup Generation for Accurate Labels and Neighbors

abstract: Graph Neural Networks (GNNs) demonstrate excellent performance on graphs, with their core idea about aggregating neighborhood information and learning from labels. However, the prevailing challenges in most graph datasets are twofold of Insufficient High-Quality Labels and Lack of Neighborhoods, resulting in weak GNNs. Existing data augmentation methods designed to address these two issues often tackle only one. They may either require extensive training of generators, rely on overly simplistic strategies, or demand substantial prior knowledge, leading to suboptimal generalization abilities. To simultaneously address both of these two challenges, we propose an elegant method called IntraMix. IntraMix innovatively employs Mixup among low-quality labeled data of the same class, generating high-quality labeled data at minimal cost. Additionally, it establishes neighborhoods for the generated data by connecting them with data from the same class with high confidence, thereby enriching the neighborhoods of graphs. IntraMix efficiently tackles both challenges faced by graphs and challenges the prior notion of the limited effectiveness of Mixup in node classification. IntraMix serves as a universal framework that can be readily applied to all GNNs. Extensive experiments demonstrate the effectiveness of IntraMix across various GNNs and datasets.


title: Generative manufacturing systems using diffusion models and ChatGPT

abstract: In this study, we introduce Generative Manufacturing Systems (GMS) as a novel approach to effectively manage and coordinate autonomous manufacturing assets, thereby enhancing their responsiveness and flexibility to address a wide array of production objectives and human preferences. Deviating from traditional explicit modeling, GMS employs generative AI, including diffusion models and ChatGPT, for implicit learning from envisioned futures, marking a shift from a model-optimum to a training-sampling decision-making. Through the integration of generative AI, GMS enables complex decision-making through interactive dialogue with humans, allowing manufacturing assets to generate multiple high-quality global decisions that can be iteratively refined based on human feedback. Empirical findings showcase GMS's substantial improvement in system resilience and responsiveness to uncertainties, with decision times reduced from seconds to milliseconds. The study underscores the inherent creativity and diversity in the generated solutions, facilitating human-centric decision-making through seamless and continuous human-machine interactions.


title: Solar Radio Bursts and Space Weather

abstract: Space Weather is the study of the conditions in the solar wind that can affect life on the surface of the Earth, particularly the increasingly technologically sophisticated devices that are part of modern life. Solar radio observations are relevant to such phenomena because they generally originate as events in the solar atmosphere, including flares, coronal mass ejections and shocks, that produce electromagnetic and particle radiations that impact the Earth. Low frequency solar radio emission arises in the solar atmosphere at the levels where these events occur: we can use frequency as a direct measure of density, and an indirect measure of height, in the atmosphere. The main radio burst types are described and illustrated using data from the Green Bank Solar Radio Burst Spectrometer, and their potential use as diagnostics of Space Weather is discussed.


title: Foundations for Digital Twins

abstract: The growing reliance on digital twins across various industries and domains brings with it semantic interoperability challenges. Ontologies are a well-known strategy for addressing such challenges, though given the complexity of the phenomenon, there are risks of reintroducing the interoperability challenges at the level of ontology representations. In the interest of avoiding such pitfalls, we introduce and defend characterizations of digital twins within the context of the Common Core Ontologies, an extension of the widely-used Basic Formal Ontology. We provide a set of definitions and design patterns relevant to the domain of digital twins, highlighted by illustrative use cases of digital twins and their physical counterparts. In doing so, we provide a foundation on which to build more sophisticated ontological content related and connected to digital twins.


title: Right-handed neutrino dark matter in $U(1)_X$SSM

abstract: There is strong evidence for the existence of dark matter in a number of current experiments. We study dark matter using the $U(1)_X$SSM obtained from the $U(1)_X$ extension of the minimal supersymmetric standard model (MSSM). In the $U(1)_X$SSM, we use the right-handed neutrino as a dark matter candidate, whose lightest mass eigenstate has cold dark matter features. In this paper, the relic density of right-handed neutrino as dark matter is investigated. For dark matter scattering, both spin-independent and spin-dependent cross sections are studied. In the final numerical results obtained, some parameter spaces can satisfy the constraints of the relic density and dark matter direct detection experiments.


title: FITA: Fine-grained Image-Text Aligner for Radiology Report Generation

abstract: Radiology report generation aims to automatically generate detailed and coherent descriptive reports alongside radiology images. Previous work mainly focused on refining fine-grained image features or leveraging external knowledge. However, the precise alignment of fine-grained image features with corresponding text descriptions has not been considered. This paper presents a novel method called Fine-grained Image-Text Aligner (FITA) to construct fine-grained alignment for image and text features. It has three novel designs: Image Feature Refiner (IFR), Text Feature Refiner (TFR) and Contrastive Aligner (CA). IFR and TFR aim to learn fine-grained image and text features, respectively. We achieve this by leveraging saliency maps to effectively fuse symptoms with corresponding abnormal visual regions, and by utilizing a meticulously constructed triplet set for training. Finally, CA module aligns fine-grained image and text features using contrastive loss for precise alignment. Results show that our method surpasses existing methods on the widely used benchmark


title: Real spin bordism and orientations of topological $\mathrm{K}$-theory

abstract: We construct a commutative orthogonal $C_2$-ring spectrum, $\mathrm{MSpin}^c_{\mathbb{R}}$, along with a $C_2$-$E_{\infty}$-orientation $\mathrm{MSpin}^c_{\mathbb{R}} \to \mathrm{KU}_{\mathbb{R}}$ of Atiyah's Real K-theory. Further, we define $E_{\infty}$-maps $\mathrm{MSpin} \to (\mathrm{MSpin}^c_{\mathbb{R}})^{C_2}$ and $\mathrm{MU}_{\mathbb{R}} \to \mathrm{MSpin}^c_{\mathbb{R}}$, which are used to recover the three well-known orientations of topological $\mathrm{K}$-theory, $\mathrm{MSpin}^c \to \mathrm{KU}$, $\mathrm{MSpin} \to \mathrm{KO}$, and $\mathrm{MU}_{\mathbb{R}} \to \mathrm{KU}_{\mathbb{R}}$, from the map $\mathrm{MSpin}^c_{\mathbb{R}} \to \mathrm{KU}_{\mathbb{R}}$. We also show that the integrality of the $\hat{A}$-genus on spin manifolds provides an obstruction for the fixed points $(\mathrm{MSpin}^c_{\mathbb{R}})^{C_2}$ to be equivalent to $\mathrm{MSpin}$, using the Mackey functor structure of $\underline{\pi}_*\mathrm{MSpin}^c_{\mathbb{R}}$. In particular, the usual map $\mathrm{MSpin} \to \mathrm{MSpin}^c$ does not arise as the inclusion of fixed points for any $C_2$-$E_{\infty}$-ring spectrum.


title: Deriving Lehmer and H\"older means as maximum weighted likelihood estimates for the multivariate exponential family

abstract: The links between the mean families of Lehmer and H\"older and the weighted maximum likelihood estimator have recently been established in the case of a regular univariate exponential family. In this article, we will extend the outcomes obtained to the multivariate case. This extension provides a probabilistic interpretation of these families of means and could therefore broaden their uses in various applications.


title: Robust Decentralized Learning with Local Updates and Gradient Tracking

abstract: As distributed learning applications such as Federated Learning, the Internet of Things (IoT), and Edge Computing grow, it is critical to address the shortcomings of such technologies from a theoretical perspective. As an abstraction, we consider decentralized learning over a network of communicating clients or nodes and tackle two major challenges: data heterogeneity and adversarial robustness. We propose a decentralized minimax optimization method that employs two important modules: local updates and gradient tracking. Minimax optimization is the key tool to enable adversarial training for ensuring robustness. Having local updates is essential in Federated Learning (FL) applications to mitigate the communication bottleneck, and utilizing gradient tracking is essential to proving convergence in the case of data heterogeneity. We analyze the performance of the proposed algorithm, Dec-FedTrack, in the case of nonconvex-strongly concave minimax optimization, and prove that it converges a stationary point. We also conduct numerical experiments to support our theoretical findings.


title: Efficient Compression of Multitask Multilingual Speech Models

abstract: Whisper is a multitask and multilingual speech model covering 99 languages. It yields commendable automatic speech recognition (ASR) results in a subset of its covered languages, but the model still underperforms on a non-negligible number of under-represented languages, a problem exacerbated in smaller model versions. In this work, we examine its limitations, demonstrating the presence of speaker-related (gender, age) and model-related (resourcefulness and model size) bias. Despite that, we show that only model-related bias are amplified by quantization, impacting more low-resource languages and smaller models. Searching for a better compression approach, we propose DistilWhisper, an approach that is able to bridge the performance gap in ASR for these languages while retaining the advantages of multitask and multilingual capabilities. Our approach involves two key strategies: lightweight modular ASR fine-tuning of whisper-small using language-specific experts, and knowledge distillation from whisper-large-v2. This dual approach allows us to effectively boost ASR performance while keeping the robustness inherited from the multitask and multilingual pre-training. Results demonstrate that our approach is more effective than standard fine-tuning or LoRA adapters, boosting performance in the targeted languages for both in- and out-of-domain test sets, while introducing only a negligible parameter overhead at inference.


title: Mass generation via nonlinear massive solution in Higgs potential and particle creations

abstract: The nonlinear massive plane wave solution of the classical scalar field in the Higgs potential is revisited to study the mass generation and particle creation. In particular, by assuming that the Higgs system is in the slightly excited state in early universe and it is described by the nonlinear solution, we study the mass generation mechanism for massive vector bosons and a heavy fermion in the quantum field theory around the nonlinear massive classical field. The nonlinear massive classical solution gives the transition from the vacuum to a pair of vector bosons and fermions. We present the new formulae of the probability density of the production process for particles in the standard model of elementary particle physics. The probability densities of the particle productions vanish when the nonlinear massive solution reduces to the constant solution (the classical vacuum expectation value); while the probability densities are expressed as the function of the free parameter in the classical solution in general case. We discuss the behavior of the probability densities for the three oscillating modes in the classical solution.


title: A multidimensional approach to quantum state tomography of photoelectron wavepackets

abstract: There is a growing interest in reconstructing the density matrix of photoionized electrons, in particular in complex systems where decoherence can be introduced either by a partial measurement of the system or through coupling with a stochastic environment. To this, end, several methods to reconstruct the density matrix, quantum state tomography protocols, have been developed and tested on photoelectrons ejected from noble gases following absorption of XUV photons from attosecond pulses. It remains a challenge to obtain model-free, single scan protocols that can reconstruct the density matrix with high fidelities. Current methods require extensive measurements or involve complex fitting of the signal. Faithful single-scan reconstructions would be of great help to increase the number of systems that can be studied. We propose a new and more efficient protocol - rainbow-KRAKEN - that is able to reconstruct the continuous variable density matrix of a photoelectron in a single time delay scan. It is based on measuring the coherences of a photoelectron created by absorption of an XUV pulse using a broadband IR probe that is scanned in time and a narrowband IR reference that is temporally fixed to the XUV pulse. We illustrate its performance for a Fano resonance in He as well as mixed states in Ar arising from spin-orbit splitting. We show that the protocol results in excellent fidelities and near-perfect estimation of the purity.


title: Elastic electron scattering from Be, Mg, and Ca

abstract: We present a comprehensive set of theoretical results for differential, integrated, and momentum transfer cross sections for the elastic scattering of electrons by beryllium, magnesium and calcium, at energies below 1 keV. In addition, we provide Sherman function values for elastic electron scattering from calcium in the same energy range. This study extends the application of our method of calculations, already employed for barium and strontium, to all stable alkaline-earth-metal atoms. Our semi-empirical approach to treating target polarization has produced in our earlier work a satisfactory agreement with experimental values and precise theoretical results such as convergent close-coupling calculations for barium. The present data are expected to be of similar high accuracy, based on our previous success in similar calculations for barium and all inert gases.


title: How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses

abstract: One-on-one tutoring is widely acknowledged as an effective instructional method, conditioned on qualified tutors. However, the high demand for qualified tutors remains a challenge, often necessitating the training of novice tutors (i.e., trainees) to ensure effective tutoring. Research suggests that providing timely explanatory feedback can facilitate the training process for trainees. However, it presents challenges due to the time-consuming nature of assessing trainee performance by human experts. Inspired by the recent advancements of large language models (LLMs), our study employed the GPT-4 model to build an explanatory feedback system. This system identifies trainees' responses in binary form (i.e., correct/incorrect) and automatically provides template-based feedback with responses appropriately rephrased by the GPT-4 model. We conducted our study on 410 responses from trainees across three training lessons: Giving Effective Praise, Reacting to Errors, and Determining What Students Know. Our findings indicate that: 1) using a few-shot approach, the GPT-4 model effectively identifies correct/incorrect trainees' responses from three training lessons with an average F1 score of 0.84 and an AUC score of 0.85; and 2) using the few-shot approach, the GPT-4 model adeptly rephrases incorrect trainees' responses into desired responses, achieving performance comparable to that of human experts.


title: Excitation-Dependent Features and Artifacts in 2-D Terahertz Spectroscopy

abstract: Recently, two-dimensional terahertz spectroscopy (2DTS) has attracted increasing attention for studying complex solids. A number of recent studies have applied 2DTS either with long pulses or away from any material resonances, situations that yield unconventional 2DTS spectra that are often difficult to interpret. Here, we clarify the generic origins of observed spectral features by examining 2DTS spectra of ZnTe, a model system with a featureless optical susceptibility at low terahertz frequencies. These results also reveal possible artifacts that may arise from electro-optic sampling in collinear 2DTS experiments, including the observation of spurious rectified or second harmonic signals.


title: CACTUS: Chemistry Agent Connecting Tool-Usage to Science

abstract: Large language models (LLMs) have shown remarkable potential in various domains, but they often lack the ability to access and reason over domain-specific knowledge and tools. In this paper, we introduced CACTUS (Chemistry Agent Connecting Tool-Usage to Science), an LLM-based agent that integrates cheminformatics tools to enable advanced reasoning and problem-solving in chemistry and molecular discovery. We evaluate the performance of CACTUS using a diverse set of open-source LLMs, including Gemma-7b, Falcon-7b, MPT-7b, Llama2-7b, and Mistral-7b, on a benchmark of thousands of chemistry questions. Our results demonstrate that CACTUS significantly outperforms baseline LLMs, with the Gemma-7b and Mistral-7b models achieving the highest accuracy regardless of the prompting strategy used. Moreover, we explore the impact of domain-specific prompting and hardware configurations on model performance, highlighting the importance of prompt engineering and the potential for deploying smaller models on consumer-grade hardware without significant loss in accuracy. By combining the cognitive capabilities of open-source LLMs with domain-specific tools, CACTUS can assist researchers in tasks such as molecular property prediction, similarity searching, and drug-likeness assessment. Furthermore, CACTUS represents a significant milestone in the field of cheminformatics, offering an adaptable tool for researchers engaged in chemistry and molecular discovery. By integrating the strengths of open-source LLMs with domain-specific tools, CACTUS has the potential to accelerate scientific advancement and unlock new frontiers in the exploration of novel, effective, and safe therapeutic candidates, catalysts, and materials. Moreover, CACTUS's ability to integrate with automated experimentation platforms and make data-driven decisions in real time opens up new possibilities for autonomous discovery.

categories: cs.CL cs.AI cs.LG physics.chem-ph q-bio.QM


title: Active Cell Balancing for Extended Operational Time of Lithium-Ion Battery Systems in Energy Storage Applications

abstract: Cell inconsistency within a lithium-ion battery system poses a significant challenge in maximizing the system operational time. This study presents an optimization-driven active balancing method to minimize the effects of cell inconsistency on the system operational time while simultaneously satisfying the system output power demand and prolonging the system operational time in energy storage applications. The proposed method utilizes a fractional order model to forecast the terminal voltage dynamics of each cell within a battery system, enhanced with a particle-swarm-optimisation-genetic algorithm for precise parameter identification. It is implemented under two distinct cell-level balancing topologies: independent cell balancing and differential cell balancing. Subsequently, the current distribution for each topology is determined by resolving two optimization control problems constrained by the battery's operational specifications and power demands. The effectiveness of the proposed method is validated by extensive experiments based on the two balancing topologies. The results demonstrate that the proposed method increases the operational time by 3.2%.


title: On Ridge Estimation in High-dimensional Rotationally Sparse Linear Regression

abstract: Recently, deep neural networks have been found to nearly interpolate training data but still generalize well in various applications. To help understand such a phenomenon, it has been of interest to analyze the ridge estimator and its interpolation limit in high-dimensional regression models. For this motivation, we study the ridge estimator in a rotationally sparse setting of high-dimensional linear regression, where the signal of a response is aligned with a small number, $d$, of covariates with large or spiked variances, compared with the remaining covariates with small or tail variances, \textit{after} an orthogonal transformation of the covariate vector. We establish high-probability upper and lower bounds on the out-sample and in-sample prediction errors in two distinct regimes depending on the ratio of the effective rank of tail variances over the sample size $n$. The separation of the two regimes enables us to exploit relevant concentration inequalities and derive concrete error bounds without making any oracle assumption or independent components assumption on covariate vectors. Moreover, we derive sufficient and necessary conditions which indicate that the prediction errors of ridge estimation can be of the order $O(\frac{d}{n})$ if and only if the gap between the spiked and tail variances are sufficiently large. We also compare the orders of optimal out-sample and in-sample prediction errors and find that, remarkably, the optimal out-sample prediction error may be significantly smaller than the optimal in-sample one. Finally, we present numerical experiments which empirically confirm our theoretical findings.


title: PLAID SHIRTTT for Large-Scale Streaming Dense Retrieval

abstract: PLAID, an efficient implementation of the ColBERT late interaction bi-encoder using pretrained language models for ranking, consistently achieves state-of-the-art performance in monolingual, cross-language, and multilingual retrieval. PLAID differs from ColBERT by assigning terms to clusters and representing those terms as cluster centroids plus compressed residual vectors. While PLAID is effective in batch experiments, its performance degrades in streaming settings where documents arrive over time because representations of new tokens may be poorly modeled by the earlier tokens used to select cluster centroids. PLAID Streaming Hierarchical Indexing that Runs on Terabytes of Temporal Text (PLAID SHIRTTT) addresses this concern using multi-phase incremental indexing based on hierarchical sharding. Experiments on ClueWeb09 and the multilingual NeuCLIR collection demonstrate the effectiveness of this approach both for the largest collection indexed to date by the ColBERT architecture and in the multilingual setting, respectively.