title: Ar-Spider: Text-to-SQL in Arabic

abstract: In Natural Language Processing (NLP), one of the most important tasks is text-to-SQL semantic parsing, which focuses on enabling users to interact with the database in a more natural manner. In recent years, text-to-SQL has made significant progress, but most were English-centric. In this paper, we introduce Ar-Spider 1, the first Arabic cross-domain text-to-SQL dataset. Due to the unique nature of the language, two major challenges have been encountered, namely schema linguistic and SQL structural challenges. In order to handle these issues and conduct the experiments, we adopt two baseline models LGESQL [4] and S2SQL [12], both of which are tested with two cross-lingual models to alleviate the effects of schema linguistic and SQL structure linking challenges. The baselines demonstrate decent single-language performance on our Arabic text-to-SQL dataset, Ar-Spider, achieving 62.48% for S2SQL and 65.57% for LGESQL, only 8.79% below the highest results achieved by the baselines when trained in English dataset. To achieve better performance on Arabic text-to-SQL, we propose the context similarity relationship (CSR) approach, which results in a significant increase in the overall performance of about 1.52% for S2SQL and 1.06% for LGESQL and closes the gap between Arabic and English languages to 7.73%.


title: Filter Bubble or Homogenization? Disentangling the Long-Term Effects of Recommendations on User Consumption Patterns

abstract: Recommendation algorithms play a pivotal role in shaping our media choices, which makes it crucial to comprehend their long-term impact on user behavior. These algorithms are often linked to two critical outcomes: homogenization, wherein users consume similar content despite disparate underlying preferences, and the filter bubble effect, wherein individuals with differing preferences only consume content aligned with their preferences (without much overlap with other users). Prior research assumes a trade-off between homogenization and filter bubble effects and then shows that personalized recommendations mitigate filter bubbles by fostering homogenization. However, because of this assumption of a tradeoff between these two effects, prior work cannot develop a more nuanced view of how recommendation systems may independently impact homogenization and filter bubble effects. We develop a more refined definition of homogenization and the filter bubble effect by decomposing them into two key metrics: how different the average consumption is between users (inter-user diversity) and how varied an individual's consumption is (intra-user diversity). We then use a novel agent-based simulation framework that enables a holistic view of the impact of recommendation systems on homogenization and filter bubble effects. Our simulations show that traditional recommendation algorithms (based on past behavior) mainly reduce filter bubbles by affecting inter-user diversity without significantly impacting intra-user diversity. Building on these findings, we introduce two new recommendation algorithms that take a more nuanced approach by accounting for both types of diversity.


title: Impact of Nanometer-Thin Stiff Layer on Adhesion to Rough Surfaces

abstract: Adhesion requires molecular contact, and natural adhesives employ mechanical gradients to achieve complete (conformal) contact to maximize adhesion. Intuitively, one expects that the higher the modulus of the top layer, the lower will be the adhesion strength. However, the relationship between the thickness of the stiff top layer and adhesion is not known. In this work, we quantified the adhesion between a stiff glassy poly (methyl methacrylate) (PMMA) layer of varying thickness on top of a soft poly dimethyl siloxane (PDMS) elastomer with a sapphire lens. We found that only about 90 nm thick PMMA layer on a relatively thicker, softer, and elastic PDMS block is required to drop macroscopic adhesion to almost zero during the loading cycle. This drop in adhesion for bilayers can be explained using a conformal model developed by Persson and Tosatti, where the elastic energy to create conformal contact depends on both the thickness and the mechanical properties of the bilayer. A better understanding of the influence of mechanical gradients on adhesion will have an impact on adhesives, friction, and colloidal and granular physics.


title: Turbulence unsteadiness drives extreme clustering

abstract: We show that the unsteadiness of turbulence has a drastic effect on turbulence parameters and in particle cluster formation. To this end we use direct numerical simulations of particle laden flows with a steady forcing that generates an unsteady large-scale flow. Particle clustering correlates with the instantaneous Taylor-based flow Reynolds number, and anti-correlates with its instantaneous turbulent energy dissipation constant. A dimensional argument for these correlations is presented. In natural flows, unsteadiness can result in extreme particle clustering, which is stronger than the clustering expected from averaged inertial turbulence effects.


title: A stochastic moving ball approximation method for smooth convex constrained minimization

abstract: In this paper, we consider constrained optimization problems with convex, smooth objective and constraints. We propose a new stochastic gradient algorithm, called the Stochastic Moving Ball Approximation (SMBA) method, to solve this class of problems, where at each iteration we first take a gradient step for the objective function and then perform a projection step onto one ball approximation of a randomly chosen constraint. The computational simplicity of SMBA, which uses first-order information and considers only one constraint at a time, makes it suitable for large-scale problems with many functional constraints. We provide a convergence analysis for the SMBA algorithm using basic assumptions on the problem, that yields new convergence rates in both optimality and feasibility criteria evaluated at some average point. Our convergence proofs are novel since we need to deal properly with infeasible iterates and with quadratic upper approximations of constraints that may yield empty balls. We derive convergence rates of order $\mathcal{O} (k^{-1/2})$ when the objective function is convex, and $\mathcal{O} (k^{-1})$ when the objective function is strongly convex. Preliminary numerical experiments on quadratically constrained quadratic problems demonstrate the viability and performance of our method when compared to some existing state-of-the-art optimization methods and software.


title: Towards Few-Shot Adaptation of Foundation Models via Multitask Finetuning

abstract: Foundation models have emerged as a powerful tool for many AI problems. Despite the tremendous success of foundation models, effective adaptation to new tasks, particularly those with limited labels, remains an open question and lacks theoretical understanding. An emerging solution with recent success in vision and NLP involves finetuning a foundation model on a selection of relevant tasks, before its adaptation to a target task with limited labeled samples. In this paper, we study the theoretical justification of this multitask finetuning approach. Our theoretical analysis reveals that with a diverse set of related tasks, this multitask finetuning leads to reduced error in the target task, in comparison to directly adapting the same pretrained model. We quantify the relationship between finetuning tasks and target tasks by diversity and consistency metrics, and further propose a practical task selection algorithm. We substantiate our theoretical claims with extensive empirical evidence. Further, we present results affirming our task selection algorithm adeptly chooses related finetuning tasks, providing advantages to the model performance on target tasks. We believe our study shed new light on the effective adaptation of foundation models to new tasks that lack abundant labels. Our code is available at https://github.com/OliverXUZY/Foudation-Model_Multitask.


title: Unintended Impacts of LLM Alignment on Global Representation

abstract: Before being deployed for user-facing applications, developers align Large Language Models (LLMs) to user preferences through a variety of procedures, such as Reinforcement Learning From Human Feedback (RLHF) and Direct Preference Optimization (DPO). Current evaluations of these procedures focus on benchmarks of instruction following, reasoning, and truthfulness. However, human preferences are not universal, and aligning to specific preference sets may have unintended effects. We explore how alignment impacts performance along three axes of global representation: English dialects, multilingualism, and opinions from and about countries worldwide. Our results show that current alignment procedures create disparities between English dialects and global opinions. We find alignment improves capabilities in several languages. We conclude by discussing design decisions that led to these unintended impacts and recommendations for more equitable preference tuning. We make our code and data publicly available on Github.


title: Consistency-Guided Temperature Scaling Using Style and Content Information for Out-of-Domain Calibration

abstract: Research interests in the robustness of deep neural networks against domain shifts have been rapidly increasing in recent years. Most existing works, however, focus on improving the accuracy of the model, not the calibration performance which is another important requirement for trustworthy AI systems. Temperature scaling (TS), an accuracy-preserving post-hoc calibration method, has been proven to be effective in in-domain settings, but not in out-of-domain (OOD) due to the difficulty in obtaining a validation set for the unseen domain beforehand. In this paper, we propose consistency-guided temperature scaling (CTS), a new temperature scaling strategy that can significantly enhance the OOD calibration performance by providing mutual supervision among data samples in the source domains. Motivated by our observation that over-confidence stemming from inconsistent sample predictions is the main obstacle to OOD calibration, we propose to guide the scaling process by taking consistencies into account in terms of two different aspects -- style and content -- which are the key components that can well-represent data samples in multi-domain settings. Experimental results demonstrate that our proposed strategy outperforms existing works, achieving superior OOD calibration performance on various datasets. This can be accomplished by employing only the source domains without compromising accuracy, making our scheme directly applicable to various trustworthy AI systems.


title: Probabilistically-sound beam search with masked language models

abstract: Beam search with masked language models (MLMs) is challenging in part because joint probability distributions over sequences are not readily available, unlike for autoregressive models. Nevertheless, estimating such distributions has applications in many domains, including protein engineering and ancient text restoration. We present probabilistically-sound methods for beam search with MLMs. First, we clarify the conditions under which it is theoretically sound to perform text infilling with MLMs using standard beam search. When these conditions fail, we provide a probabilistically-sound modification with no additional computational complexity and demonstrate that it is superior to the aforementioned beam search in the expected conditions. We then present empirical results comparing several infilling approaches with MLMs across several domains.


title: CLoVe: Encoding Compositional Language in Contrastive Vision-Language Models

abstract: Recent years have witnessed a significant increase in the performance of Vision and Language tasks. Foundational Vision-Language Models (VLMs), such as CLIP, have been leveraged in multiple settings and demonstrated remarkable performance across several tasks. Such models excel at object-centric recognition yet learn text representations that seem invariant to word order, failing to compose known concepts in novel ways. However, no evidence exists that any VLM, including large-scale single-stream models such as GPT-4V, identifies compositions successfully. In this paper, we introduce a framework to significantly improve the ability of existing models to encode compositional language, with over 10% absolute improvement on compositionality benchmarks, while maintaining or improving the performance on standard object-recognition and retrieval benchmarks. Our code and pre-trained models are publicly available at https://github.com/netflix/clove.


title: Moving higher-order Taylor approximations method for smooth constrained minimization problems

abstract: In this paper we develop a higher-order method for solving composite (non)convex minimization problems with smooth (non)convex functional constraints. At each iteration our method approximates the smooth part of the objective function and of the constraints by higher-order Taylor approximations, leading to a moving Taylor approximation method (MTA). We present convergence guarantees for MTA algorithm for both, nonconvex and convex problems. In particular, when the objective and the constraints are nonconvex functions, we prove that the sequence generated by MTA algorithm converges globally to a KKT point. Moreover, we derive convergence rates in the iterates when the problem data satisfy the Kurdyka-Lojasiewicz (KL) property. Further, when the objective function is (uniformly) convex and the constraints are also convex, we provide (linear/superlinear) sublinear convergence rates for our algorithm. Finally, we present an efficient implementation of the proposed algorithm and compare it with existing methods from the literature.


title: ALMA-IMF XI: The sample of hot core candidates A rich population of young high-mass proto-stars unveiled by the emission of methyl formate

abstract: Sites associated with high-mass star and cluster formation exhibit a so-called hot core phase, characterized by high temperatures and column densities of complex organic molecules. We built a comprehensive census of hot core candidates towards the ALMA-IMF protoclusters based on the detection of two CH3OCHO emission lines at 216.1 GHz. We used the source extraction algorithm GExt2D to identify peaks of methyl formate (CH3OCHO) emission that is a complex species commonly observed towards sites of star formation. We built up a catalog of 76 hot core candidates with masses ranging from about 0.2 to 80 Msun , of which 56 are new detections. A large majority of these objects are compact, rather circular, with deconvolved FWHM sizes of about 2300 au on average. About 30% of our sample of methyl formate sources have core masses above 8 Msun within sizes ranging from about 1000 au to 13400 au, which well correspond to archetypical hot cores. The origin of the CH3OCHO emission toward the lower-mass cores can be explained by a mixture of contribution from shocks, or may correspond to objects in a more evolved state, i.e. beyond the hot core stage. We find that the fraction of hot core candidates increases with the core mass. The large fraction of hot core candidates towards the most massive cores suggests that they rapidly enter the hot core phase and feedback effects from the forming protostar(s) impact their environment on short time-scales.


title: Radiative recombination rate suppressed in a quantum photocell with three electron donors

abstract: The radiative recombination of electron-hole pairs represents a great challenge to the photon-to-charge efficiency in photocell. In this paper, we visit the radiative recombination rate (RRR) in a quantum photocell with or without three dipole-dipole coupled electron donors. The results show that different gaps play the same roles while the ambient temperatures play different roles in the suppressed RRR with or without three dipole-dipole coupled electron donors. What's more, the dipole-dipole coupling strength J can greatly inhibit the RRRs with three dipole-dipole coupled electron donors, which indicates the quantum coherence generated by three coupled donors is an efficient approach to suppress RRR, and it is different from the quantum coherence mentioned by Marlan O. Scully [PRL 104, 207701 (2010)]. This presented scheme may propose some regulating strategies for efficient conversion efficiency via the suppressed RRR.


title: Practice Makes Perfect: Planning to Learn Skill Parameter Policies

abstract: One promising approach towards effective robot decision making in complex, long-horizon tasks is to sequence together parameterized skills. We consider a setting where a robot is initially equipped with (1) a library of parameterized skills, (2) an AI planner for sequencing together the skills given a goal, and (3) a very general prior distribution for selecting skill parameters. Once deployed, the robot should rapidly and autonomously learn to improve its performance by specializing its skill parameter selection policy to the particular objects, goals, and constraints in its environment. In this work, we focus on the active learning problem of choosing which skills to practice to maximize expected future task success. We propose that the robot should estimate the competence of each skill, extrapolate the competence (asking: "how much would the competence improve through practice?"), and situate the skill in the task distribution through competence-aware planning. This approach is implemented within a fully autonomous system where the robot repeatedly plans, practices, and learns without any environment resets. Through experiments in simulation, we find that our approach learns effective parameter policies more sample-efficiently than several baselines. Experiments in the real-world demonstrate our approach's ability to handle noise from perception and control and improve the robot's ability to solve two long-horizon mobile-manipulation tasks after a few hours of autonomous practice. Project website: http://ees.csail.mit.edu


title: Enhanced quantum yields and efficiency in a quantum dot photocell modeled by a multi-level system

abstract: To absorb the photons below the band-gap energy effectively, we proposed a quantum dot (QD) photocell modeled by multi-level system for the quantum yields and photo-to-charge efficiency limits. The theoretical results show the quantum yields are enhanced as compared to the single band-gap solar cell, and the photo-to-charge efficiencies are larger than Shockley and Queisser efficiency in the same absorbed spectrum. What's more, at the room temperature the efficiency limits are well beyond 63% achieved by Luque and Marti (Ref\cite{26}) due to absorbing the low-energy photons via two sub-bands in this proposed photocell system. The achievements may reveal a novel theoretical approach to enhance the QD photocell performance modeled a multi-level absorbing photons system.


title: Multi-stakeholder Perspective on Responsible Artificial Intelligence and Acceptability in Education

abstract: This study investigates the acceptability of different artificial intelligence (AI) applications in education from a multi-stakeholder perspective, including students, teachers, and parents. Acknowledging the transformative potential of AI in education, it addresses concerns related to data privacy, AI agency, transparency, explainability and the ethical deployment of AI. Through a vignette methodology, participants were presented with four scenarios where AI's agency, transparency, explainability, and privacy were manipulated. After each scenario, participants completed a survey that captured their perceptions of AI's global utility, individual usefulness, justice, confidence, risk, and intention to use each scenario's AI if available. The data collection comprising a final sample of 1198 multi-stakeholder participants was distributed through a partner institution and social media campaigns and focused on individual responses to four AI use cases. A mediation analysis of the data indicated that acceptance and trust in AI varies significantly across stakeholder groups. We found that the key mediators between high and low levels of AI's agency, transparency, and explainability, as well as the intention to use the different educational AI, included perceived global utility, justice, and confidence. The study highlights that the acceptance of AI in education is a nuanced and multifaceted issue that requires careful consideration of specific AI applications and their characteristics, in addition to the diverse stakeholders' perceptions.


title: The $3k-4$ Theorem modulo a Prime: High Density for $A+B$

abstract: The $3k-4$ Theorem asserts that, if $A,\,B\subseteq \mathbb Z$ are finite, nonempty subsets with $|A|\geq |B|$ and $|A+B|=|A|+|B|+r< |A|+2|B|-3$, then there are arithmetic progressions $P_A$ and $P_B$ of common difference with $X\subseteq P_X$ with $|P_X|\leq |X|+r+1$ for all $X\in \{A,B\}$. There is much progress extending this result to $\mathbb Z/p\mathbb Z$ with $p\geq 2$ prime. Here we begin by showing that, if $A,\,B\subseteq G=\mathbb Z/p\mathbb Z$ are nonempty with $|A|\geq |B|$, $A+B\neq G$, $|A+B|=|A|+|B|+r\leq |A|+1.0527|B|-3$, and $|A+B|\leq |A|+|B|-9(r+3)$, then there are arithmetic progressions $P_A$, $P_B$ and $P_C$ of common difference such that $X\subseteq P_X$ with $|P_X|\leq |X|+r+1$ for all $X\in \{A,B,C\}$, where $C=-\,G\setminus (A+B)$. This gives a rare high density version of the $3k-4$ Theorem for general sumsets $A+B$ and is the first instance with tangible (rather than effectively existential) values for the constants for general sumsets $A+B$ with high density. The ideal conjectured density restriction under which a version of the $3k-4$ Theorem modulo $p$ is expected is $|A+B|\leq p-(r+3)$. In part by utilizing the above result as well as several other recent advances, we extend methods of Serra and Z\'emor to give a version valid under this ideal density constraint. We show that, if $A,\,B\subseteq G=\mathbb Z/p\mathbb Z$ are nonempty with $|A|\geq |B|$, $A+B\neq G$, $|A+B|=|A|+|B|+r\leq |A|+1.01|B|-3$, and $|A+B|\leq |A|+|B|-(r+3)$, then there exist arithmetic progressions $P_A$, $P_B$ and $P_C$ of common difference such that $X\subseteq P_X$ with $|P_X|\leq |X|+r+1$ for all $X\in \{A,B,C\}$, where $C=-\,G\setminus (A+B)$. This notably improves upon the original result of Serra and Z\'emor, who treated the case $A+A$, required $p$ be sufficiently large, and needed the much more restrictive small doubling hypothesis $|A+A|\leq |A|+1.0001|A|$.


title: Calculating the expected value function of a two-stage stochastic optimization program with a quantum algorithm

abstract: Stochastic optimization problems are powerful models for the operation of systems under uncertainty and are in general computationally intensive to solve. Two-stage stochastic optimization is one such problem, where the objective function involves calculating the expected cost of future decisions to inform the best decision in the present. In general, even approximating this expectation value is a #P-Hard problem. We provide a quantum algorithm to estimate the expected value function in a two-stage stochastic optimization problem in time complexity largely independent from the complexity of the random variable. Our algorithm works in two steps: (1) By representing the random variable in a register of qubits and using this register as control logic for a cost Hamiltonian acting on the primary system of qubits, we use the quantum alternating operator ansatz (QAOA) with operator angles following an annealing schedule to converge to the minimal decision for each scenario in parallel. (2) We then use Quantum Amplitude Estimation (QAE) to approximate the expected value function of the per-scenario optimized wavefunction. We show that the annealing time of the procedure in (1) is independent of the number of scenarios in the probability distribution. Additionally, estimation error in QAE converges inverse-linear in the number of "repetitions" of the algorithm, as opposed to converging as the inverse of the square root in traditional Monte Carlo sampling. Because both QAOA and QAE are expected to have polynomial advantage over their classical computing counterparts, we expect our algorithm to have polynomial advantage over classical methods to compute the expected value function. We implement our algorithms for a simple optimization problem inspired by operating the power grid with renewable generation and uncertainty in the weather, and give numerical evidence to support our arguments.


title: Adjusting for Ascertainment Bias in Meta-Analysis of Penetrance for Cancer Risk

abstract: Multi-gene panel testing allows efficient detection of pathogenic variants in cancer susceptibility genes including moderate-risk genes such as ATM and PALB2. A growing number of studies examine the risk of breast cancer (BC) conferred by pathogenic variants of such genes. A meta-analysis combining the reported risk estimates can provide an overall age-specific risk of developing BC, i.e., penetrance for a gene. However, estimates reported by case-control studies often suffer from ascertainment bias. Currently there are no methods available to adjust for such ascertainment bias in this setting. We consider a Bayesian random-effects meta-analysis method that can synthesize different types of risk measures and extend it to incorporate studies with ascertainment bias. This is achieved by introducing a bias term in the model and assigning appropriate priors. We validate the method through a simulation study and apply it to estimate BC penetrance for carriers of pathogenic variants of ATM and PALB2 genes. Our simulations show that the proposed method results in more accurate and precise penetrance estimates compared to when no adjustment is made for ascertainment bias or when such biased studies are discarded from the analysis. The estimated overall BC risk for individuals with pathogenic variants in (1) ATM is 5.77% (3.22%-9.67%) by age 50 and 26.13% (20.31%-32.94%) by age 80; (2) PALB2 is 12.99% (6.48%-22.23%) by age 50 and 44.69% (34.40%-55.80%) by age 80. The proposed method allows for meta-analyses to include studies with ascertainment bias resulting in a larger number of studies included and thereby more robust estimates.


title: The Dual Dynamical Foundation of Orthodox Quantum Mechanics

abstract: This paper combines mathematical, philosophical, and historical analyses in a comprehensive investigation of the dynamical foundations of the formalism of orthodox quantum mechanics. The results obtained include: (i) A deduction of the canonical commutation relations (CCR) from the tenets of Matrix Mechanics; (ii) A discussion of the meaning of Schr\"odinger's first derivation of the wave equation that not only improves on Joas and Lehner's 2009 investigation on the subject but also demonstrates that the CCR follow of necessity from Schr\"odinger's first derivation of the wave equation, thus correcting the common misconception that the CCR were only posited by Schr\"odinger to pursue equivalence with Matrix Mechanics; (iii) A discussion of the mathematical facts and requirements involved in the equivalence of Matrix and Wave Mechanics that improves on F. A. Muller's classical treatment of the subject; (iv) A proof that the equivalence of Matrix and Wave Mechanics is necessitated by the formal requirements of a dual action functional from which both the dynamical postulates of orthodox quantum mechanics, von Neumann's process 1 and process 2, follow; (v) A critical assessment, based on (iii) and (iv), of von Neumann's construction of unified quantum mechanics over Hilbert space. Point (iv) is our main result. It brings to the open the important, but hitherto ignored, fact that orthodox quantum mechanics is no exception to the golden rule of physics that the dynamics of a physical theory must follow from the action functional. If orthodox quantum mechanics, based as it is on the assumption of the equivalence of Matrix and Wave Mechanics, has this "peculiar dual dynamics," as von Neumann called it, this is so because by assuming the equivalence one has been assuming a peculiar dual action.


title: Analysis of Conformally Invariant Energies on four-Dimensional Hypersurfaces

abstract: We discuss a large class of conformally invariant curvature energies for immersed hypersurfaces of dimension 4. The class under study includes various examples that have appeared in the recent literature and which arise from different contexts. We show that under natural small-energy hypotheses, critical points satisfy improved energy estimates. Nearly all the PDEs which we consider are quasilinear and fourth-order in the mean curvature. We approach the problem a la T. Riviere by generating first from Noether's theorem divergence-free "potentials", and then by exhibiting an underlying analytically favourable algebraic structure relating them. Similar ideas are used to obtain energy estimates for the Weyl tensor of a Bach-flat immersion. Finally, we show how to use Noether's theorem and the Gauss-Bonnet theorem to construct on a hypersurface non-trivial divergence-free and Codazzi symmetric two-tensors, cubic in the second fundamental form.


title: Two-Stage Block Orthogonalization to Improve Performance of $s$-step GMRES

abstract: On current computer architectures, GMRES' performance can be limited by its communication cost to generate orthonormal basis vectors of the Krylov subspace. To address this performance bottleneck, its $s$-step variant orthogonalizes a block of $s$ basis vectors at a time, potentially reducing the communication cost by a factor of $s$. Unfortunately, for a large step size $s$, the solver can generate extremely ill-conditioned basis vectors, and to maintain stability in practice, a conservatively small step size is used, which limits the performance of the $s$-step solver. To enhance the performance using a small step size, in this paper, we introduce a two-stage block orthogonalization scheme. Similar to the original scheme, the first stage of the proposed method operates on a block of $s$ basis vectors at a time, but its objective is to maintain the well-conditioning of the generated basis vectors with a lower cost. The orthogonalization of the basis vectors is delayed until the second stage when enough basis vectors are generated to obtain higher performance. Our analysis shows the stability of the proposed two-stage scheme. The performance is improved because while the same amount of computation as the original scheme is required, most of the communication is done at the second stage of the proposed scheme, reducing the overall communication requirements. Our performance results with up to 192 NVIDIA V100 GPUs on the Summit supercomputer demonstrate that when solving a 2D Laplace problem, the two-stage approach can reduce the orthogonalization time and the total time-to-solution by the respective factors of up to $2.6\times$ and $1.6\times$ over the original $s$-step GMRES, which had already obtained the respective speedups of $2.1\times$ and $1.8\times$ over the standard GMRES. Similar speedups were obtained for 3D problems and for matrices from the SuiteSparse Matrix Collection.


title: Rectilinear Crossing Number of Graphs Excluding Single-Crossing Graphs as Minors

abstract: The crossing number of a graph $G$ is the minimum number of crossings in a drawing of $G$ in the plane. A rectilinear drawing of a graph $G$ represents vertices of $G$ by a set of points in the plane and represents each edge of $G$ by a straight-line segment connecting its two endpoints. The rectilinear crossing number of $G$ is the minimum number of crossings in a rectilinear drawing of $G$. By the crossing lemma, the crossing number of an $n$-vertex graph $G$ can be $O(n)$ only if $|E(G)|\in O(n)$. Graphs of bounded genus and bounded degree (B\"{o}r\"{o}czky, Pach and T\'{o}th, 2006) and in fact all bounded degree proper minor-closed families (Wood and Telle, 2007) have been shown to admit linear crossing number, with tight $\Theta(\Delta n)$ bound shown by Dujmovi\'c, Kawarabayashi, Mohar and Wood, 2008. Much less is known about rectilinear crossing number. It is not bounded by any function of the crossing number. We prove that graphs that exclude a single-crossing graph as a minor have the rectilinear crossing number $O(\Delta n)$. This dependence on $n$ and $\Delta$ is best possible. A single-crossing graph is a graph whose crossing number is at most one. Thus the result applies to $K_5$-minor-free graphs, for example. It also applies to bounded treewidth graphs, since each family of bounded treewidth graphs excludes some fixed planar graph as a minor. Prior to our work, the only bounded degree minor-closed families known to have linear rectilinear crossing number were bounded degree graphs of bounded treewidth (Wood and Telle, 2007), as well as, bounded degree $K_{3,3}$-minor-free graphs (Dujmovi\'c, Kawarabayashi, Mohar and Wood, 2008). In the case of bounded treewidth graphs, our $O(\Delta n)$ result is again tight and improves on the previous best known bound of $O(\Delta^2 n)$ by Wood and Telle, 2007 (obtained for convex geometric drawings).


title: Constraining the quark and gluon helicity at STAR

abstract: How quarks and gluons conspire to provide the total spin of proton is a long-standing puzzle in quantum chromodynamics (QCD). The unique capability of RHIC, that can provide longitudinally polarized $p+p$ collisions at both $\sqrt{s} = 200$ GeV and $\sqrt{s} = 510$ GeV, opened new territory to constrain the helicity structure of the proton with unprecedented depth and precision. Results from various STAR spin measurements have contributed significantly to our understanding of the quark and gluon helicity distributions inside the proton. The longitudinal double-spin asymmetry, $A_{LL}$, from the STAR 2009 inclusive jet measurement, provides the first indication of the positive gluon polarization with partonic momentum fraction $x$ greater than 0.05 inside the proton. More precise measurements using the $p+p$ data collected in 2012, 2013 and 2015 at both $\sqrt{s}$ = 510 and 200 GeV confirm the previous findings and provide additional constraints in the largely unexplored region of $x < 0.05$. Compared to the inclusive jet observables, analyses of dijet production extending to higher pseudorapidity (up to $\eta \sim 1.8$) provide better constraints on the $x$ dependent behavior of $\Delta g(x)$. Moreover, the reconstruction of $W^{\pm}$ in longitudinally polarized proton-proton collisions provides significant constraints on the flavor separation of the light sea quark helicity distributions inside the proton, while the longitudinal spin transfer to $\Lambda$ and $\bar \Lambda$ hyperons provides access to the helicity of strange and anti-strange quarks in the proton. In this proceeding, an overview of dijet measurements from longitudinally polarized proton-proton collisions at STAR is presented.


title: Elastic interactions compete with persistent cell motility to drive durotaxis

abstract: Many animal cells crawling on elastic substrates exhibit durotaxis and have implications in several biological processes including tissue development, and tumor progression. Here, we introduce a phenomenological model for durotactic migration incorporating both elastic deformation-mediated cell-substrate interactions and the stochasticity of cell migration. Our model is motivated by the key observation in one of the first demonstrations of durotaxis: a single contractile cell at an interface between a softer and a stiffer region of an elastic substrate reorients and migrates towards the stiffer region. We model migrating cells as self-propelling, persistently motile agents that exert contractile, dipolar traction forces on the underlying elastic substrate. The resulting substrate deformations induce elastic interactions with mechanical boundaries, captured by an elastic potential that depends on cell position and orientation relative to the boundary. The potential is attractive or repulsive depending on whether the mechanical boundary condition is clamped or free, which represents the cell being on the softer or stiffer side, respectively, of a confining boundary. The forces and torques from the interactions drive cells to orient perpendicular (parallel) to the boundary and accumulate (deplete) at the clamped (free) boundary, extent of which is determined by elastic potential (A) and motility (Pe). While the elastic interaction drives durotaxis, cell migratory movements such as random reorientation and self-propulsion enable the cell from the attractive potential thereby reducing durotaxis. We define metrics quantifying boundary accumulation and durotaxis and present a phase diagram that identifies three possible regimes: durotaxis, adurotaxis without accumulation and adurotaxis with motility-induced accumulation at a confining boundary.


title: Analyzing Games in Maker Protocol Part One: A Multi-Agent Influence Diagram Approach Towards Coordination

abstract: Decentralized Finance (DeFi) ecosystems, exemplified by the Maker Protocol, rely on intricate games to maintain stability and security. Understanding the dynamics of these games is crucial for ensuring the robustness of the system. This motivating research proposes a novel methodology leveraging Multi-Agent Influence Diagrams (MAID), originally proposed by Koller and Milch, to dissect and analyze the games within the Maker stablecoin protocol. By representing users and governance of the Maker protocol as agents and their interactions as edges in a graph, we capture the complex network of influences governing agent behaviors. Furthermore in the upcoming papers, we will show a Nash Equilibrium model to elucidate strategies that promote coordination and enhance economic security within the ecosystem. Through this approach, we aim to motivate the use of this method to introduce a new method of formal verification of game theoretic security in DeFi platforms.


title: Dynamics-Guided Diffusion Model for Robot Manipulator Design

abstract: We present Dynamics-Guided Diffusion Model, a data-driven framework for generating manipulator geometry designs for a given manipulation task. Instead of training different design models for each task, our approach employs a learned dynamics network shared across tasks. For a new manipulation task, we first decompose it into a collection of individual motion targets which we call target interaction profile, where each individual motion can be modeled by the shared dynamics network. The design objective constructed from the target and predicted interaction profiles provides a gradient to guide the refinement of finger geometry for the task. This refinement process is executed as a classifier-guided diffusion process, where the design objective acts as the classifier guidance. We evaluate our framework on various manipulation tasks, under the sensor-less setting using only an open-loop parallel jaw motion. Our generated designs outperform optimization-based and unguided diffusion baselines relatively by 31.5% and 45.3% on average manipulation success rate. With the ability to generate a design within 0.8 seconds, our framework could facilitate rapid design iteration and enhance the adoption of data-driven approaches for robotic mechanism design.


title: Descripci\'on autom\'atica de secciones delgadas de rocas: una aplicaci\'on Web

abstract: The identification and characterization of various rock types is one of the fundamental activities for geology and related areas such as mining, petroleum, environment, industry and construction. Traditionally, a human specialist is responsible for analyzing and explaining details about the type, composition, texture, shape and other properties using rock samples collected in-situ or prepared in a laboratory. The results become subjective based on experience, in addition to consuming a large investment of time and effort. The present proposal uses artificial intelligence techniques combining computer vision and natural language processing to generate a textual and verbal description from a thin section image of rock. We build a dataset of images and their respective textual descriptions for the training of a model that associates the relevant features of the image extracted by EfficientNetB7 with the textual description generated by a Transformer network, reaching an accuracy value of 0.892 and a BLEU value of 0.71. This model can be a useful resource for research, professional and academic work, so it has been deployed through a Web application for public use.


title: Ramification and unicity theorems for Gauss maps of complete space-like stationary surfaces in four-dimensional Lorentz-Minkowski space

abstract: In this paper, we investigate the value distribution properties for Gauss maps of space-like stationary surfaces in four-dimensional Lorentz-Minkowski space $\mathbb{R}^{3,1}$, focusing on aspects such as the number of totally ramified points and unicity properties. We not only obtain general conclusions similar to situations in four-dimensional Euclidean space, but also consider the space-like stationary surfaces with rational graphic Gauss image, which is an extension of degenerate space-like stationary surfaces.


title: Observation of the First-Order Interference Fringes Beyond Coherence Length Employing Commercial Continuous-wave Multi-mode Laser Diode: A Sight of Two-photon Interference

abstract: We report an experiment of observation of classical double-slit interference fringes of two-photon interference. In the experiment, a commercial continuous-wave multi-mode F-P laser diode without either mode-locked or frequency-locked is used as the light source, the density of photons is far more than the single-photon level, and the path difference of the long and short paths is far more than the longitudinal coherence length of the laser diode. The temporal stable and clearly visible spatial-distributed pattern, i.e. first-order interference fringes, was observed .Contradict to the prediction of single-photon interference mechanism, the interference happened far beyond the coherence length, the occurrence possibility and time duration of the interference fringes decrease with the reduction of mode number of the LD, and the time difference between the fringes disappearance and the light vanish is equal to the time difference of the two paths. After discussion, we came to the conclusion that the observed phenomena can be understood in time-resolved two-photon interference mechanism. We reveal a new method to perform two-photon first-order interference, and this help to understand the nature of two-photon interference and also can be useful for quantum information science.


title: Searching for Exotic Spin-Dependent Interactions with Diamond-Based Vector Magnetometer

abstract: We propose a new method to search for exotic spin-spin interactions between electrons and nucleons using a diamond-based vector magnetometer. The vector magnetometer can be constructed from ensembles of nitrogen-vacancy centers along different axes in a diamond. The $^{14}\mathrm{N} $ nuclear spins of nitrogen-vacancy centers in the same diamond can be polarized through the dynamic nuclear polarization method to serve as spin sources. With the vector magnetometer, the sought-after exotic interactions can be distinguished from the magnetic dipole-dipole interaction. For the axion-mediated interaction $ V_{PP} $, new upper bounds of the coupling $ |g_{P}^{e} g_{P}^{N}| $ are expected within the force range from 10 nm to 100 $ \mu $m. For the $ Z' $-mediated interaction $ V_{AA} $, new upper bounds of the coupling $ |g_{A}^{e} g_{A}^{N}| $ are expected within the force range from 10 nm to 1 cm. The new upper bounds for $ V_{PP} $ and $ V_{AA} $ are both expected to be more than 5 orders of magnitude more stringent than existing constraints at the force range of 1 $ \mu $m with the total measurement time of one day.


title: KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models

abstract: Automatic evaluation methods for large language models (LLMs) are hindered by data contamination, leading to inflated assessments of their effectiveness. Existing strategies, which aim to detect contaminated texts, focus on quantifying contamination status instead of accurately gauging model performance. In this paper, we introduce KIEval, a Knowledge-grounded Interactive Evaluation framework, which incorporates an LLM-powered "interactor" role for the first time to accomplish a dynamic contamination-resilient evaluation. Starting with a question in a conventional LLM benchmark involving domain-specific knowledge, KIEval utilizes dynamically generated, multi-round, and knowledge-focused dialogues to determine whether a model's response is merely a recall of benchmark answers or demonstrates a deep comprehension to apply knowledge in more complex conversations. Extensive experiments on seven leading LLMs across five datasets validate KIEval's effectiveness and generalization. We also reveal that data contamination brings no contribution or even negative effect to models' real-world applicability and understanding, and existing contamination detection methods for LLMs can only identify contamination in pre-training but not during supervised fine-tuning.


title: Fiducial Focus Augmentation for Facial Landmark Detection

abstract: Deep learning methods have led to significant improvements in the performance on the facial landmark detection (FLD) task. However, detecting landmarks in challenging settings, such as head pose changes, exaggerated expressions, or uneven illumination, continue to remain a challenge due to high variability and insufficient samples. This inadequacy can be attributed to the model's inability to effectively acquire appropriate facial structure information from the input images. To address this, we propose a novel image augmentation technique specifically designed for the FLD task to enhance the model's understanding of facial structures. To effectively utilize the newly proposed augmentation technique, we employ a Siamese architecture-based training mechanism with a Deep Canonical Correlation Analysis (DCCA)-based loss to achieve collective learning of high-level feature representations from two different views of the input images. Furthermore, we employ a Transformer + CNN-based network with a custom hourglass module as the robust backbone for the Siamese framework. Extensive experiments show that our approach outperforms multiple state-of-the-art approaches across various benchmark datasets.


title: Effective description of a quantum particle constrained to a catenoid

abstract: We describe a quantum particle constrained on a catenoid, employing an effective description of quantum mechanics based on expected values of observables and quantum dispersions. We obtain semiclassical trajectories for particles, displaying general features of the quantum behaviour; most interestingly, particles present tunneling through the throat of the catenoid, a characteristic having important physical applications


title: CARBD-Ko: A Contextually Annotated Review Benchmark Dataset for Aspect-Level Sentiment Classification in Korean

abstract: This paper explores the challenges posed by aspect-based sentiment classification (ABSC) within pretrained language models (PLMs), with a particular focus on contextualization and hallucination issues. In order to tackle these challenges, we introduce CARBD-Ko (a Contextually Annotated Review Benchmark Dataset for Aspect-Based Sentiment Classification in Korean), a benchmark dataset that incorporates aspects and dual-tagged polarities to distinguish between aspect-specific and aspect-agnostic sentiment classification. The dataset consists of sentences annotated with specific aspects, aspect polarity, aspect-agnostic polarity, and the intensity of aspects. To address the issue of dual-tagged aspect polarities, we propose a novel approach employing a Siamese Network. Our experimental findings highlight the inherent difficulties in accurately predicting dual-polarities and underscore the significance of contextualized sentiment analysis models. The CARBD-Ko dataset serves as a valuable resource for future research endeavors in aspect-level sentiment classification.


title: Networked Collaborative Sensing using Multi-domain Measurements: Architectures, Performance Limits and Algorithms

abstract: As a promising 6G technology, integrated sensing and communication (ISAC) gains growing interest. ISAC provides integration gain via sharing spectrum, hardware, and software. However, concerns exist regarding its sensing performance when compared to dedicated radar systems. To address this issue, the advantages of widely deployed networks should be utilized, and this paper proposes networked collaborative sensing (NCS) using multi-domain measurements (MM), including range, Doppler, and two-dimension angle of arrival. In the NCS-MM architecture, this paper proposes a novel multi-domain decoupling model and a novel guard band-based protocol. The proposed model simplifies multi-domain derivations and algorithm designs, and the proposed protocol conserves resources and mitigates NCS interference. To determine the performance limits, this paper derives the Cram\'er-Rao lower bound (CRLB) of three-dimension position and velocity in NCS-MM. An accumulated single-dimension channel model is used to obtain the CRLB of MM, which is proven to be equivalent to that of the multi-dimension model. The algorithms of both MM estimation and fusion are proposed. An arbitrary-dimension Newtonized orthogonal matched pursuit (AD-NOMP) is proposed to accurately estimate grid-less MM. The degree-of-freedom (DoF) of MM is analyzed, and a novel DoF-based two-stage weighted least squares (TSWLS) is proposed to reduce equations without DoF loss. The numerical results show that the performances of the proposed algorithms are close to their performance limits.


title: Unlocking the Power of Large Language Models for Entity Alignment

abstract: Entity Alignment (EA) is vital for integrating diverse knowledge graph (KG) data, playing a crucial role in data-driven AI applications. Traditional EA methods primarily rely on comparing entity embeddings, but their effectiveness is constrained by the limited input KG data and the capabilities of the representation learning techniques. Against this backdrop, we introduce ChatEA, an innovative framework that incorporates large language models (LLMs) to improve EA. To address the constraints of limited input KG data, ChatEA introduces a KG-code translation module that translates KG structures into a format understandable by LLMs, thereby allowing LLMs to utilize their extensive background knowledge to improve EA accuracy. To overcome the over-reliance on entity embedding comparisons, ChatEA implements a two-stage EA strategy that capitalizes on LLMs' capability for multi-step reasoning in a dialogue format, thereby enhancing accuracy while preserving efficiency. Our experimental results affirm ChatEA's superior performance, highlighting LLMs' potential in facilitating EA tasks.


title: The use of Specutils by Data Central

abstract: Specutils is an Astropy affiliated package which provides a consistent interface to astronomical spectra (primarily 1D). As Specutils can be adapted to parse spectra in many different formats, Specutils plays a key role at Data Central, allowing us to handle the diverse formats provided to us by survey teams. In this poster, I will cover what Specutils is, how it works, how Data Central uses it, and why you too should use and contribute to it.


title: Energy Extraction via Magnetic Reconnection in Konoplya-Rezzolla-Zhidenko Parametrized Black Holes

abstract: Recently, Comisso and Asenjo proposed a novel mechanism for harnessing energy from black holes through magnetic reconnection. Our study focuses on exploring the utilization of this mechanism on Konoplya-Rezzolla-Zhidenko (KRZ) parametrized black holes to assess the impact of deformation parameters on energy extraction. Among the various parameters, $\{\delta_1, \delta_2\}$ are identified as the most important factors affecting the physics under consideration. The influence of these two parameters on the ergoregion, circular geodesics in the equatorial plane, and energy extraction from the KRZ black holes through magnetic reconnection is carefully analyzed. Results indicate that deviations from the Kerr metric have a notable influence on the energy extraction process. Particularly, energy extraction is enhanced with more negative ${\delta_1}$ or more positive ${\delta_2}$ within the range constrained by current astronomical observations, resulting in significantly higher maximum power and efficiency compared to the Kerr model. Moreover, when ${\delta_2}$ is sufficiently negative, extracting energy through this mechanism becomes increasingly challenging, necessitating an exceptionally high black hole spin.


title: Prediction of Fishbone Linear Instability in Tokamaks with Machine Learning Methods

abstract: A machine learning based surrogate model for fishbone linear instability in tokamaks is constructed. Hybrid simulations with the kinetic-magnetohydrodynamic (MHD) code M3D-K is used to generate the database of fishbone linear instability, through scanning the four key parameters which are thought to determine the fishbone physics. The four key parameters include (1) central total beta of both thermal plasma and fast ions, (2) the fast ion pressure fraction, (3) central value of safety factor $q$ and (4) the radius of $q=1$ surface. Four machine learning methods including linear regression, support vector machines (SVM) with linear kernel, SVM with nonlinear kernel and multi-layer perceptron are used to predict the fishbone instability, growth rate and real frequency, mode structure respectively. Among the four methods, SVM with nonlinear kernel performs very well to predict the linear instability with accuracy $\approx$95%, growth rate and real frequency with $R^2\approx$98%, mode structure with $R^2\approx$98%.


title: ToMBench: Benchmarking Theory of Mind in Large Language Models

abstract: Theory of Mind (ToM) is the cognitive capability to perceive and ascribe mental states to oneself and others. Recent research has sparked a debate over whether large language models (LLMs) exhibit a form of ToM. However, existing ToM evaluations are hindered by challenges such as constrained scope, subjective judgment, and unintended contamination, yielding inadequate assessments. To address this gap, we introduce ToMBench with three key characteristics: a systematic evaluation framework encompassing 8 tasks and 31 abilities in social cognition, a multiple-choice question format to support automated and unbiased evaluation, and a build-from-scratch bilingual inventory to strictly avoid data leakage. Based on ToMBench, we conduct extensive experiments to evaluate the ToM performance of 10 popular LLMs across tasks and abilities. We find that even the most advanced LLMs like GPT-4 lag behind human performance by over 10% points, indicating that LLMs have not achieved a human-level theory of mind yet. Our aim with ToMBench is to enable an efficient and effective evaluation of LLMs' ToM capabilities, thereby facilitating the development of LLMs with inherent social intelligence.


title: Nonlinear Bayesian optimal experimental design using logarithmic Sobolev inequalities

abstract: We study the problem of selecting $k$ experiments from a larger candidate pool, where the goal is to maximize mutual information (MI) between the selected subset and the underlying parameters. Finding the exact solution is to this combinatorial optimization problem is computationally costly, not only due to the complexity of the combinatorial search but also the difficulty of evaluating MI in nonlinear/non-Gaussian settings. We propose greedy approaches based on new computationally inexpensive lower bounds for MI, constructed via log-Sobolev inequalities. We demonstrate that our method outperforms random selection strategies, Gaussian approximations, and nested Monte Carlo (NMC) estimators of MI in various settings, including optimal design for nonlinear models with non-additive noise.


title: Dynamical Reversibility and A New Theory of Causal Emergence

abstract: The theory of causal emergence based on effective information(EI) suggests that complex systems may exhibit a phenomenon called causal emergence(CE), where the macro-dynamics demonstrate a stronger causal effect than the micro-dynamics. However, a challenge in this theory is the dependence on the method used to coarse-grain the system. In this paper, we introduce a fresh concept of approximate dynamical reversibility and establish a novel framework for CE based on this and singular value decomposition. Our research not only reveals a strong correlation between the proximity of a Markov chain being dynamically reversible and EI in assessing causal effects across various scenarios but also demonstrates that EI is constrained by the logarithm of the approximate dynamical reversibility. Leveraging this concept, we present an innovative approach to quantifying CE that is agnostic to specific coarse-graining techniques and effectively captures the inherent characteristics of Markov dynamics. Through empirical evaluations on examples of boolean networks, cellular automata, and complex networks, we validate our refined CE definition.

categories: cond-mat.stat-mech math-ph math.MP physics.data-an


title: Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions

abstract: In this paper, we investigate the interplay between attention heads and specialized "next-token" neurons in the Multilayer Perceptron that predict specific tokens. By prompting an LLM like GPT-4 to explain these model internals, we can elucidate attention mechanisms that activate certain next-token neurons. Our analysis identifies attention heads that recognize contexts relevant to predicting a particular token, activating the associated neuron through the residual connection. We focus specifically on heads in earlier layers consistently activating the same next-token neuron across similar prompts. Exploring these differential activation patterns reveals that heads that specialize for distinct linguistic contexts are tied to generating certain tokens. Overall, our method combines neural explanations and probing isolated components to illuminate how attention enables context-dependent, specialized processing in LLMs.


title: Effects of Misorientation on Single Crystal Plasticity by Finite Element Methods

abstract: The crystal plasticity finite element method (CPFEM) is a widely used technique for resolving macroscopic stress and strain onto the physically relevant length scales of grains and slip systems in ductile crystalline materials like structural metals. Here, the calibration of a CPFEM model for single crystal applications was found to depend critically on loading orientation, with an effect significant even at an angle of 0.1 degrees. Slight misorientation from high symmetry loading affected lattice rotation during tensile deformation, changing the number of active slip systems, and, as a result, the overall stress-strain behavior. The strongest misorientation effects occurred around the multi-slip orientations of [001], [111], [101], and [102], while the single slip orientation of [213] showed a negligible effect, as expected, and the double slip orientation of [112] showed less of an effect than [102] due to its relative lattice orientation stability. The magnitude of the misorientation effect increased dramatically with the strength of slip system interaction, which, in the chosen hardening framework, is represented by the latent hardening coefficient. In a case study on [001] Cu, offsets of 0.3-2.0 degrees gave stress values at an engineering strain of 0.25 that were lower by 15-18% relative to the direct loading values, highlighting the importance of exact orientations for single crystal plasticity parameterization and application.


title: On the Multi-turn Instruction Following for Conversational Web Agents

abstract: Web agents powered by Large Language Models (LLMs) have demonstrated remarkable abilities in planning and executing multi-step interactions within complex web-based environments, fulfilling a wide range of web navigation tasks. Despite these advancements, the potential for LLM-powered agents to effectively engage with sequential user instructions in real-world scenarios has not been fully explored. In this work, we introduce a new task of Conversational Web Navigation, which necessitates sophisticated interactions that span multiple turns with both the users and the environment, supported by a specially developed dataset named Multi-Turn Mind2Web (MT-Mind2Web). To tackle the limited context length of LLMs and the context-dependency issue of the conversational tasks, we further propose a novel framework, named self-reflective memory-augmented planning (Self-MAP), which employs memory utilization and self-reflection techniques. Extensive experiments are conducted to benchmark the MT-Mind2Web dataset, and validate the effectiveness of the proposed method.


title: Mixup Barcodes: Quantifying Geometric-Topological Interactions between Point Clouds

abstract: We combine standard persistent homology with image persistent homology to define a novel way of characterizing shapes and interactions between them. In particular, we introduce: (1) a mixup barcode, which captures geometric-topological interactions (mixup) between two point sets in arbitrary dimension; (2) simple summary statistics, total mixup and total percentage mixup, which quantify the complexity of the interactions as a single number; (3) a software tool for playing with the above. As a proof of concept, we apply this tool to a problem arising from machine learning. In particular, we study the disentanglement in embeddings of different classes. The results suggest that topological mixup is a useful method for characterizing interactions for low and high-dimensional data. Compared to the typical usage of persistent homology, the new tool is sensitive to the geometric locations of the topological features, which is often desirable.


title: ColBERT-XM: A Modular Multi-Vector Representation Model for Zero-Shot Multilingual Information Retrieval

abstract: State-of-the-art neural retrievers predominantly focus on high-resource languages like English, which impedes their adoption in retrieval scenarios involving other languages. Current approaches circumvent the lack of high-quality labeled data in non-English languages by leveraging multilingual pretrained language models capable of cross-lingual transfer. However, these models require substantial task-specific fine-tuning across multiple languages, often perform poorly in languages with minimal representation in the pretraining corpus, and struggle to incorporate new languages after the pretraining phase. In this work, we present a novel modular dense retrieval model that learns from the rich data of a single high-resource language and effectively zero-shot transfers to a wide array of languages, thereby eliminating the need for language-specific labeled data. Our model, ColBERT-XM, demonstrates competitive performance against existing state-of-the-art multilingual retrievers trained on more extensive datasets in various languages. Further analysis reveals that our modular approach is highly data-efficient, effectively adapts to out-of-distribution data, and significantly reduces energy consumption and carbon emissions. By demonstrating its proficiency in zero-shot scenarios, ColBERT-XM marks a shift towards more sustainable and inclusive retrieval systems, enabling effective information accessibility in numerous languages. We publicly release our code and models for the community.


title: A uniformly ergodic Gibbs sampler for Bayesian survival analysis

abstract: Finite sample inference for Cox models is an important problem in many settings, such as clinical trials. Bayesian procedures provide a means for finite sample inference and incorporation of prior information if MCMC algorithms and posteriors are well behaved. On the other hand, estimation procedures should also retain inferential properties in high dimensional settings. In addition, estimation procedures should be able to incorporate constraints and multilevel modeling such as cure models and frailty models in a straightforward manner. In order to tackle these modeling challenges, we propose a uniformly ergodic Gibbs sampler for a broad class of convex set constrained multilevel Cox models. We develop two key strategies. First, we exploit a connection between Cox models and negative binomial processes through the Poisson process to reduce Bayesian computation to iterative Gaussian sampling. Next, we appeal to sufficient dimension reduction to address the difficult computation of nonparametric baseline hazards, allowing for the collapse of the Markov transition operator within the Gibbs sampler based on sufficient statistics. We demonstrate our approach using open source data and simulations.


title: Fine-tuning Large Language Models for Domain-specific Machine Translation

abstract: Large language models (LLMs) have made significant progress in machine translation (MT). However, their potential in domain-specific MT remains under-explored. Current LLM-based MT systems still face several challenges. First, for LLMs with in-context learning, their effectiveness is highly sensitive to input translation examples, and processing them can increase inference costs. They often require extra post-processing due to over-generation. Second, LLMs with fine-tuning on domain-specific data often require high training costs for domain adaptation, and may weaken the zero-shot MT capabilities of LLMs due to over-specialization. The aforementioned methods can struggle to translate rare words in domain transfer scenarios. To address these challenges, this paper proposes a prompt-oriented fine-tuning method, denoted as LlamaIT, to effectively and efficiently fine-tune a general-purpose LLM for domain-specific MT tasks. First, we construct a task-specific mix-domain dataset, which is then used to fine-tune the LLM with LoRA. This can eliminate the need for input translation examples, post-processing, or over-specialization. By zero-shot prompting with instructions, we adapt the MT tasks to the target domain at inference time. To further elicit the MT capability for rare words, we construct new prompts by incorporating domain-specific bilingual vocabulary. We also conduct extensive experiments on both publicly available and self-constructed datasets. The results show that our LlamaIT can significantly enhance the domain-specific MT capabilities of the LLM, meanwhile preserving its zero-shot MT capabilities.


title: Gotcha! Don't trick me with unanswerable questions! Self-aligning Large Language Models for Responding to Unknown Questions

abstract: Despite the remarkable abilities of Large Language Models (LLMs) to answer questions, they often display a considerable level of overconfidence even when the question does not have a definitive answer. To avoid providing hallucinated answers to these unknown questions, existing studies typically investigate approaches to refusing to answer these questions. In this work, we propose a novel and scalable self-alignment method to utilize the LLM itself to enhance its response-ability to different types of unknown questions, being capable of not only refusing to answer but also providing explanation to the unanswerability of unknown questions. Specifically, the Self-Align method first employ a two-stage class-aware self-augmentation approach to generate a large amount of unknown question-response data. Then we conduct disparity-driven self-curation to select qualified data for fine-tuning the LLM itself for aligning the responses to unknown questions as desired. Experimental results on two datasets across four types of unknown questions validate the superiority of the Self-Align method over existing baselines in terms of three types of task formulation.


title: Efficient Evaluations of Weighted Sums over the Boolean Lattice inspired by conjectures of Berti, Corsi, Maspero, and Ventura

abstract: In their study of water waves, Massimiliano Berti, Livia Corsi, Alberto Maspero, and Paulo Ventura, came up with two intriguing conjectured identities involving certain weighted sums over the Boolean lattice. They were able to prove the first one, while the second is still open. In this methodological note, we will describe how to generate many terms of these types of weighted sums, and if in luck, evaluate them in closed-form. We were able to use this approach to give a new proof of their first conjecture, and while we failed to prove the second conjecture, we give overwhelming evidence for its veracity. In this second version, we are happy to announce that Mark van Hoeij was able to complete the proof of the second conjecture, by explicitly solving the second-order recurrence mentioned at the end.


title: Single-photon generation from a neodymium ion in optical fiber at room temperature

abstract: The realization of single-photon generation is important for implementing various quantum information technologies. The use of rare-earth ions in an optical fiber is a promising single photon generation method due to its ability to operate at room temperature as well as the low cost involved. Neodymium ions are especially interesting because the ions are one of the most commercially affordable rare-earth materials in the current industry. The neodymium ion also has the advantage of having a rich energy level structure, which offers several possible wavelengths for emitted single photons from visible to near-telecommunication wavelengths. In this paper, we experimentally demonstrated single-photon generation using an isolated single neodymium ion in tapered silica fiber at room temperature. Our results have significant implications as a platform for low-cost wavelength-selectable single-photon sources and photonic quantum applications.


title: Epstein Surfaces, $W$-Volume, and the Osgood-Stowe Differential

abstract: In a seminal paper, Epstein introduced the theory of what are now called Epstein surfaces, which construct surfaces in $\mathbb{H}^3$ associated to a conformal metric on a domain in $\hat{\mathbb{C}}$. More recently, these surfaces have been used by Krasnov-Schlenker to define the W-volume and renormalized volume associated with a convex co-compact hyperbolic 3-manifold. In this paper we consider Epstein surfaces, W-volume and renormalized volume in two main parts. In the first, we develop an alternate construction of Epstein surfaces using the Osgood-Stowe differential, a generalization of the Schwarzian derivative. Krasnov-Schlenker showed that the metric and shape operator of a surface in hyperbolic space is naturally dual to a conformal metric and shape operator on a projective structure via the hyperbolic Gauss map. We show that this projective shape operator can be derived from the Osgood-Stowe differential. This approach allows us to give a comprehensive and self-contained development of Epstein surfaces, W-volume, and renormalized volume. In the second part, we use the theory developed in the first to prove a number of new results including a generalization of Epstein's univalence criterion, a variational formula for W-volume in terms of the Osgood-Stowe differential, and a use of W-volume to relate the length of the bending lamination of the convex core to the norm of the Schwarzian derivative of the associated univalent map on the conformal boundary.


title: Spin Doctors: How to diagnose a hierarchical merger origin

abstract: Gravitational-wave observations provide the unique opportunity of studying black hole formation channels and histories -- but only if we can identify their origin. One such formation mechanism is the dynamical synthesis of black hole binaries in dense stellar systems. Given the expected isotropic distribution of component spins of binary black hole in gas-free dynamical environments, the presence of anti-aligned or in-plane spins with respect to the orbital angular momentum is considered a tell-tale sign of a merger's dynamical origin. Even in the scenario where birth spins of black holes are low, hierarchical mergers attain large component spins due to the orbital angular momentum of the prior merger. However, measuring such spin configurations is difficult. Here, we quantify the efficacy of the spin parameters encoding aligned-spin ($\chi_{\rm eff}$) and in-plane spin ($\chi_{\rm p}$) at classifying such hierarchical systems. Using Monte Carlo cluster simulations to generate a realistic distribution of hierarchical merger parameters from globular clusters, we can infer mergers' $\chi_{\rm eff}$ and $\chi_{rm p}$. The cluster populations are simulated using Advanced LIGO-Virgo sensitivity during the detector network's third observing period and projections for design sensitivity. Using a "likelihood-ratio"-based statistic, we find that $\sim2\%$ of the recovered population by the current gravitational-wave detector network has a statistically significant $\chi_{\rm p}$ measurement, whereas no $\chi_{\rm eff}$ measurement was capable of confidently determining a system to be anti-aligned with the orbital angular momentum at current detector sensitivities. These results indicate that measuring spin-precession through $\chi_{\rm p}$ is a more detectable signature of a hierarchical mergers and dynamical formation than anti-aligned spins.


title: Magnetar as the Central Engine of AT2018cow: Optical, Soft X-Ray, and Hard X-Ray Emission

abstract: AT2018cow is the most extensively observed and widely studied fast blue optical transient to date; its unique observational properties challenge all existing standard models. In this paper, we model the luminosity evolution of the optical, soft X-ray, and hard X-ray emission, as well as the X-ray spectrum of AT2018cow with a magnetar-centered engine model. We consider a two-zone model with a striped magnetar wind in the interior and an expanding ejecta outside. The soft and hard X-ray emission of AT2018cow can be explained by the leakage of high-energy photons produced by internal gradual magnetic dissipation in the striped magnetar wind, while the luminous thermal UV/optical emission results from the thermalization of the ejecta by the captured photons. The two-component energy spectrum yielded by our model with a quasi-thermal component from the optically thick region of the wind superimposed on an optically thin synchrotron component well reproduces the X-ray spectral shape of AT2018cow. The Markov Chain Monte Carlo fitting results suggest that in order to explain the very short rise time to peak of the thermal optical emission, a low ejecta mass $M_{\rm ej}\approx0.1~M_\odot$ and high ejecta velocity $v_{\rm SN}\approx0.17c$ are required. A millisecond magnetar with $P_0\approx3.7~\rm ms$ and $B_p\approx2.4\times10^{14}~\rm G$ is needed to serve as the central engine of AT2018cow.


title: Bending Energy-Driven Cooperative Patterning of 2D Colloids in Elastic 2D Fluids

abstract: Suspensions of colloidal microplates in contoured 2D elastic fluids sheets are dominated by the bending mechanics and shear rigidity of the plates and the contrasting in-plane shear flow of the 2D fluid. Using the phase separated phospholipid membranes of individual giant unilamellar vesicles as models of contoured 2D suspensions, where solid domains act as colloids in a fluid membrane, we explore bending elasticity-driven assembly. The plate-shaped domains are varied between 1-10 {\mu}m in diameter, with 4-100 plates per vesicle depending on size, contributing a solid area of 17 plus minus 3%. Three classes of reversible plate arrangements evidence inter-plate attractions and repulsions: persistent hexagonal vesicle-encompassing quasi-lattices, persistent closely associated configurations (chains or concentrated lattices), and a dynamic disordered state. The vesicle-encompassing quasi-lattice is stable to vesicle dehydration by 30% relative to an inflated sphere. Excess area or membrane slack, for a fixed composition, dominates the preferred configuration while domain size and number contribute pattern intricacy. Different from the gradual variations in domain interactions and tunable positions in two-colloid systems, multibody interactions vary sharply within a particular range of excess area, producing cooperative assembly reminiscent of a phase transition.


title: Investigation of profile shifting and subpulse movement in PSR J0344-0901 with FAST

abstract: We report two phenomena detected in PSR J0344$-$0901 from two observations conducted at frequency centered at 1.25 GHz using the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The first phenomenon manifests as shifting in the pulse emission to later longitudinal phases and then gradually returns to its original location. The event lasts for about 216 pulse periods, with an average shift of about $0.7^\circ$ measured at the peak of the integrated profile. Changes in the polarization position angle (PPA) are detected around the trailing edge of the profile, together with an increase in the profile width. The second phenomenon is characterized by the apparent movement of subpulses, which results in different subpulse track patterns across the profile window. For the first time in this pulsar, we identify four emission modes, each with unique subpulse movement, and determine the pattern periods for three of the emission modes. Pulse nulling was not detected. Modeling of the changes in the PPA using the rotating vector model gives an inclination angle of $75.12^\circ \pm 3.80^\circ$ and an impact parameter of $-3.17^\circ \pm 5.32^\circ$ for this pulsar. We speculate that the subpulse movement may be related to the shifting of the pulse emission.


title: Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boosting

abstract: One-shot Federated Learning (OFL) has become a promising learning paradigm, enabling the training of a global server model via a single communication round. In OFL, the server model is aggregated by distilling knowledge from all client models (the ensemble), which are also responsible for synthesizing samples for distillation. In this regard, advanced works show that the performance of the server model is intrinsically related to the quality of the synthesized data and the ensemble model. To promote OFL, we introduce a novel framework, Co-Boosting, in which synthesized data and the ensemble model mutually enhance each other progressively. Specifically, Co-Boosting leverages the current ensemble model to synthesize higher-quality samples in an adversarial manner. These hard samples are then employed to promote the quality of the ensemble model by adjusting the ensembling weights for each client model. Consequently, Co-Boosting periodically achieves high-quality data and ensemble models. Extensive experiments demonstrate that Co-Boosting can substantially outperform existing baselines under various settings. Moreover, Co-Boosting eliminates the need for adjustments to the client's local training, requires no additional data or model transmission, and allows client models to have heterogeneous architectures.


title: High-Dimensional Covariate-Augmented Overdispersed Poisson Factor Model

abstract: The current Poisson factor models often assume that the factors are unknown, which overlooks the explanatory potential of certain observable covariates. This study focuses on high dimensional settings, where the number of the count response variables and/or covariates can diverge as the sample size increases. A covariate-augmented overdispersed Poisson factor model is proposed to jointly perform a high-dimensional Poisson factor analysis and estimate a large coefficient matrix for overdispersed count data. A group of identifiability conditions are provided to theoretically guarantee computational identifiability. We incorporate the interdependence of both response variables and covariates by imposing a low-rank constraint on the large coefficient matrix. To address the computation challenges posed by nonlinearity, two high-dimensional latent matrices, and the low-rank constraint, we propose a novel variational estimation scheme that combines Laplace and Taylor approximations. We also develop a criterion based on a singular value ratio to determine the number of factors and the rank of the coefficient matrix. Comprehensive simulation studies demonstrate that the proposed method outperforms the state-of-the-art methods in estimation accuracy and computational efficiency. The practical merit of our method is demonstrated by an application to the CITE-seq dataset. A flexible implementation of our proposed method is available in the R package \emph{COAP}.


title: Impacts of Extreme Heat on Labor Force Dynamics

abstract: We use daily longitudinal data and a within-worker identification approach to examine the impacts of heat on labor force dynamics in Australia. High temperatures during 2001-2019 significantly reduced work attendance and hours worked, which were not compensated for in subsequent days and weeks. The largest reductions occurred in cooler regions and recent years, and were not solely concentrated amongst outdoor-based workers. Financial and Insurance Services was the most strongly affected industry, with temperatures above 38{\deg}C (100{\deg}F) increasing absenteeism by 15 percent. Adverse heat effects during the work commute and during outdoor work hours are shown to be key mechanisms.


title: Cost-Adaptive Recourse Recommendation by Adaptive Preference Elicitation

abstract: Algorithmic recourse recommends a cost-efficient action to a subject to reverse an unfavorable machine learning classification decision. Most existing methods in the literature generate recourse under the assumption of complete knowledge about the cost function. In real-world practice, subjects could have distinct preferences, leading to incomplete information about the underlying cost function of the subject. This paper proposes a two-step approach integrating preference learning into the recourse generation problem. In the first step, we design a question-answering framework to refine the confidence set of the Mahalanobis matrix cost of the subject sequentially. Then, we generate recourse by utilizing two methods: gradient-based and graph-based cost-adaptive recourse that ensures validity while considering the whole confidence set of the cost matrix. The numerical evaluation demonstrates the benefits of our approach over state-of-the-art baselines in delivering cost-efficient recourse recommendations.


title: Interpretation of Inaccessible Sets in Martin-L\"{o}f Type Theory with One Mahlo Universe

abstract: Martin-L\"{o}f type theory $\mathbf{MLTT}$ was extended by Setzer with the so-called Mahlo universe types. This extension is called $\mathbf{MLM}$ and was introduced to develop a variant of $\mathbf{MLTT}$ equipped with an analogue of a large cardinal. Another instance of constructive systems extended with an analogue of a large set was formulated in the context of Aczel's constructive set theory: $\mathbf{CZF}$. Rathjen, Griffor and Palmgren extended $\mathbf{CZF}$ with inaccessible sets of all transfinite orders. It is unknown whether this extension of $\mathbf{CZF}$ is directly interpretable by Mahlo universes. In particular, how to construct the transfinite hierarchy of inaccessible sets using the reflection property of the Mahlo universe in $\mathbf{MLM}$ is not well understood. We extend $\mathbf{MLM}$ further by adding the accessibility predicate to it and show that the above extension of $\mathbf{CZF}$ is directly interpretable in $\mathbf{MLM}$ using the accessibility predicate.


title: Stacking Factorizing Partitioned Expressions in Hybrid Bayesian Network Models

abstract: Hybrid Bayesian networks (HBN) contain complex conditional probabilistic distributions (CPD) specified as partitioned expressions over discrete and continuous variables. The size of these CPDs grows exponentially with the number of parent nodes when using discrete inference, resulting in significant inefficiency. Normally, an effective way to reduce the CPD size is to use a binary factorization (BF) algorithm to decompose the statistical or arithmetic functions in the CPD by factorizing the number of connected parent nodes to sets of size two. However, the BF algorithm was not designed to handle partitioned expressions. Hence, we propose a new algorithm called stacking factorization (SF) to decompose the partitioned expressions. The SF algorithm creates intermediate nodes to incrementally reconstruct the densities in the original partitioned expression, allowing no more than two continuous parent nodes to be connected to each child node in the resulting HBN. SF can be either used independently or combined with the BF algorithm. We show that the SF+BF algorithm significantly reduces the CPD size and contributes to lowering the tree-width of a model, thus improving efficiency.


title: Tight Inapproximability of Target Set Reconfiguration

abstract: Given a graph $G$ with a vertex threshold function $\tau$, consider a dynamic process in which any inactive vertex $v$ becomes activated whenever at least $\tau(v)$ of its neighbors are activated. A vertex set $S$ is called a target set if all vertices of $G$ would be activated when initially activating vertices of $S$. In the Minmax Target Set Reconfiguration problem, for a graph $G$ and its two target sets $X$ and $Y$, we wish to transform $X$ into $Y$ by repeatedly adding or removing a single vertex, using only target sets of $G$, so as to minimize the maximum size of any intermediate target set. We prove that it is NP-hard to approximate Minmax Target Set Reconfiguration within a factor of $2-o\left(\frac{1}{\operatorname{polylog} n}\right)$, where $n$ is the number of vertices. Our result establishes a tight lower bound on approximability of Minmax Target Set Reconfiguration, which admits a $2$-factor approximation algorithm. The proof is based on a gap-preserving reduction from Target Set Selection to Minmax Target Set Reconfiguration, where NP-hardness of approximation for the former problem is proven by Chen (SIAM J. Discrete Math., 2009) and Charikar, Naamad, and Wirth (APPROX/RANDOM 2016).


title: The Pixel Charging-up effect in Gas Micro-Pixel Detectors

abstract: This study investigates the charging-up effect on the Topmetal-II$^-$ chip in Gas Micro-Pixel Detectors(GMPD). It is found that this effect differs from the charging-up typically observed in gas detector multiplier devices and increases the effective gain of the detector. The research indicates that this effect originates from the accumulation of charges on the insulating layer of the chip's pixel surface and is unlikely to dissipate naturally. Iterative simulations using COMSOL and GARFIELD++ were employed to model the variation of detector effective gain with the charging-up effect, and a simple yet effective model was proposed, which aligns well with experimental data. The study suggests that to ensure stable detector gain and reduce residual modulation in polarization detection, charging-up to near saturation state is required before operating the GMPD.


title: LLM-CompDroid: Repairing Configuration Compatibility Bugs in Android Apps with Pre-trained Large Language Models

abstract: XML configurations are integral to the Android development framework, particularly in the realm of UI display. However, these configurations can introduce compatibility issues (bugs), resulting in divergent visual outcomes and system crashes across various Android API versions (levels). In this study, we systematically investigate LLM-based approaches for detecting and repairing configuration compatibility bugs. Our findings highlight certain limitations of LLMs in effectively identifying and resolving these bugs, while also revealing their potential in addressing complex, hard-to-repair issues that traditional tools struggle with. Leveraging these insights, we introduce the LLM-CompDroid framework, which combines the strengths of LLMs and traditional tools for bug resolution. Our experimental results demonstrate a significant enhancement in bug resolution performance by LLM-CompDroid, with LLM-CompDroid-GPT-3.5 and LLM-CompDroid-GPT-4 surpassing the state-of-the-art tool, ConfFix, by at least 9.8% and 10.4% in both Correct and Correct@k metrics, respectively. This innovative approach holds promise for advancing the reliability and robustness of Android applications, making a valuable contribution to the field of software development.


title: Optimal mesh generation for a non-iterative grid-converged solution of flow through a blade passage using deep reinforcement learning

abstract: An automatic mesh generation method for optimal computational fluid dynamics (CFD) analysis of a blade passage is developed using deep reinforcement learning (DRL). Unlike conventional automation techniques, which require repetitive tuning of meshing parameters for each new geometry and flow condition, the method developed herein trains a mesh generator to determine optimal parameters across varying configurations in a non-iterative manner. Initially, parameters controlling mesh shape are optimized to maximize geometric mesh quality, as measured by the ratio of determinants of Jacobian matrices and skewness. Subsequently, resolution-controlling parameters are optimized by incorporating CFD results. Multi-agent reinforcement learning is employed, enabling 256 agents to construct meshes and perform CFD analyses across randomly assigned flow configurations in parallel, aiming for maximum simulation accuracy and computational efficiency within a multi-objective optimization framework. After training, the mesh generator is capable of producing meshes that yield converged solutions at desired computational costs for new configurations in a single simulation, thereby eliminating the need for iterative CFD procedures for grid convergence. The robustness and effectiveness of the method are investigated across various blade passage configurations, accommodating a range of blade geometries, including high-pressure and low-pressure turbine blades, axial compressor blades, and impulse rotor blades. Furthermore, the method is capable of identifying the optimal mesh resolution for diverse flow conditions, including complex phenomena like boundary layers, shock waves, and flow separation. The optimality is confirmed by comparing the accuracy and the efficiency achieved in a single attempt with those from the conventional iterative optimization method.


title: Infusing Hierarchical Guidance into Prompt Tuning: A Parameter-Efficient Framework for Multi-level Implicit Discourse Relation Recognition

abstract: Multi-level implicit discourse relation recognition (MIDRR) aims at identifying hierarchical discourse relations among arguments. Previous methods achieve the promotion through fine-tuning PLMs. However, due to the data scarcity and the task gap, the pre-trained feature space cannot be accurately tuned to the task-specific space, which even aggravates the collapse of the vanilla space. Besides, the comprehension of hierarchical semantics for MIDRR makes the conversion much harder. In this paper, we propose a prompt-based Parameter-Efficient Multi-level IDRR (PEMI) framework to solve the above problems. First, we leverage parameter-efficient prompt tuning to drive the inputted arguments to match the pre-trained space and realize the approximation with few parameters. Furthermore, we propose a hierarchical label refining (HLR) method for the prompt verbalizer to deeply integrate hierarchical guidance into the prompt tuning. Finally, our model achieves comparable results on PDTB 2.0 and 3.0 using about 0.1% trainable parameters compared with baselines and the visualization demonstrates the effectiveness of our HLR method.


title: How to Sustain a Scientific Open-Source Software Ecosystem: Learning from the Astropy Project

abstract: Scientific open-source software (OSS) has greatly benefited research communities through its transparent and collaborative nature. Given its critical role in scientific research, ensuring the sustainability of such software has become vital. Earlier studies have proposed sustainability strategies for conventional scientific software and open-source communities. However, it remains unclear whether these solutions can be easily adapted to the integrated framework of scientific OSS and its larger ecosystem. This study examines the challenges and opportunities to enhance the sustainability of scientific OSS in the context of interdisciplinary collaboration, open-source community, and multi-project ecosystem. We conducted a case study on a widely-used software ecosystem in the astrophysics domain, the Astropy Project, using a mixed-methods design approach. This approach includes an interview with core contributors regarding their participation in an interdisciplinary team, a survey of disengaged contributors about their motivations for contribution, reasons for disengagement, and suggestions for sustaining the communities, and finally, an analysis of cross-referenced issues and pull requests to understand best practices for collaboration on the ecosystem level. Our study reveals the implications of major challenges for sustaining scientific OSS and proposes concrete suggestions for tackling these challenges.


title: PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning

abstract: Parameter-efficient fine-tuning (PEFT) has emerged as an effective method for adapting pre-trained language models to various tasks efficiently. Recently, there has been a growing interest in transferring knowledge from one or multiple tasks to the downstream target task to achieve performance improvements. However, current approaches typically either train adapters on individual tasks or distill shared knowledge from source tasks, failing to fully exploit task-specific knowledge and the correlation between source and target tasks. To overcome these limitations, we propose PEMT, a novel parameter-efficient fine-tuning framework based on multi-task transfer learning. PEMT extends the mixture-of-experts (MoE) framework to capture the transferable knowledge as a weighted combination of adapters trained on source tasks. These weights are determined by a gated unit, measuring the correlation between the target and each source task using task description prompt vectors. To fully exploit the task-specific knowledge, we also propose the Task Sparsity Loss to improve the sparsity of the gated unit. We conduct experiments on a broad range of tasks over 17 datasets. The experimental results demonstrate our PEMT yields stable improvements over full fine-tuning, and state-of-the-art PEFT and knowledge transferring methods on various tasks. The results highlight the effectiveness of our method which is capable of sufficiently exploiting the knowledge and correlation features across multiple tasks.


title: Hands-Free VR

abstract: The paper introduces Hands-Free VR, a voice-based natural-language interface for VR. The user gives a command using their voice, the speech audio data is converted to text using a speech-to-text deep learning model that is fine-tuned for robustness to word phonetic similarity and to spoken English accents, and the text is mapped to an executable VR command using a large language model that is robust to natural language diversity. Hands-Free VR was evaluated in a controlled within-subjects study (N = 22) that asked participants to find specific objects and to place them in various configurations. In the control condition participants used a conventional VR user interface to grab, carry, and position the objects using the handheld controllers. In the experimental condition participants used Hands-Free VR. The results confirm that: (1) Hands-Free VR is robust to spoken English accents, as for 20 of our participants English was not their first language, and to word phonetic similarity, correctly transcribing the voice command 96.71% of the time; (2) Hands-Free VR is robust to natural language diversity, correctly mapping the transcribed command to an executable command in 97.83% of the time; (3) Hands-Free VR had a significant efficiency advantage over the conventional VR interface in terms of task completion time, total viewpoint translation, total view direction rotation, and total left and right hand translations; (4) Hands-Free VR received high user preference ratings in terms of ease of use, intuitiveness, ergonomics, reliability, and desirability.


title: On quasilinear Beltrami equations with restrictions on tangential dilatation

abstract: We study quasilinear Beltrami equations, the complex coefficients of which depend on the unknown function. In terms of the so-called tangential dilatation, we have found conditions under which these equations have homeomorphic $ACL$-solutions. Sepa\-ra\-tely, we have found some conditions that ensure the existence of the corresponding con\-ti\-nuous $ACL$-solutions.


title: Quasinormal modes of a regular black hole with sub-Planckian curvature

abstract: This paper explores the properties of the quasinormal modes (QNMs) of a regular black hole(BH) characterized by a Minkowski core and sub-Planckian curvature. When focusing on a special case, this regular BH exhibits identical large-scale behavior with the Hayward BH and some loop quantum gravity corrected (LQG-corrected) BH. A notable characteristic of the QNMs in this regular BH is the pronounced outburst of overtones when compared to the Schwarzschild BH (SS-BH). This outburst can be attributed to the deviation from the SS-BH in the near-horizon geometry region due to the quantum gravity effect. Furthermore, we compare the QNM properties of the regular BH with those of the Hayward BH and the LQG-corrected BH. A similar phenomenon of overtone outburst is observed in the modes of the overtone. As a conclusion, the QNMs may be a powerful tool for detecting the quantum gravity effect and distinguishing different BH models.