title: Towards Practical Tool Usage for Continually Learning LLMs

abstract: Large language models (LLMs) show an innate skill for solving language based tasks. But insights have suggested an inability to adjust for information or task-solving skills becoming outdated, as their knowledge, stored directly within their parameters, remains static in time. Tool use helps by offloading work to systems that the LLM can access through an interface, but LLMs that use them still must adapt to nonstationary environments for prolonged use, as new tools can emerge and existing tools can change. Nevertheless, tools require less specialized knowledge, therefore we hypothesize they are better suited for continual learning (CL) as they rely less on parametric memory for solving tasks and instead focus on learning when to apply pre-defined tools. To verify this, we develop a synthetic benchmark and follow this by aggregating existing NLP tasks to form a more realistic testing scenario. While we demonstrate scaling model size is not a solution, regardless of tool usage, continual learning techniques can enable tool LLMs to both adapt faster while forgetting less, highlighting their potential as continual learners.


title: Nitrogen-monovacancy (VN) Hexagonal Boron Nitride 2D Monolayer Material as an Efficient Electrocatalyst for CO2 Reduction Reaction

abstract: The conversion of waste carbon dioxide (CO2) gas into valuable products and fuels through an electrocatalytic CO2 reduction reaction (CO2RR) is a promising approach. The sluggish kinetics of the CO2RR require the development of novel strategies for electrocatalyst design. Two-dimensional (2D) materials emerge as promising candidates for CO2RR due to their distinctive electronic and structural properties. This study follows the first principles based DFT-D method to examine the electrocatalytic competences of the defective two-dimensional boron nitride monolayer (d-BN) material towards CO2RR. Introducing a particular defect with nitrogen vacancies in the 2D single layer pristine hexagonal boron nitride (VN_d-BN) can efficiently activate the CO2 molecules for hydrogenation by reducing the electronic band gap of the pristine hBN from 6.23 eV to 3.0 eV. Therefore, VN_d-BN material can act as a large band gap semiconductor. Our findings demonstrate that the defective regions in the 2D monolayer VN_d-BN serve as active sites (Boron) for both the adsorption and activation of CO2. The subsequent hydrogenation steps occur sequentially once the CO2 molecule is adsorbed on the catalytic surface. Our results indicate that the OCHO* path is the most favorable for CH4 production. Hence, the 2D monolayer VN_d-BN material holds a great promise as a cost-effective catalyst for CO2RR, and it presents a viable alternative to expensive platinum (Pt) catalysts.


title: Numerical Study of Cleavable Bond-Modified Polyethylene for Circular Polymer Design

abstract: There is considerable interest in designing new polymeric materials with built-in mechanisms for recycling. In this work, we present a systematic exploration of several polyethylene-based polymers that contain strategically incorporated cleavable bonds that are susceptible to chemical degradation. We consider ten distinct telechelic functionalities across varying chain lengths: ester, aromatic ester, anhydride, carbonate, urethane, siloxane, oxalate, acetal, urea, and amide linkages. Our study is focused on the effects of cleavable bonds on density, diffusion, enthalpy, and melting temperatures. We also examine the crystallization process. These are key properties for polymer processing and, by comparing them to those of linear polyethylene, we establish a platform that will help guide future synthetic efforts towards the design of sustainable plastics with performance comparable to that of traditional, high-performance polyolefin-based materials.


title: Face-voice Association in Multilingual Environments (FAME) Challenge 2024 Evaluation Plan

abstract: The advancements of technology have led to the use of multimodal systems in various real-world applications. Among them, the audio-visual systems are one of the widely used multimodal systems. In the recent years, associating face and voice of a person has gained attention due to presence of unique correlation between them. The Face-voice Association in Multilingual Environments (FAME) Challenge 2024 focuses on exploring face-voice association under a unique condition of multilingual scenario. This condition is inspired from the fact that half of the world's population is bilingual and most often people communicate under multilingual scenario. The challenge uses a dataset namely, Multilingual Audio-Visual (MAV-Celeb) for exploring face-voice association in multilingual environments. This report provides the details of the challenge, dataset, baselines and task details for the FAME Challenge.


title: Remarks on quasilocal mass and fill-ins

abstract: In this paper we would have a brief overview of several proposals of quasilocal mass which are based on Hamiltonian formulation. We also show the positivity of the Wang-Yau energy under a more general condition. We then further study the quasilocal mass and DEC fill-ins defined by the author in terms of completeness and shields.


title: Threshold Current Density for Diffusion-controlled Stability of Electrolytic Surface Nanobubbles

abstract: Understanding the stability mechanism of surface micro/nanobubbles adhered to gas-evolving electrodes is essential for improving the efficiency of water electrolysis, which is known to be hindered by the bubble coverage on electrodes. Using molecular simulations, the diffusion-controlled evolution of single electrolytic nanobubbles on wettability-patterned nanoelectrodes is investigated. These nanoelectrodes feature hydrophobic islands as preferential nucleation sites and allow the growth of nanobubbles in the pinning mode. In these simulations, a threshold current density distinguishing stable nanobubbles from unstable nanobubbles is found. When the current density remains below the threshold value, nucleated nanobubbles grow to their equilibrium states, maintaining their nanoscopic size. However, for the current density above the threshold value, nanobubbles undergo unlimited growth and can eventually detach due to buoyancy. Increasing the pinning length of nanobubbles increases the degree of nanobubble instability. By connecting the current density with the local gas oversaturation, an extension of the stability theory for surface nanobubbles [Lohse and Zhang, Phys. Rev. E, 2015, 91, 031003(R)] accurately predicts the nanobubble behavior found in molecular simulations, including equilibrium contact angles and the threshold current density. For larger systems that are not accessible to molecular simulations, continuum numerical simulations with the finite difference method combined with the immersed boundary method are performed, again demonstrating good agreement between numerics and theories.


title: Blue quantum emitter in hexagonal boron nitride and carbon chain tetramer: proposition of identification

abstract: Single photon emitters in hexagonal boron nitride offer a gateway to the future of quantum technologies, yet their identification remains challenging and subject to ongoing debate. We demonstrate through ab initio calculations that the optical properties of a carbon chain tetramer are in excellent agreement with the characteristics of a blue quantum emitter in hexagonal boron nitride emitting at 435 nm. Its calculated zero-phonon line energy (2.77 eV) and radiative lifetime (1.6 ns) perfectly align with experimental observations. The relatively weak electron--phonon coupling (Huang-Rhys factor of 1.5) indicates intense emission at the zero-phonon line. Despite the absence of an inversion center in the carbon tetramer, we demonstrate that it exhibits a negligible linear Stark effect, consistent with experimental findings. Additionally, our hypothesis explains the experimental observation that the formation of blue emitters is only possible in samples containing numerous ultraviolet emitters, which are likely identical to carbon dimers.


title: The Norton-balanced condition for $Q$-polynomial distance-regular graphs

abstract: Let $\Gamma$ denote a $Q$-polynomial distance-regular graph, with vertex set $X$ and diameter $D\geq 3$. The standard module $V$ has a basis $\lbrace {\hat x} \vert x \in X\rbrace$, where ${\hat x}$ denotes column $x$ of the identity matrix $I \in {\rm Mat}_X(\mathbb C)$. Let $E$ denote a $Q$-polynomial primitive idempotent of $\Gamma$. The eigenspace $EV$ is spanned by the vectors $\lbrace E {\hat x} \vert x \in X\rbrace$. It was previously known that these vectors satisfy a condition called the balanced set condition. In this paper, we introduce a variation on the balanced set condition called the Norton-balanced condition. The Norton-balanced condition involves the Norton algebra product on $EV$. We define $\Gamma$ to be Norton-balanced whenever $\Gamma$ has a $Q$-polynomial primitive idempotent $E$ such that the set $\lbrace E {\hat x} \vert x \in X\rbrace$ is Norton-balanced. We show that $\Gamma$ is Norton-balanced in the following cases: (i) $\Gamma$ is bipartite; (ii) $\Gamma$ is almost bipartite; (iii) $\Gamma$ is dual-bipartite; (iv) $\Gamma$ is almost dual-bipartite; (v) $\Gamma$ is tight; (vi) $\Gamma$ is a Hamming graph; (vii) $\Gamma$ is a Johnson graph; (viii) $\Gamma$ is the Grassmann graph $J_q(2D,D)$; (ix) $\Gamma$ is a halved bipartite dual-polar graph; (x) $\Gamma$ is a halved Hemmeter graph; (xi) $\Gamma$ is a halved hypercube; (xii) $\Gamma$ is a folded-half hypercube; (xiii) $\Gamma$ has $q$-Racah type and affords a spin model. Some theoretical results about the Norton-balanced condition are obtained, and some open problems are given.


title: Matroid variant of Matiyasevich formula and its application

abstract: In 1977, Yu. V. Matiyasevich proposed a formula expressing the chromatic polynomial of an arbitrary graph as a linear combination of flow polynomials of subgraphs of the original graph. In this paper, we prove that this representation is a particular case of one (easily verifiable) formula, namely, the representation of the characteristic polynomial of an arbitrary matroid as a linear combination of characteristic polynomials of dual matroids. As an application, we represent the flow polynomial of a complete graph with $n$ vertices as the sum of elementary terms with respect to all partitions of positive integer $n$. Since the growth rate of the number of all partitions is less than exponential, this technique allows us to evaluate the flow polynomial for values of $n\approx 50$. We also get an explicit expression for the characteristic polynomial of the matroid dual to the matroid of the projective geometry over a finite field. We prove, in particular, that major coefficients of all these polynomials coincide with the beginning of the row in the Pascal triangle, whose number equals the quantity of elements in the corresponding matroid. At the end part of the paper, we consider one more approach, which allows us to obtain the same results of application of our main theoren by using properties of the Tutte polynomial and the classical Rota formula for coefficients of the characteristic polynomial of a matroid. In addition, we describe the connection between the matroid variant of the Matiyasevich formula and convolution formulas for Tutte polynomials.


title: Multifractal Analysis of F-exponents for Finitely Irreducible Conformal Graph Directed Markov Systems

abstract: Let $\Phi = \{\phi_e\}_{e\in E}$ be a finitely irreducible conformal graph directed Markov system (CGDMS) with symbolic representation $E_A^{\infty}$ and limit set $J$. Under a mild condition on the system, we give a multifractal analysis of level sets of Birkhoff averages with respect to Hausdorff dimension for a large family of functions. We then apply these results to a few examples in the case of both $E$ finite and $E$ countably infinite.


title: Adversarial Robustness Limits via Scaling-Law and Human-Alignment Studies

abstract: This paper revisits the simple, long-studied, yet still unsolved problem of making image classifiers robust to imperceptible perturbations. Taking CIFAR10 as an example, SOTA clean accuracy is about $100$%, but SOTA robustness to $\ell_{\infty}$-norm bounded perturbations barely exceeds $70$%. To understand this gap, we analyze how model size, dataset size, and synthetic data quality affect robustness by developing the first scaling laws for adversarial training. Our scaling laws reveal inefficiencies in prior art and provide actionable feedback to advance the field. For instance, we discovered that SOTA methods diverge notably from compute-optimal setups, using excess compute for their level of robustness. Leveraging a compute-efficient setup, we surpass the prior SOTA with $20$% ($70$%) fewer training (inference) FLOPs. We trained various compute-efficient models, with our best achieving $74$% AutoAttack accuracy ($+3$% gain). However, our scaling laws also predict robustness slowly grows then plateaus at $90$%: dwarfing our new SOTA by scaling is impractical, and perfect robustness is impossible. To better understand this predicted limit, we carry out a small-scale human evaluation on the AutoAttack data that fools our top-performing model. Concerningly, we estimate that human performance also plateaus near $90$%, which we show to be attributable to $\ell_{\infty}$-constrained attacks' generation of invalid images not consistent with their original labels. Having characterized limiting roadblocks, we outline promising paths for future research.


title: Machine learning-based identification of Gaia astrometric exoplanet orbits

abstract: The third Gaia data release (DR3) contains $\sim$170 000 astrometric orbit solutions of two-body systems located within $\sim$500 pc of the Sun. Determining component masses in these systems, in particular of stars hosting exoplanets, usually hinges on incorporating complementary observations in addition to the astrometry, e.g. spectroscopy and radial velocities. Several DR3 two-body systems with exoplanet, brown-dwarf, stellar, and black-hole components have been confirmed in this way. We developed an alternative machine learning approach that uses only the DR3 orbital solutions with the aim of identifying the best candidates for exoplanets and brown-dwarf companions. Based on confirmed substellar companions in the literature, we use semi-supervised anomaly detection methods in combination with extreme gradient boosting and random forest classifiers to determine likely low-mass outliers in the population of non-single sources. We employ and study feature importance to investigate the method's plausibility and produced a list of 22 best candidates of which four are exoplanet candidates and another five are either very-massive brown dwarfs or very-low mass stars. Three candidates, including one initial exoplanet candidate, correspond to false-positive solutions where longer-period binary star motion was fitted with a biased shorter-period orbit. We highlight nine candidates with brown-dwarf companions for preferential follow-up. One candidate companion around the Sun-like star G 15-6 could be confirmed as a genuine brown dwarf using external radial-velocity data. This new approach is a powerful complement to the traditional identification methods for substellar companions among Gaia astrometric orbits. It is particularly relevant in the context of Gaia DR4 and its expected exoplanet discovery yield.

categories: astro-ph.EP astro-ph.IM astro-ph.SR cs.LG


title: Extrapolation via Sawyer-type inequalities

abstract: We present a multi-variable extension of Rubio de Francia's restricted weak-type extrapolation theory that does not involve Rubio de Francia's iteration algorithm; instead, we rely on the following Sawyer-type inequality for the weighted Hardy-Littlewood maximal operator $M_u$: $$ \left \Vert \frac{M_u (fv)}{v} \right \Vert_{L^{1,\infty}(uv)} \leq C_{u,v} \Vert f \Vert_{L^1(uv)}, \quad u, \, uv \in A_{\infty}. $$ Our approach can be adapted to recover weak-type $A_{\vec P}$ extrapolation schemes, including an endpoint result that falls outside the classical theory. Among the applications of our work, we highlight extending outside the Banach range the well-known equivalence between restricted weak-type and weak-type for characteristic functions, and obtaining mixed and restricted weak-type bounds with $A_{p}^{\mathcal R}$ weights for relevant families of multi-variable operators, addressing the lack in the literature of these types of estimates. We also reveal several standalone properties of the class $A_{p}^{\mathcal R}$.


title: Counteracting Concept Drift by Learning with Future Malware Predictions

abstract: The accuracy of deployed malware-detection classifiers degrades over time due to changes in data distributions and increasing discrepancies between training and testing data. This phenomenon is known as the concept drift. While the concept drift can be caused by various reasons in general, new malicious files are created by malware authors with a clear intention of avoiding detection. The existence of the intention opens a possibility for predicting such future samples. Including predicted samples in training data should consequently increase the accuracy of the classifiers on new testing data. We compare two methods for predicting future samples: (1) adversarial training and (2) generative adversarial networks (GANs). The first method explicitly seeks for adversarial examples against the classifier that are then used as a part of training data. Similarly, GANs also generate synthetic training data. We use GANs to learn changes in data distributions within different time periods of training data and then apply these changes to generate samples that could be in testing data. We compare these prediction methods on two different datasets: (1) Ember public dataset and (2) the internal dataset of files incoming to Avast. We show that while adversarial training yields more robust classifiers, this method is not a good predictor of future malware in general. This is in contrast with previously reported positive results in different domains (including natural language processing and spam detection). On the other hand, we show that GANs can be successfully used as predictors of future malware. We specifically examine malware families that exhibit significant changes in their data distributions over time and the experimental results confirm that GAN-based predictions can significantly improve the accuracy of the classifier on new, previously unseen data.


title: A Unified Combination Framework for Dependent Tests with Applications to Microbiome Association Studies

abstract: We introduce a novel meta-analysis framework to combine dependent tests under a general setting, and utilize it to synthesize various microbiome association tests that are calculated from the same dataset. Our development builds upon the classical meta-analysis methods of aggregating $p$-values and also a more recent general method of combining confidence distributions, but makes generalizations to handle dependent tests. The proposed framework ensures rigorous statistical guarantees, and we provide a comprehensive study and compare it with various existing dependent combination methods. Notably, we demonstrate that the widely used Cauchy combination method for dependent tests, referred to as the vanilla Cauchy combination in this article, can be viewed as a special case within our framework. Moreover, the proposed framework provides a way to address the problem when the distributional assumptions underlying the vanilla Cauchy combination are violated. Our numerical results demonstrate that ignoring the dependence among the to-be-combined components may lead to a severe size distortion phenomenon. Compared to the existing $p$-value combination methods, including the vanilla Cauchy combination method, the proposed combination framework can handle the dependence accurately and utilizes the information efficiently to construct tests with accurate size and enhanced power. The development is applied to Microbiome Association Studies, where we aggregate information from multiple existing tests using the same dataset. The combined tests harness the strengths of each individual test across a wide range of alternative spaces, %resulting in a significant enhancement of testing power across a wide range of alternative spaces, enabling more efficient and meaningful discoveries of vital microbiome associations.


title: A Paradigm For Collaborative Pervasive Fog Computing Ecosystems at the Network Edge

abstract: While the success of edge and fog computing increased with the proliferation of the Internet of Things (IoT) solutions, such novel computing paradigm, that moves compute resources closer to the source of data and services, must address many challenges such as reducing communication overhead to/from datacenters, the latency to compute and receive results, as well as energy consumption at the mobile and IoT devices. fog-to-fog (f2f) cooperation has recently been proposed to increase the computation capacity at the network edge through cooperation across multiple stakeholders. In this paper we adopt an analytical approach to studying f2f cooperation paradigm. We highlight the benefits of using such new paradigm in comparison with traditional three-tier fog computing paradigms. We use a Continuous Time Markov Chain (CTMC) model for the N f2f cooperating nodes and cast cooperation as an optimization problem, which we solve using the proposed model.


title: Shape equilibria of vesicles with rigid planar inclusions

abstract: Motivated by recent studies of two-phase lipid vesicles possessing 2D solid domains integrated within a fluid bilayer phase, we study the shape equilibria of closed vesicles possessing a single planar, circular inclusion. While 2D solid elasticity tends to expel Gaussian curvature, topology requires closed vesicles to maintain an average, non-zero Gaussian curvature leading to an elementary mechanism of shape frustration that increases with inclusion size. We study elastic ground states of the Helfrich model of the planar-fluid composite vesicles, analytically and computationally, as a function of planar fraction and reduced volume. Notably, we show that incorporation of a planar inclusion of only a few percent dramatically shifts the ground state shapes of vesicles from predominantly {\it prolate} to {\it oblate}, and moreover, shifts the optimal surface to volume ratio far from spherical shapes. We show that for sufficiently small planar inclusions, the elastic ground states break symmetry via a complex variety of asymmetric oblate, prolate, and triaxial shapes, while inclusion sizes above about $8\%$ drive composite vesicles to adopt axisymmetric oblate shapes. These predictions cast useful light on the emergent shape and mechanical responses of fluid-solid composite vesicles.


title: LLeMpower: Understanding Disparities in the Control and Access of Large Language Models

abstract: Large Language Models (LLMs) are a powerful technology that augment human skill to create new opportunities, akin to the development of steam engines and the internet. However, LLMs come with a high cost. They require significant computing resources and energy to train and serve. Inequity in their control and access has led to concentration of ownership and power to a small collection of corporations. In our study, we collect training and inference requirements for various LLMs. We then analyze the economic strengths of nations and organizations in the context of developing and serving these models. Additionally, we also look at whether individuals around the world can access and use this emerging technology. We compare and contrast these groups to show that these technologies are monopolized by a surprisingly few entities. We conclude with a qualitative study on the ethical implications of our findings and discuss future directions towards equity in LLM access.


title: Service Weaver: A Promising Direction for Cloud-native Systems?

abstract: Cloud-native and microservice architectures have taken over the development world by storm. While being incredibly scalable and resilient, microservice architectures also come at the cost of increased overhead to build and maintain. Google's Service Weaver aims to simplify the complexities associated with implementing cloud-native systems by introducing the concept of a single modular binary composed of agent-like components, thereby abstracting away the microservice architecture notion of individual services. While Service Weaver presents a promising approach to streamline the development of cloud-native applications and addresses nearly all significant aspects of conventional cloud-native systems, there are existing tradeoffs affecting the overall functionality of the system. Notably, Service Weaver's straightforward implementation and deployment of components alleviate the overhead of constructing a complex microservice architecture. However, it is important to acknowledge that certain features, including separate code bases, routing mechanisms, resiliency, and security, are presently lacking in the framework.


title: Two-stage Spatial Regression Models for Spatial Confounding

abstract: Public health data are often spatially dependent, but standard spatial regression methods can suffer from bias and invalid inference when the independent variable is associated with spatially-correlated residuals. This could occur if, for example, there is an unmeasured environmental contaminant. Geoadditive structural equation modeling (gSEM), in which an estimated spatial trend is removed from both the explanatory and response variables before estimating the parameters of interest, has previously been proposed as a solution, but there has been little investigation of gSEM's properties with point-referenced data. We link gSEM to results on double machine learning and semiparametric regression based on two-stage procedures. We propose using these semiparametric estimators for spatial regression using Gaussian processes with Mat\`ern covariance to estimate the spatial trends, and term this class of estimators Double Spatial Regression (DSR). We derive regularity conditions for root-$n$ asymptotic normality and consistency and closed-form variance estimation, and show that in simulations where standard spatial regression estimators are highly biased and have poor coverage, DSR can mitigate bias more effectively than competitors and obtain nominal coverage.


title: Exploring Feedback Generation in Automated Skeletal Movement Assessment: A Comprehensive Overview

abstract: The application of machine-learning solutions to movement assessment from skeleton videos has attracted significant research attention in recent years. This advancement has made rehabilitation at home more accessible, utilizing movement assessment algorithms that can operate on affordable equipment for human pose detection and analysis from 2D or 3D videos. While the primary objective of automatic assessment tasks is to score movements, the automatic generation of feedback highlighting key movement issues has the potential to significantly enhance and accelerate the rehabilitation process. While numerous research works exist in the field of automatic movement assessment, only a handful address feedback generation. In this study, we explain the types of feedback that can be generated, review existing solutions for automatic feedback generation, and discuss future research directions. To our knowledge, this is the first comprehensive review of feedback generation in skeletal movement assessment.


title: Are University Budget Cuts Becoming A Threat to Mathematics? with Additional Discussion

abstract: Mathematics as an area of study occupies an important place in higher education. Due in part to its utility in other disciplines as well as its role in student learning, institutions of higher education (IHEs) often have large numbers of mathematics faculty with different balances of teaching and research in different ranks and appointment structures. Most flagship IHEs, especially state land-grant institutions, have large undergraduate populations taking mathematics courses in many cases built around the widespread use of calculus and the connections between mathematics and science, technology, and engineering. These connections have made mathematics departments essential to universities\cite{olson2012engage} and emphasized the critical role math plays in supporting student success \cites{reinholz2020time,calcscience} in all areas of post-secondary education. We tend to take that essential nature of mathematics at the undergraduate level, and for research universities at the graduate level, as a given, but that characterization no longer holds for some IHEs.


title: Initial results of our spectro-photometric monitoring of XZ Tau

abstract: We present here initial results of our spectro-photometric monitoring of XZ Tau. During our monitoring period, XZ Tau exhibited several episodes of brightness variations in timescales of months at optical wavelengths in contrast to the mid-infrared wavelengths. The color evolution of XZ Tau during this period suggest that the brightness variations are driven by changes in accretion from the disc. The mid-infrared light curve shows an overall decline in brightness by $\sim$ 0.5 and 0.7 magnitude respectively in WISE W1 (3.4 $\mu$m) and W2 (4.6 $\mu$m) bands. The emission profile of the hydrogen recombination lines along with that of Ca II IRT lines points towards magnetospheric accretion of XZ Tau. We have detected P Cygni profile in H$\beta$ indicating of outflowing winds from regions close to accretion. Forbidden transitions of oxygen are also detected, likely indicating of jets originating around the central pre-main sequence star.


title: A Bayesian Joint Modelling for Misclassified Interval-censoring and Competing Risks

abstract: In active surveillance of prostate cancer, cancer progression is interval-censored and the examination to detect progression is subject to misclassification, usually false negatives. Meanwhile, patients may initiate early treatment before progression detection, constituting a competing risk. We developed the Misclassification-Corrected Interval-censored Cause-specific Joint Model (MCICJM) to estimate the association between longitudinal biomarkers and cancer progression in this setting. The sensitivity of the examination is considered in the likelihood of this model via a parameter that may be set to a specific value if the sensitivity is known, or for which a prior distribution can be specified if the sensitivity is unknown. Our simulation results show that misspecification of the sensitivity parameter or ignoring it entirely impacts the model parameters, especially the parameter uncertainty and the baseline hazards. Moreover, specification of a prior distribution for the sensitivity parameter may reduce the risk of misspecification in settings where the exact sensitivity is unknown, but may cause identifiability issues. Thus, imposing restrictions on the baseline hazards is recommended. A trade-off between modelling with a sensitivity constant at the risk of misspecification and a sensitivity prior at the cost of flexibility needs to be decided.


title: Momentum-based gradient descent methods for Lie groups

abstract: Polyak's Heavy Ball (PHB; Polyak, 1964), a.k.a. Classical Momentum, and Nesterov's Accelerated Gradient (NAG; Nesterov, 1983) are well know examples of momentum-descent methods for optimization. While the latter outperforms the former, solely generalizations of PHB-like methods to nonlinear spaces have been described in the literature. We propose here a generalization of NAG-like methods for Lie group optimization based on the variational one-to-one correspondence between classical and accelerated momentum methods (Campos et al., 2023). Numerical experiments are shown.


title: Late time decay of scalar and Dirac fields around an asymptotically de Sitter black hole in the Euler-Heisenberg electrodynamics

abstract: We compute the quasinormal modes of massive scalar and Dirac fields within the framework of asymptotically de Sitter black holes in Euler-Heisenberg non-linear electrodynamics. We pay particular attention to the regime $\mu M/m_{P}^2 \gg 1$, where $\mu$ and $M$ denote the masses of the field and the black hole, respectively, and $m_{P}$ represents the Planck mass, covering a range from primordial to large astrophysical black holes. Through time-domain integration, we demonstrate that, contrary to the asymptotically flat case, the quasinormal modes also dictate the asymptotic decay of fields. Employing the 6th order WKB formula, we derive a precise analytic approximation for quasinormal modes in the regime $\mu M/m_{P}^2 \gg 1$ without resorting to expansion in terms of the inverse multipole number. This analytic expression takes on a concise form in the limit of linear electrodynamics, represented by the Reissner-Nordstr\"om black holes.


title: Hierarchical Attention Models for Multi-Relational Graphs

abstract: We present Bi-Level Attention-Based Relational Graph Convolutional Networks (BR-GCN), unique neural network architectures that utilize masked self-attentional layers with relational graph convolutions, to effectively operate on highly multi-relational data. BR-GCN models use bi-level attention to learn node embeddings through (1) node-level attention, and (2) relation-level attention. The node-level self-attentional layers use intra-relational graph interactions to learn relation-specific node embeddings using a weighted aggregation of neighborhood features in a sparse subgraph region. The relation-level self-attentional layers use inter-relational graph interactions to learn the final node embeddings using a weighted aggregation of relation-specific node embeddings. The BR-GCN bi-level attention mechanism extends Transformer-based multiplicative attention from the natural language processing (NLP) domain, and Graph Attention Networks (GAT)-based attention, to large-scale heterogeneous graphs (HGs). On node classification, BR-GCN outperforms baselines from 0.29% to 14.95% as a stand-alone model, and on link prediction, BR-GCN outperforms baselines from 0.02% to 7.40% as an auto-encoder model. We also conduct ablation studies to evaluate the quality of BR-GCN's relation-level attention and discuss how its learning of graph structure may be transferred to enrich other graph neural networks (GNNs). Through various experiments, we show that BR-GCN's attention mechanism is both scalable and more effective in learning compared to state-of-the-art GNNs.


title: Understanding the Role of Temperature in Diverse Question Generation by GPT-4

abstract: We conduct a preliminary study of the effect of GPT's temperature parameter on the diversity of GPT4-generated questions. We find that using higher temperature values leads to significantly higher diversity, with different temperatures exposing different types of similarity between generated sets of questions. We also demonstrate that diverse question generation is especially difficult for questions targeting lower levels of Bloom's Taxonomy.


title: Colour-permuting automorphisms of complete Cayley graphs

abstract: Let $G$ be a (finite or infinite) group, and let $K_G = \mathrm{Cay} ( G;G \smallsetminus \{1\} )$ be the complete graph with vertex set $G$, considered as a Cayley graph of $G$. Being a Cayley graph, it has a natural edge-colouring by sets of the form $\{s, s^{-1}\}$ for $s \in G$. We prove that every colour-permuting automorphism of $K_G$ is an affine map, unless $G \cong Q_8 \times B$, where $Q_8$ is the quaternion group of order $8$, and $B$ is an abelian group, such that $b^2$ is trivial for all $b \in B$. We also prove (without any restriction on $G$) that every colour-permuting automorphism of $K_G$ is the composition of a group automorphism and a colour-preserving graph automorphism. This was conjectured by D.P.Byrne, M.J.Donner, and T.Q.Sibley in 2013.


title: Entangled nematic disclinations using multi-particle collision dynamics

abstract: Colloids dispersed in nematic liquid crystals form topological composites in which colloid-associated defects mediate interactions while adhering to fundamental topological constraints. Better realising the promise of such materials requires numerical methods that model nematic inclusions in dynamic and complex scenarios. We employ a mesoscale approach for simulating colloids as mobile surfaces embedded in a fluctuating nematohydrodynamic medium to study the kinetics of colloidal entanglement. In addition to reproducing far-field interactions, topological properties of disclination loops are resolved to reveal their metastable states and topological transitions during relaxation towards ground state. The intrinsic hydrodynamic fluctuations distinguish formerly unexplored far-from-equilibrium disclination states, including configurations with localised positive winding profiles. The adaptability and precision of this numerical approach offers promising avenues for studying the dynamics of colloids and topological defects in designed and out-of-equilibrium situations.


title: Perelman singular manifolds

abstract: On a Riemannian manifold with a smooth function $f: M\to \mathbb{R}$, we consider the linearization of the Perelman scalar curvature $\mathcal{R}$ and its $L^2$-formal adjoint operator $\delta\mathcal{R}^*$. A manifold endowed with a metric $g$ whose operator $\delta\mathcal{R}^*$ has a nontrivial kernel is called a Perelman singular manifold. In this paper, we present examples and apply general maximum principles to obtain rigidity or nonexistence results in the underlying setting.


title: Locuaz: an in-silico platform for antibody fragments optimization

abstract: Motivation: Engineering high-affinity binders targeting specific antigenic determinants remains a challenging and often daunting task, requiring extensive experimental screening. Computational methods have the potential to accelerate this process, reducing costs and time, but only if they demonstrate broad applicability and efficiency in exploring mutations, evaluating affinity, and pruning unproductive mutation paths. Results: In response to these challenges, we introduce a new computational platform for optimizing protein binders towards their targets. The platform is organized as a series of modules, performing mutation selection and application, molecular dynamics (MD) simulations to sample conformations around interaction poses, and mutation prioritization using suitable scoring functions. Notably, the platform supports parallel exploration of different mutation streams, enabling in silico high-throughput screening on HPC systems. Furthermore, the platform is highly customizable, allowing users to implement their own protocols. Availability and implementation: the source code is available at https://github. com/pgbarletta/locuaz and documentation is at https://locuaz.readthedocs.io/


title: The Effect of Data Partitioning Strategy on Model Generalizability: A Case Study of Morphological Segmentation

abstract: Recent work to enhance data partitioning strategies for more realistic model evaluation face challenges in providing a clear optimal choice. This study addresses these challenges, focusing on morphological segmentation and synthesizing limitations related to language diversity, adoption of multiple datasets and splits, and detailed model comparisons. Our study leverages data from 19 languages, including ten indigenous or endangered languages across 10 language families with diverse morphological systems (polysynthetic, fusional, and agglutinative) and different degrees of data availability. We conduct large-scale experimentation with varying sized combinations of training and evaluation sets as well as new test data. Our results show that, when faced with new test data: (1) models trained from random splits are able to achieve higher numerical scores; (2) model rankings derived from random splits tend to generalize more consistently.


title: Word-length curve counting on the once-punctured torus

abstract: We classify closed curves on a once-punctured torus with a single self-intersection from a combinatorial perspective. We determine the number of closed curves with given word-length and with zero, one, and arbitrary self-intersections.


title: Use of multigrids to reduce the cost of performing interpolative separable density fitting

abstract: In this article, we present an interpolative separable density fitting (ISDF) based algorithm to calculate exact exchange in periodic mean field calculations. In the past, decomposing the two-electron integrals into tensor hypercontraction (THC) form using ISDF was the most expensive step of the entire mean field calculation. Here we show that by using a multigrid-ISDF algorithm both the memory and the CPU cost of this step can be reduced. The CPU cost is brought down from cubic scaling to quadratic scaling with a low computational prefactor which reduces the cost by almost two orders of magnitude. Thus, in the new algorithm, the cost of performing ISDF is largely negligible compared to other steps. Along with the CPU cost, the memory cost of storing the factorized two-electron integrals is also reduced by a factor of up to 35. With the current algorithm, we can perform Hartree-Fock calculations on a Diamond supercell containing more than 17,000 basis functions and more than 1,500 electrons on a single node with no disk usage. For this calculation, the cost of constructing the exchange matrix is only a factor of four slower than the cost of diagonalizing the Fock matrix. Augmenting our approach with linear scaling algorithms can further speed up the calculations.


title: Classical double copy in the black hole mini-superspace

abstract: We give a novel formulation of classical double copy in the mini-superspace of static, spherically symmetric black holes where the map between the solutions of general relativity and Maxwell's theory can be realized in Boyer-Lindsquit coordinates. By employing the reduced action principle, we show that the double copy structure can be generalized to Lovelock gravities and quasi-topological gravities. However, the gravitational solutions are mapped to the purely electric solutions of Maxwell's theory with a difference: instead of a direct match between the Kerr-Schild scalar in the gravity side and the scalar potential in the gauge theory side, the scalar potential becomes a polynomial in the Kerr-Schild scalar, giving rise to a generalization of the Kerr-Schild double copy. We calculate the Regge-Teitelboim surface charges and prove that the mass of the black hole solution is identified with the electric charge corresponding to the Coulomb part of the gauge theory solution in the same way it does in the case of general relativity.


title: Deceptive Patterns of Intelligent and Interactive Writing Assistants

abstract: Large Language Models have become an integral part of new intelligent and interactive writing assistants. Many are offered commercially with a chatbot-like UI, such as ChatGPT, and provide little information about their inner workings. This makes this new type of widespread system a potential target for deceptive design patterns. For example, such assistants might exploit hidden costs by providing guidance up until a certain point before asking for a fee to see the rest. As another example, they might sneak unwanted content/edits into longer generated or revised text pieces (e.g. to influence the expressed opinion). With these and other examples, we conceptually transfer several deceptive patterns from the literature to the new context of AI writing assistants. Our goal is to raise awareness and encourage future research into how the UI and interaction design of such systems can impact people and their writing.


title: \textit{sweet} -- An Open Source Modular Platform for Contactless Hand Vascular Biometric Experiments

abstract: Current finger-vein or palm-vein recognition systems usually require direct contact of the subject with the apparatus. This can be problematic in environments where hygiene is of primary importance. In this work we present a contactless vascular biometrics sensor platform named \sweet which can be used for hand vascular biometrics studies (wrist-, palm- and finger-vein) and surface features such as palmprint. It supports several acquisition modalities such as multi-spectral Near-Infrared (NIR), RGB-color, Stereo Vision (SV) and Photometric Stereo (PS). Using this platform we collect a dataset consisting of the fingers, palm and wrist vascular data of 120 subjects and develop a powerful 3D pipeline for the pre-processing of this data. We then present biometric experimental results, focusing on Finger-Vein Recognition (FVR). Finally, we discuss fusion of multiple modalities, such palm-vein combined with palm-print biometrics. The acquisition software, parts of the hardware design, the new FV dataset, as well as source-code for our experiments are publicly available for research purposes.


title: Linear stability of vector Horndeski black holes

abstract: Horndeski's vector-tensor (HVT) gravity is described by a Lagrangian in which the field strength $F_{\mu \nu}=\partial_{\mu} A_{\nu}-\partial_{\nu} A_{\mu}$ of a vector field $A_{\mu}$ interacts with a double dual Riemann tensor $L^{\mu \nu \alpha \beta}$ in the form $\beta L^{\mu \nu \alpha \beta} F_{\mu \nu} F_{\alpha \beta}$, where $\beta$ is a constant. In Einstein-Maxwell-HVT theory, there are static and spherically symmetric black hole (BH) solutions with electric or magnetic charges, whose metric components are modified from those in the Reissner-Nordstr\"om geometry. The electric-magnetic duality of solutions is broken even at the background level by the nonvanishing coupling constant $\beta$. We compute a second-order action of BH perturbations containing both the odd- and even-parity modes and show that there are four dynamical perturbations arising from the gravitational and vector-field sectors. We derive all the linear stability conditions associated with the absence of ghosts and radial/angular Laplacian instabilities for both the electric and magnetic BHs. These conditions exhibit the difference between the electrically and magnetically charged cases by reflecting the breaking of electric-magnetic duality at the level of perturbations. In particular, the four angular propagation speeds in the large-multipole limit are different from each other for both the electric and magnetic BHs. This suggests the breaking of eikonal correspondence between the peak position of at least one of the potentials of dynamical perturbations and the radius of photon sphere. For the electrically and magnetically charged cases, we elucidate parameter spaces of the HVT coupling and the BH charge in which the BHs without naked singularities are linearly stable.


title: Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimation

abstract: Camera-based remote photoplethysmography (rPPG) enables contactless measurement of important physiological signals such as pulse rate (PR). However, dynamic and unconstrained subject motion introduces significant variability into the facial appearance in video, confounding the ability of video-based methods to accurately extract the rPPG signal. In this study, we leverage the 3D facial surface to construct a novel orientation-conditioned facial texture video representation which improves the motion robustness of existing video-based facial rPPG estimation methods. Our proposed method achieves a significant 18.2% performance improvement in cross-dataset testing on MMPD over our baseline using the PhysNet model trained on PURE, highlighting the efficacy and generalization benefits of our designed video representation. We demonstrate significant performance improvements of up to 29.6% in all tested motion scenarios in cross-dataset testing on MMPD, even in the presence of dynamic and unconstrained subject motion, emphasizing the benefits of disentangling motion through modeling the 3D facial surface for motion robust facial rPPG estimation. We validate the efficacy of our design decisions and the impact of different video processing steps through an ablation study. Our findings illustrate the potential strengths of exploiting the 3D facial surface as a general strategy for addressing dynamic and unconstrained subject motion in videos. The code is available at https://samcantrill.github.io/orientation-uv-rppg/.


title: Disentangling modified gravity from a dark force with gravitational redshift

abstract: The standard approach to test for deviations from General Relativity on cosmological scales is to combine measurements of the growth rate of structure with gravitational lensing. In this study, we show that this method suffers from an important limitation with regard to these two probes: models of dark matter with additional interactions can lead to the very same observational signatures found in modified gravity (and viceversa). Using synthetic data of redshift-space distortions, weak lensing, and cosmic microwave background, we demonstrate that this degeneracy is inevitable between modifications of gravity and a dark fifth force. We then show that the coming generation of surveys, in particular the Square Kilometer Array, will allow us to break the degeneracy between such models through measurements of gravitational redshift. Performing a Markov Chain Monte Carlo analysis of the synthetic data set, we quantify the extent to which gravitational redshift can distinguish between two representative classes of models, Generalized Brans-Dicke (modified gravity) and Coupled Quintessence (fifth force).


title: The effects of finite electron inertia on helicity-barrier-mediated turbulence

abstract: Understanding the partitioning of turbulent energy between ions and electrons in weakly collisional plasmas is crucial for the accurate interpretation of observations and modelling of various astrophysical phenomena. Many such plasmas are "imbalanced", wherein the large-scale energy input is dominated by Alfv\'enic fluctuations propagating in a single direction. In this paper, we demonstrate that when strongly-magnetised plasma turbulence is imbalanced, nonlinear conservation laws imply the existence of a critical value of the electron plasma beta that separates two dramatically different types of turbulence in parameter space. For betas below the critical value, the free energy injected on the largest scales is able to undergo a familiar Kolmogorov-type cascade to small scales where it is dissipated, heating electrons. For betas above the critical value, the system forms a "helicity barrier" that prevents the cascade from proceeding past the ion Larmor radius, causing the majority of the injected free energy to be deposited into ion heating. Physically, the helicity barrier results from the inability of the system to adjust to the disparity between the perpendicular-wavenumber scalings of the free energy and generalised helicity below the ion Larmor radius; restoring finite electron inertia can annul, or even reverse, this disparity, giving rise to the aforementioned critical beta. We relate this physics to the "dynamic phase alignment" mechanism, and characterise various other important features of the helicity barrier, including the nature of the nonlinear wavenumber-space fluxes, dissipation rates, and energy spectra. The existence of such a critical beta has important implications for heating, as it suggests that the dominant recipient of the turbulent energy -- ions or electrons -- can depend sensitively on the characteristics of the plasma at large scales.


title: Eddington envelopes: The fate of stars on parabolic orbits tidally disrupted by supermassive black holes

abstract: Stars falling too close to massive black holes in the centres of galaxies can be torn apart by the strong tidal forces. Simulating the subsequent feeding of the black hole with disrupted material has proved challenging because of the range of timescales involved. Here we report a set of simulations that capture the relativistic disruption of the star, followed by one year of evolution of the returning debris stream. These reveal the formation of an expanding asymmetric bubble of material extending to hundreds of astronomical units -- an Eddington envelope with an optically thick inner region. Such envelopes have been hypothesised as the reprocessing layer needed to explain optical/UV emission in tidal disruption events, but never produced self-consistently in a simulation. Our model broadly matches the observed light curves with low temperatures, faint luminosities, and line widths of 10,000--20,000 km/s.


title: Implicit EXP-RBF techniques for modeling unsaturated flow through soils with water uptake by plant roots

abstract: Modeling unsaturated flow through soils with water uptake by plan root has many applications in agriculture and water resources management. In this study, our aim is to develop efficient numerical techniques for solving the Richards equation with a sink term due to plant root water uptake. The Feddes model is used for water absorption by plant roots, and the van-Genuchten model is employed for capillary pressure. We introduce a numerical approach that combines the localized exponential radial basis function (EXP-RBF) method for space and the second-order backward differentiation formula (BDF2) for temporal discretization. The localized RBF methods eliminate the need for mesh generation and avoid ill-conditioning problems. This approach yields a sparse matrix for the global system, optimizing memory usage and computational time. The proposed implicit EXP-RBF techniques have advantages in terms of accuracy and computational efficiency thanks to the use of BDF2 and the localized RBF method. Modified Picards iteration method for the mixed form of the Richards equation is employed to linearize the system. Various numerical experiments are conducted to validate the proposed numerical model of infiltration with plant root water absorption. The obtained results conclusively demonstrate the effectiveness of the proposed numerical model in accurately predicting soil moisture dynamics under water uptake by plant roots. The proposed numerical techniques can be incorporated in the numerical models where unsaturated flows and water uptake by plant roots are involved such as in hydrology, agriculture, and water management.


title: Low-Resource Named Entity Recognition with Cross-Lingual, Character-Level Neural Conditional Random Fields

abstract: Low-resource named entity recognition is still an open problem in NLP. Most state-of-the-art systems require tens of thousands of annotated sentences in order to obtain high performance. However, for most of the world's languages, it is unfeasible to obtain such annotation. In this paper, we present a transfer learning scheme, whereby we train character-level neural CRFs to predict named entities for both high-resource languages and low resource languages jointly. Learning character representations for multiple related languages allows transfer among the languages, improving F1 by up to 9.8 points over a loglinear CRF baseline.


title: Tasks People Prompt: A Taxonomy of LLM Downstream Tasks in Software Verification and Falsification Approaches

abstract: Prompting has become one of the main approaches to leverage emergent capabilities of Large Language Models [Brown et al. NeurIPS 2020, Wei et al. TMLR 2022, Wei et al. NeurIPS 2022]. During the last year, researchers and practitioners have been playing with prompts to see how to make the most of LLMs. By homogeneously dissecting 80 papers, we investigate in deep how software testing and verification research communities have been abstractly architecting their LLM-enabled solutions. More precisely, first, we want to validate whether downstream tasks are an adequate concept to convey the blueprint of prompt-based solutions. We also aim at identifying number and nature of such tasks in solutions. For such goal, we develop a novel downstream task taxonomy that enables pinpointing some engineering patterns in a rather varied spectrum of Software Engineering problems that encompasses testing, fuzzing, debugging, vulnerability detection, static analysis and program verification approaches.


title: A Large-Scale Evaluation of Speech Foundation Models

abstract: The foundation model paradigm leverages a shared foundation model to achieve state-of-the-art (SOTA) performance for various tasks, requiring minimal downstream-specific modeling and data annotation. This approach has proven crucial in the field of Natural Language Processing (NLP). However, the speech processing community lacks a similar setup to explore the paradigm systematically. In this work, we establish the Speech processing Universal PERformance Benchmark (SUPERB) to study the effectiveness of the paradigm for speech. We propose a unified multi-tasking framework to address speech processing tasks in SUPERB using a frozen foundation model followed by task-specialized, lightweight prediction heads. Combining our results with community submissions, we verify that the foundation model paradigm is promising for speech, and our multi-tasking framework is simple yet effective, as the best-performing foundation model shows competitive generalizability across most SUPERB tasks. For reproducibility and extensibility, we have developed a long-term maintained platform that enables deterministic benchmarking, allows for result sharing via an online leaderboard, and promotes collaboration through a community-driven benchmark database to support new development cycles. Finally, we conduct a series of analyses to offer an in-depth understanding of SUPERB and speech foundation models, including information flows across tasks inside the models, the correctness of the weighted-sum benchmarking protocol and the statistical significance and robustness of the benchmark.


title: Integrating Marketing Channels into Quantile Transformation and Bayesian Optimization of Ensemble Kernels for Sales Prediction with Gaussian Process Models

abstract: This study introduces an innovative Gaussian Process (GP) model utilizing an ensemble kernel that integrates Radial Basis Function (RBF), Rational Quadratic, and Mat\'ern kernels for product sales forecasting. By applying Bayesian optimization, we efficiently find the optimal weights for each kernel, enhancing the model's ability to handle complex sales data patterns. Our approach significantly outperforms traditional GP models, achieving a notable 98\% accuracy and superior performance across key metrics including Mean Squared Error (MSE), Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), and Coefficient of Determination ($R^2$). This advancement underscores the effectiveness of ensemble kernels and Bayesian optimization in improving predictive accuracy, offering profound implications for machine learning applications in sales forecasting.


title: RankCLIP: Ranking-Consistent Language-Image Pretraining

abstract: Self-supervised contrastive learning models, such as CLIP, have set new benchmarks for vision-language models in many downstream tasks. However, their dependency on rigid one-to-one mappings overlooks the complex and often multifaceted relationships between and within texts and images. To this end, we introduce RANKCLIP, a novel pretraining method that extends beyond the rigid one-to-one matching framework of CLIP and its variants. By extending the traditional pair-wise loss to list-wise, and leveraging both in-modal and cross-modal ranking consistency, RANKCLIP improves the alignment process, enabling it to capture the nuanced many-to-many relationships between and within each modality. Through comprehensive experiments, we demonstrate the effectiveness of RANKCLIP in various downstream tasks, notably achieving significant gains in zero-shot classifications over state-of-the-art methods, underscoring the importance of this enhanced learning process.


title: Magnon-Skyrmion Hybrid Quantum Systems: Tailoring Interactions via Magnons

abstract: Coherent and dissipative interactions between different quantum systems are essential for the construction of hybrid quantum systems and the investigation of novel quantum phenomena. Here, we propose and analyze a magnon-skyrmion hybrid quantum system, consisting of a micromagnet and nearby magnetic skyrmions. We predict a strong coupling mechanism between the magnonic mode of the micromagnet and the quantized helicity degree of freedom of the skyrmion. We show that with this hybrid setup it is possible to induce magnon-mediated nonreciprocal interactions and responses between distant skyrmion qubits or between skyrmion qubits and other quantum systems like superconducting qubits. This work provides a quantum platform for the investigation of diverse quantum effects and quantum information processing with magnetic microstructures.


title: Masked and Shuffled Blind Spot Denoising for Real-World Images

abstract: We introduce a novel approach to single image denoising based on the Blind Spot Denoising principle, which we call MAsked and SHuffled Blind Spot Denoising (MASH). We focus on the case of correlated noise, which often plagues real images. MASH is the result of a careful analysis to determine the relationships between the level of blindness (masking) of the input and the (unknown) noise correlation. Moreover, we introduce a shuffling technique to weaken the local correlation of noise, which in turn yields an additional denoising performance improvement. We evaluate MASH via extensive experiments on real-world noisy image datasets. We demonstrate on par or better results compared to existing self-supervised denoising methods.


title: Skyrmion-mechanical hybrid quantum systems: Manipulation of skyrmion qubits via phonons

abstract: Skyrmion qubits are a new highly promising logic element for quantum information processing. However, their scalability to multiple interacting qubits remains challenging. We propose a hybrid quantum setup with skyrmion qubits strongly coupled to nanomechanical cantilevers via magnetic coupling, which harnesses phonons as quantum interfaces for the manipulation of distant skyrmion qubits. A linear drive is utilized to achieve the modulation of the stiffness coefficient of the cantilever, resulting in an exponential enhancement of the coupling strength between the skyrmion qubit and the mechanical mode. We also consider the case of a topological resonator array, which allows us to study interactions between skyrmion qubits and topological phonon band structure, as well as chiral skyrmion-skyrmion interactions. The scheme suggested here offers a fascinating platform for investigating quantum information processing and quantum simulation with magnetic microstructures.


title: Privacy at a Price: Exploring its Dual Impact on AI Fairness

abstract: The worldwide adoption of machine learning (ML) and deep learning models, particularly in critical sectors, such as healthcare and finance, presents substantial challenges in maintaining individual privacy and fairness. These two elements are vital to a trustworthy environment for learning systems. While numerous studies have concentrated on protecting individual privacy through differential privacy (DP) mechanisms, emerging research indicates that differential privacy in machine learning models can unequally impact separate demographic subgroups regarding prediction accuracy. This leads to a fairness concern, and manifests as biased performance. Although the prevailing view is that enhancing privacy intensifies fairness disparities, a smaller, yet significant, subset of research suggests the opposite view. In this article, with extensive evaluation results, we demonstrate that the impact of differential privacy on fairness is not monotonous. Instead, we observe that the accuracy disparity initially grows as more DP noise (enhanced privacy) is added to the ML process, but subsequently diminishes at higher privacy levels with even more noise. Moreover, implementing gradient clipping in the differentially private stochastic gradient descent ML method can mitigate the negative impact of DP noise on fairness. This mitigation is achieved by moderating the disparity growth through a lower clipping threshold.


title: An Autoencoder-Based Constellation Design for AirComp in Wireless Federated Learning

abstract: Wireless federated learning (FL) relies on efficient uplink communications to aggregate model updates across distributed edge devices. Over-the-air computation (a.k.a. AirComp) has emerged as a promising approach for addressing the scalability challenge of FL over wireless links with limited communication resources. Unlike conventional methods, AirComp allows multiple edge devices to transmit uplink signals simultaneously, enabling the parameter server to directly decode the average global model. However, existing AirComp solutions are intrinsically analog, while modern wireless systems predominantly adopt digital modulations. Consequently, careful constellation designs are necessary to accurately decode the sum model updates without ambiguity. In this paper, we propose an end-to-end communication system supporting AirComp with digital modulation, aiming to overcome the challenges associated with accurate decoding of the sum signal with constellation designs. We leverage autoencoder network structures and explore the joint optimization of transmitter and receiver components. Our approach fills an important gap in the context of accurately decoding the sum signal in digital modulation-based AirComp, which can advance the deployment of FL in contemporary wireless systems.


title: Identification of cardiovascular diseases through ECG classification using wavelet transformation

abstract: Cardiovascular diseases are the leading cause of mortality globally, necessitating advancements in diagnostic techniques. This study explores the application of wavelet transformation for classifying electrocardiogram (ECG) signals to identify various cardiovascular conditions. Utilizing the MIT-BIH Arrhythmia Database, we employed both continuous and discrete wavelet transforms to decompose ECG signals into frequency sub-bands, from which we extracted eight statistical features per band. These features were then used to train and test various classifiers, including K-Nearest Neighbors and Support Vector Machines, among others. The classifiers demonstrated high efficacy, with some achieving an accuracy of up to 96% on test data, suggesting that wavelet-based feature extraction significantly enhances the prediction of cardiovascular abnormalities in ECG data. The findings advocate for further exploration of wavelet transforms in medical diagnostics to improve automation and accuracy in disease detection. Future work will focus on optimizing feature selection and classifier parameters to refine predictive performance further.


title: Fluorite-type materials in the monolayer limit

abstract: The 2H, 1T, and their distorted structures are known as prototype structures of $AB_2$ monolayers. Here, we study a puckered structure that is truncated from the (110) surface of fluorite-type materials. 53 fluorite-type materials are investigated based on first-principles approach. The formation energy calculations indicate that seven systems form the puckered structure in the monolayer limit, while other systems form either 1T, 2H, or distorted 1T structures. The puckered structures of PbF$_2$, PRh$_2$, and Ga$_2$Au exhibit negative Poisson's ratio (NPR) in the out-of-plane direction. An analytical model for the NPR is derived. The surface energy calculations predict the appearance of NPR.


title: Data Analysis Methods Preliminaries for a Photon-based Hardware Random Number Generator

abstract: High quality random numbers are necessary in the modern world. Ranging from encryption keys in cyber security to models and simulations for scientific use: it's important that these random numbers are of high quality and quickly attainable. One common solution to the generation of random numbers is that of pseudo-random number generators, or PRNGs. PRNGs generate random numbers by first quantifying some unpredictable phenomena into a number or string and feeding it into an algorithm which yields numbers randomly based on that seed. Easy places to find seeds include the user's mouse movements or the machine's uptime. These are only pseudorandom, however, as if given the same seed twice, the PRNG would generate the same 'random' output. This is great for games like Minecraft, but not so great for cybersecurity encryption key generation. By using a hardware random number generator (HRNG), random numbers that are not susceptible to the flaws found in PRNGs can be attained at a high rate.


title: Main $\mathbf{Q}$-eigenvalues of quasi-threshold graphs

abstract: In this note, we present a structural description of certain connected cographs having $k \geq 2$ main signless Laplacian eigenvalues. This result allows us to characterize the cographs which are quasi-threshold graphs with two main $\mathbf{Q}$-eigenvalues. In addition, we describe all the quasi-threshold graphs belonging to the subclass of generalized core-satellite graphs with $k \geq 2$ main $\mathbf{Q}$-eigenvalues.


title: Systematic Effects in Galaxy-Galaxy Lensing with DESI

abstract: The Dark Energy Spectroscopic Instrument (DESI) survey will measure spectroscopic redshifts for millions of galaxies across roughly $14,000 \, \mathrm{deg}^2$ of the sky. Cross-correlating targets in the DESI survey with complementary imaging surveys allows us to measure and analyze shear distortions caused by gravitational lensing in unprecedented detail. In this work, we analyze a series of mock catalogs with ray-traced gravitational lensing and increasing sophistication to estimate systematic effects on galaxy-galaxy lensing estimators such as the tangential shear $\gamma_{\mathrm{t}}$ and the excess surface density $\Delta\Sigma$. We employ mock catalogs tailored to the specific imaging surveys overlapping with the DESI survey: the Dark Energy Survey (DES), the Hyper Suprime-Cam (HSC) survey, and the Kilo-Degree Survey (KiDS). Among others, we find that fiber incompleteness can have significant effects on galaxy-galaxy lensing estimators but can be corrected effectively by up-weighting DESI targets with fibers by the inverse of the fiber assignment probability. Similarly, we show that intrinsic alignment and lens magnification are expected to be statistically significant given the precision forecasted for the DESI year-1 data set. Our study informs several analysis choices for upcoming cross-correlation studies of DESI with DES, HSC, and KiDS.


title: A Generic Approach to Fix Test Flakiness in Real-World Projects

abstract: Test flakiness, a non-deterministic behavior of builds irrelevant to code changes, is a major and continuing impediment to delivering reliable software. The very few techniques for the automated repair of test flakiness are specifically crafted to repair either Order-Dependent (OD) or Implementation-Dependent (ID) flakiness. They are also all symbolic approaches, i.e., leverage program analysis to detect and repair known test flakiness patterns and root causes, failing to generalize. To bridge the gap, we propose FlakyDoctor, a neuro-symbolic technique that combines the power of LLMs-generalizability-and program analysis-soundness-to fix different types of test flakiness. Our extensive evaluation using 873 confirmed flaky tests (332 OD and 541 ID) from 243 real-world projects demonstrates the ability of FlakyDoctor in repairing flakiness, achieving 57% (OD) and 59% (ID) success rate. Comparing to three alternative flakiness repair approaches, FlakyDoctor can repair 8% more ID tests than DexFix, 12% more OD flaky tests than ODRepair, and 17% more OD flaky tests than iFixFlakies. Regardless of underlying LLM, the non-LLM components of FlakyDoctor contribute to 12-31% of the overall performance, i.e., while part of the FlakyDoctor power is from using LLMs, they are not good enough to repair flaky tests in real-world projects alone. What makes the proposed technique superior to related research on test flakiness mitigation specifically and program repair, in general, is repairing 79 previously unfixed flaky tests in real-world projects. We opened pull requests for all cases with corresponding patches; 19 of them were accepted and merged at the time of submission.


title: Characterizing Kirkwood-Dirac positive states based on discrete Fourier transform

abstract: Kirkwood-Dirac (KD) distribution is helpful to describe nonclassical phenomena and quantum advantages, which have been linked with nonpositive entries of KD distribution. Suppose that $\mathcal{A}$ and $\mathcal{B}$ are the eigenprojectors of the two eigenbases of two observables and the discrete Fourier transform (DFT) matrix is the transition matrix between the two eigenbases. In a system with prime dimension, the set $\mathcal{E}_{KD+}$ of KD positive states based on the DFT matrix is convex combinations of $\mathcal{A}$ and $\mathcal{B}$. That is, $\mathcal{E}_{KD+}={\rm conv}(\mathcal{A}\cup\mathcal{B})$ [arXiv:2306.00086]. In this paper, we generalize the result. That is, in a $d$-dimensional system, $\mathcal{E}_{KD+}={\rm conv}(\Omega)$ for $d=p^{2}$ and $d=pq$, where $p, q$ are prime and $\Omega$ is the set of projectors of all the pure KD positive states.


title: Fractional Integral Estimates of Hermite-Hadamard type in Global Nonpositive Curvature Spaces

abstract: We extend the notion of convexity of functions defined on global nonpositive curvature spaces by introducing (geodesically) $h$-convex functions. We prove estimates of Hermite-Hadamard type via Katugampola's fractional integrals. We obtain an important corollary which gives an essentially sharp estimate involving squared distance mappings between points in a global NPC space. This is a contribution to analysis on spaces with curved geometry.


title: Watermark-embedded Adversarial Examples for Copyright Protection against Diffusion Models

abstract: Diffusion Models (DMs) have shown remarkable capabilities in various image-generation tasks. However, there are growing concerns that DMs could be used to imitate unauthorized creations and thus raise copyright issues. To address this issue, we propose a novel framework that embeds personal watermarks in the generation of adversarial examples. Such examples can force DMs to generate images with visible watermarks and prevent DMs from imitating unauthorized images. We construct a generator based on conditional adversarial networks and design three losses (adversarial loss, GAN loss, and perturbation loss) to generate adversarial examples that have subtle perturbation but can effectively attack DMs to prevent copyright violations. Training a generator for a personal watermark by our method only requires 5-10 samples within 2-3 minutes, and once the generator is trained, it can generate adversarial examples with that watermark significantly fast (0.2s per image). We conduct extensive experiments in various conditional image-generation scenarios. Compared to existing methods that generate images with chaotic textures, our method adds visible watermarks on the generated images, which is a more straightforward way to indicate copyright violations. We also observe that our adversarial examples exhibit good transferability across unknown generative models. Therefore, this work provides a simple yet powerful way to protect copyright from DM-based imitation.


title: Neural McKean-Vlasov Processes: Distributional Dependence in Diffusion Processes

abstract: McKean-Vlasov stochastic differential equations (MV-SDEs) provide a mathematical description of the behavior of an infinite number of interacting particles by imposing a dependence on the particle density. As such, we study the influence of explicitly including distributional information in the parameterization of the SDE. We propose a series of semi-parametric methods for representing MV-SDEs, and corresponding estimators for inferring parameters from data based on the properties of the MV-SDE. We analyze the characteristics of the different architectures and estimators, and consider their applicability in relevant machine learning problems. We empirically compare the performance of the different architectures and estimators on real and synthetic datasets for time series and probabilistic modeling. The results suggest that explicitly including distributional dependence in the parameterization of the SDE is effective in modeling temporal data with interaction under an exchangeability assumption while maintaining strong performance for standard It\^o-SDEs due to the richer class of probability flows associated with MV-SDEs.


title: Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal Learning

abstract: Integrating and processing information from various sources or modalities are critical for obtaining a comprehensive and accurate perception of the real world in autonomous systems and cyber-physical systems. Drawing inspiration from neuroscience, we develop the Information-Theoretic Hierarchical Perception (ITHP) model, which utilizes the concept of information bottleneck. Different from most traditional fusion models that incorporate all modalities identically in neural networks, our model designates a prime modality and regards the remaining modalities as detectors in the information pathway, serving to distill the flow of information. Our proposed perception model focuses on constructing an effective and compact information flow by achieving a balance between the minimization of mutual information between the latent state and the input modal state, and the maximization of mutual information between the latent states and the remaining modal states. This approach leads to compact latent state representations that retain relevant information while minimizing redundancy, thereby substantially enhancing the performance of multimodal representation learning. Experimental evaluations on the MUStARD, CMU-MOSI, and CMU-MOSEI datasets demonstrate that our model consistently distills crucial information in multimodal learning scenarios, outperforming state-of-the-art benchmarks. Remarkably, on the CMU-MOSI dataset, ITHP surpasses human-level performance in the multimodal sentiment binary classification task across all evaluation metrics (i.e., Binary Accuracy, F1 Score, Mean Absolute Error, and Pearson Correlation).


title: EQO: Exploring Ultra-Efficient Private Inference with Winograd-Based Protocol and Quantization Co-Optimization

abstract: Private convolutional neural network (CNN) inference based on secure two-party computation (2PC) suffers from high communication and latency overhead, especially from convolution layers. In this paper, we propose EQO, a quantized 2PC inference framework that jointly optimizes the CNNs and 2PC protocols. EQO features a novel 2PC protocol that combines Winograd transformation with quantization for efficient convolution computation. However, we observe naively combining quantization and Winograd convolution is sub-optimal: Winograd transformations introduce extensive local additions and weight outliers that increase the quantization bit widths and require frequent bit width conversions with non-negligible communication overhead. Therefore, at the protocol level, we propose a series of optimizations for the 2PC inference graph to minimize the communication. At the network level, We develop a sensitivity-based mixed-precision quantization algorithm to optimize network accuracy given communication constraints. We further propose a 2PC-friendly bit re-weighting algorithm to accommodate weight outliers without increasing bit widths. With extensive experiments, EQO demonstrates 11.7x, 3.6x, and 6.3x communication reduction with 1.29%, 1.16%, and 1.29% higher accuracy compared to state-of-the-art frameworks SiRNN, COINN, and CoPriv, respectively.


title: Few-shot Name Entity Recognition on StackOverflow

abstract: StackOverflow, with its vast question repository and limited labeled examples, raise an annotation challenge for us. We address this gap by proposing RoBERTa+MAML, a few-shot named entity recognition (NER) method leveraging meta-learning. Our approach, evaluated on the StackOverflow NER corpus (27 entity types), achieves a 5% F1 score improvement over the baseline. We improved the results further domain-specific phrase processing enhance results.


title: Human-in-the-Loop Segmentation of Multi-species Coral Imagery

abstract: Broad-scale marine surveys performed by underwater vehicles significantly increase the availability of coral reef imagery, however it is costly and time-consuming for domain experts to label images. Point label propagation is an approach used to leverage existing image data labeled with sparse point labels. The resulting augmented ground truth generated is then used to train a semantic segmentation model. Here, we first demonstrate that recent advances in foundation models enable generation of multi-species coral augmented ground truth masks using denoised DINOv2 features and K-Nearest Neighbors (KNN), without the need for any pre-training or custom-designed algorithms. For extremely sparsely labeled images, we propose a labeling regime based on human-in-the-loop principles, resulting in significant improvement in annotation efficiency: If only 5 point labels per image are available, our proposed human-in-the-loop approach improves on the state-of-the-art by 17.3% for pixel accuracy and 22.6% for mIoU; and by 10.6% and 19.1% when 10 point labels per image are available. Even if the human-in-the-loop labeling regime is not used, the denoised DINOv2 features with a KNN outperforms the prior state-of-the-art by 3.5% for pixel accuracy and 5.7% for mIoU (5 grid points). We also provide a detailed analysis of how point labeling style and the quantity of points per image affects the point label propagation quality and provide general recommendations on maximizing point label efficiency.


title: Intravalley Andreev reflection in the multi-terminal device with Y-shaped Kekul\'{e} graphene superlattices

abstract: Using the tight-binding model, a multi-terminal superconductor(S) device is proposed, where the structures of the center region are primitive grpahene(G) and Y-shaped Kekul\'{e} graphene superlattice(GS), respectively. The intravalley Andreev reflection is studied in this model through the utilization of the non-equilibrium Green's function method. In the G/S device, due to the time-reverse symmetry the dominant process of Andreev reflection is intervalley reflection. In a three-terminal GS/S device, it has been observed that the coefficient of intravalley Andreev reflection can surpass that of intervalley reflection in crossed Andreev reflection. This is attributed to the coupling between valleys K and -K within the first Brillouin zone, resulting in enhanced intervalley scattering. The valley-dependent transport of Andreev reflection can be influenced by the phase difference between superconductor terminals. The valley polarization of the local Andreev reflection and the crossed Andreev reflection could be controlled by adjusting the structure of the central region.


title: A Distributed Scalable Cross-chain State Channel Scheme Based on Recursive State Synchronization

abstract: As cross-chain technology continues to advance, the scale of cross-chain transactions is experiencing significant expansion. To improve scalability, researchers have turned to the study of cross-chain state channels. However, most of the existing schemes rely on trusted parties to support channel operations. To address this issue, we present Interpipe: a distributed cross-chain state channel scheme. Specifically, we propose a real-time cross-chain synchronization scheme to ensure consistent operations between two blockchains to a cross-chain state channel. Moreover, we propose a batch transaction proof scheme based on recursive SNARK to meet the cross-chain verification needs of large-scale users. Based on the above designs, Interpipe offers protocols for opening, updating, closing, and disputing operations to cross-chain state channels. Security analysis shows that Interpipe has consistency and resistance, and experimental results demonstrate that a cross-chain state channel can be nearly as efficient as an existing intra-chain state channel.


title: Disorder Chaos in Short-Range, Diluted, and L\'evy Spin Glasses

abstract: In a recent breakthrough [arXiv:2301.04112], Chatterjee proved site disorder chaos in the Edwards-Anderson (EA) short-range spin glass model utilizing the Hermite spectral method. In this paper, we demonstrate the further usefulness of this Hermite spectral approach by extending the validity of site disorder chaos in three related spin glass models. The first, called the mixed even $p$-spin short-range model, is a generalization of the EA model where the underlying graph is a deterministic bounded degree hypergraph consisting of hyperedges with even number of vertices. The second model is the diluted mixed $p$-spin model, which is allowed to have hyperedges with both odd and even number of vertices. For both models, our results hold under general symmetric disorder distributions. The main novelty of our argument is played by an elementary algebraic equation for the Fourier-Hermite series coefficients for the two-spin correlation functions. It allows us to deduce necessary geometric conditions to determine the contributing coefficients in the overlap function, which in spirit is the same as the crucial Lemma 1 in [arXiv:2301.04112]. Finally, we also establish disorder chaos in the L\'evy model with stable index $\alpha \in (1, 2)$.


title: $L^2$-based stability of blowup with log correction for semilinear heat equation

abstract: We propose an alternative proof of the classical result of type-I blowup with log correction for the semilinear equation. Compared with previous proofs, we use a novel idea of enforcing stable normalizations for perturbation around the approximate profile and establish a weighted $H^k$ stability, thereby avoiding the use of a topological argument and the analysis of a linearized spectrum. Therefore, this approach can be adopted even if we only have a numerical profile and do not have explicit information on the spectrum of its linearized operator. This result generalizes the $L^2$-based stability argument to blowups that are not exactly self-similar and can be adapted to higher dimensions. Numerical results corroborate the effectiveness of our normalization, even in the large perturbation regime beyond our theoretical setting.


title: Wasserstein Wormhole: Scalable Optimal Transport Distance with Transformers

abstract: Optimal transport (OT) and the related Wasserstein metric (W) are powerful and ubiquitous tools for comparing distributions. However, computing pairwise Wasserstein distances rapidly becomes intractable as cohort size grows. An attractive alternative would be to find an embedding space in which pairwise Euclidean distances map to OT distances, akin to standard multidimensional scaling (MDS). We present Wasserstein Wormhole, a transformer-based autoencoder that embeds empirical distributions into a latent space wherein Euclidean distances approximate OT distances. Extending MDS theory, we show that our objective function implies a bound on the error incurred when embedding non-Euclidean distances. Empirically, distances between Wormhole embeddings closely match Wasserstein distances, enabling linear time computation of OT distances. Along with an encoder that maps distributions to embeddings, Wasserstein Wormhole includes a decoder that maps embeddings back to distributions, allowing for operations in the embedding space to generalize to OT spaces, such as Wasserstein barycenter estimation and OT interpolation. By lending scalability and interpretability to OT approaches, Wasserstein Wormhole unlocks new avenues for data analysis in the fields of computational geometry and single-cell biology.


title: DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading

abstract: Reconstructing and editing 3D objects and scenes both play crucial roles in computer graphics and computer vision. Neural radiance fields (NeRFs) can achieve realistic reconstruction and editing results but suffer from inefficiency in rendering. Gaussian splatting significantly accelerates rendering by rasterizing Gaussian ellipsoids. However, Gaussian splatting utilizes a single Spherical Harmonic (SH) function to model both texture and lighting, limiting independent editing capabilities of these components. Recently, attempts have been made to decouple texture and lighting with the Gaussian splatting representation but may fail to produce plausible geometry and decomposition results on reflective scenes. Additionally, the forward shading technique they employ introduces noticeable blending artifacts during relighting, as the geometry attributes of Gaussians are optimized under the original illumination and may not be suitable for novel lighting conditions. To address these issues, we introduce DeferredGS, a method for decoupling and editing the Gaussian splatting representation using deferred shading. To achieve successful decoupling, we model the illumination with a learnable environment map and define additional attributes such as texture parameters and normal direction on Gaussians, where the normal is distilled from a jointly trained signed distance function. More importantly, we apply deferred shading, resulting in more realistic relighting effects compared to previous methods. Both qualitative and quantitative experiments demonstrate the superior performance of DeferredGS in novel view synthesis and editing tasks.


title: On the Optimal Regret of Locally Private Linear Contextual Bandit

abstract: Contextual bandit with linear reward functions is among one of the most extensively studied models in bandit and online learning research. Recently, there has been increasing interest in designing \emph{locally private} linear contextual bandit algorithms, where sensitive information contained in contexts and rewards is protected against leakage to the general public. While the classical linear contextual bandit algorithm admits cumulative regret upper bounds of $\tilde O(\sqrt{T})$ via multiple alternative methods, it has remained open whether such regret bounds are attainable in the presence of local privacy constraints, with the state-of-the-art result being $\tilde O(T^{3/4})$. In this paper, we show that it is indeed possible to achieve an $\tilde O(\sqrt{T})$ regret upper bound for locally private linear contextual bandit. Our solution relies on several new algorithmic and analytical ideas, such as the analysis of mean absolute deviation errors and layered principal component regression in order to achieve small mean absolute deviation errors.


title: General Bayesian inference for causal effects using covariate balancing procedure

abstract: In observational studies, the propensity score plays a central role in estimating causal effects of interest. The inverse probability weighting (IPW) estimator is especially commonly used. However, if the propensity score model is misspecified, the IPW estimator may produce biased estimates of causal effects. Previous studies have proposed some robust propensity score estimation procedures; these methods, however, require consideration of parameters that dominate the uncertainty of sampling and treatment allocation. In this manuscript, we propose a novel Bayesian estimating procedure that necessitates deciding the parameter probability, rather than deterministically. Since both the IPW estimator and the propensity score estimator can be derived as solutions to certain loss functions, the general Bayesian paradigm, which does not require the consideration of the full likelihood, can be applied. In this sense, our proposed method only requires the same level of assumptions as ordinary causal inference contexts.


title: A Review on Machine Learning Algorithms for Dust Aerosol Detection using Satellite Data

abstract: Dust storms are associated with certain respiratory illnesses across different areas in the world. Researchers have devoted time and resources to study the elements surrounding dust storm phenomena. This paper reviews the efforts of those who have investigated dust aerosols using sensors onboard of satellites using machine learning-based approaches. We have reviewed the most common issues revolving dust aerosol modeling using different datasets and different sensors from a historical perspective. Our findings suggest that multi-spectral approaches based on linear and non-linear combinations of spectral bands are some of the most successful for visualization and quantitative analysis; however, when researchers have leveraged machine learning, performance has been improved and new opportunities to solve unique problems arise.


title: Automatic Knowledge Graph Construction for Judicial Cases

abstract: In this paper, we explore the application of cognitive intelligence in legal knowledge, focusing on the development of judicial artificial intelligence. Utilizing natural language processing (NLP) as the core technology, we propose a method for the automatic construction of case knowledge graphs for judicial cases. Our approach centers on two fundamental NLP tasks: entity recognition and relationship extraction. We compare two pre-trained models for entity recognition to establish their efficacy. Additionally, we introduce a multi-task semantic relationship extraction model that incorporates translational embedding, leading to a nuanced contextualized case knowledge representation. Specifically, in a case study involving a "Motor Vehicle Traffic Accident Liability Dispute," our approach significantly outperforms the baseline model. The entity recognition F1 score improved by 0.36, while the relationship extraction F1 score increased by 2.37. Building on these results, we detail the automatic construction process of case knowledge graphs for judicial cases, enabling the assembly of knowledge graphs for hundreds of thousands of judgments. This framework provides robust semantic support for applications of judicial AI, including the precise categorization and recommendation of related cases.


title: Satellite observations reveal shorter periodic inner core oscillation

abstract: Detecting the Earth's inner core motions relative to the mantle presents a considerable challenge due to their indirect accessibility. Seismological observations initially provided evidence for differential/super-rotation of the inner core, but recently demonstrated a possibly about 70-year periodic oscillation. The contrasting results underscore the ongoing enigma surrounding inner core motion, leaving debates unresolved, including the precise oscillate period. In parallel to seismic observations, satellite geodesy has accumulated decades of global high-precision records, providing a novel avenue to probe inner core motions. Here, we detect an about 6-year oscillation from the gravitational field degree-2 order-2 Stokes coefficients derived from satellite observations, and find it has a unique phase correlation with the about 6-year signal in the Earth's length-of-day variations. This correlation is attributed to an inner core oscillation which is controlled by the gravitational coupling between the inner core and lower mantle (mainly due to the density heterogeneity of the two large low-velocity provinces; LLVPs). That is, we independently corroborate the inner core periodic oscillation, albeit with a significantly shorter period than previously suggested. Our findings demonstrate the dense layer of the LLVPs (mean density anomalies of about +0.9 percent at the bottom), consistent with inversions from tidal tomography and Stoneley modes. Furthermore, our research reveals equatorial topographic undulations of about 187 m at the inner core boundary.


abstract: Polarized radio emission of RRAT J1854+0306 is investigated with single pulses using Five-hundred-meter-Aperture Spherical Telescope. Its emission is characterized by nulls, narrow and weak pulses, and occasional wide and intense bursts with a nulling fraction of 53.2%. Its burst emission is typically of one rotation, and occasionally of two or three or even five rotations at the most, but without significant periodicity. The integrated pulse profile has an 'S'-shaped position angle curve that is superposed with orthogonal modes, from which geometry parameters are obtained. Individual pulses exhibit diverse profile morphology with single, double, or multiple peaks. The intensity and width of these pulses are highly correlated, and bright pulses generally have wide profiles with multiple peaks. These nulling behaviours, profile morphology, and polarization demonstrate that a rotating radio transient has the same physical origins as the normal pulsars.


title: Predicting Accurate Hot Spots in a More Than Ten-Thousand-Core GPU with a Million-Time Speedup over FEM Enabled by a Physics-based Learning Algorithm

abstract: The classical proper orthogonal decomposition (POD) with the Galerkin projection (GP) has been revised for chip-level thermal simulation of microprocessors with a large number of cores. An ensemble POD-GP methodology (EnPOD-GP) is introduced to significantly improve the training effectiveness and prediction accuracy by dividing a large number of heat sources into heat source blocks (HSBs) each of which may contains one or a very small number of heat sources. Although very accurate, efficient and robust to any power map, EnPOD-GP suffers from intensive training for microprocessors with an enormous number of cores. A local-domain EnPOD-GP model (LEnPOD-GP) is thus proposed to further minimize the training burden. LEnPOD-GP utilizes the concepts of local domain truncation and generic building blocks to reduce the massive training data. LEnPOD-GP has been demonstrated on thermal simulation of NVIDIA Tesla Volta GV100, a GPU with more than 13,000 cores including FP32, FP64, INT32, and Tensor Cores. Due to the domain truncation for LEnPOD-GP, the least square error (LSE) is degraded but is still as small as 1.6% over the entire space and below 1.4% in the device layer when using 4 modes per HSB. When only the maximum temperature of the entire GPU is of interest, LEnPOD-GP offers a computing speed 1.1 million times faster than the FEM with a maximum error near 1.2 degrees over the entire simulation time.