title: Impact-Aware Bimanual Catching of Large-Momentum Objects

abstract: This paper investigates one of the most challenging tasks in dynamic manipulation -- catching large-momentum moving objects. Beyond the realm of quasi-static manipulation, dealing with highly dynamic objects can significantly improve the robot's capability of interacting with its surrounding environment. Yet, the inevitable motion mismatch between the fast moving object and the approaching robot will result in large impulsive forces, which lead to the unstable contacts and irreversible damage to both the object and the robot. To address the above problems, we propose an online optimization framework to: 1) estimate and predict the linear and angular motion of the object; 2) search and select the optimal contact locations across every surface of the object to mitigate impact through sequential quadratic programming (SQP); 3) simultaneously optimize the end-effector motion, stiffness, and contact force for both robots using multi-mode trajectory optimization (MMTO); and 4) realise the impact-aware catching motion on the compliant robotic system based on indirect force controller. We validate the impulse distribution, contact selection, and impact-aware MMTO algorithms in simulation and demonstrate the benefits of the proposed framework in real-world experiments including catching large-momentum moving objects with well-defined motion, constrained motion and free-flying motion.


title: Machine learning for moduli space of genus two curves and an application to post-quantum cryptography

abstract: We use machine learning to study the locus ${\mathcal L}_n$ of genus two curves with $(n, n)$-split Jacobian. More precisely we design a transformer model which given values for the Igusa invariants determines if the corresponding genus two curve is in the locus ${\mathcal L}_n$, for $n=2, 3, 5, 7$. Such curves are important in isogeny based cryptography. During this study we discover that there are no rational points ${\mathfrak p} \in {\mathcal L}_n$ with weighted moduli height $\leq 2$ in any of ${\mathcal L}_2$, ${\mathcal L}_3$, and ${\mathcal L}_5$. This extends on previous work of the authors to use machine learning methods to study the moduli space of genus 2 algebraic curves.


title: Birational complexity and conic fibrations

abstract: Let $(X,B)$ be a log Calabi--Yau pair of dimension $n$, index one, and birational complexity $c$. We show that $(X,B)$ has a crepant birational model that admits a tower of Mori fiber spaces of which at least $n-c$ are conic fibrations. Motivated by the proof of the previous statement, we introduce new measures of the complexity of a log Calabi--Yau pair; the alteration complexity and the conic complexity. We characterize when these invariants are zero. Finally, we give applications of the tools of the main theorem to birational superrigidity, Fano hypersurfaces, dual complexes, Weil indices of Fano varieties, and klt singularities.


title: The pretty bad measurement

abstract: The quantum state discrimination problem has Alice sending a quantum state to Bob who wins if he correctly identifies the state. The pretty good measurement, also known as the square root measurement, performs pretty well at this task. We study the version of this problem where Bob tries to lose with the greatest probability possible (which is harder than it sounds). We define the pretty bad measurement which performs pretty well at this task, or in other words, pretty poorly for the original task. We show that both the pretty good measurement and the pretty bad measurement are always no worse than blind guessing at their respective tasks. As an application, we apply the pretty bad measurement to the quantum state anomaly detection problem and show how to avoid pretty bad qubits.


title: Convert laser light into single photons via interference

abstract: Laser light possesses perfect coherence, but cannot be attenuated to single photons via linear optics. An elegant route to convert laser light into single photons is based on photon blockade in a cavity with a single atom in the strong coupling regime. However, the single-photon purity achieved by this method remains relatively low. Here we propose an interference-based approach where laser light can be transformed into single photons by destructively interfering with a weak but super-bunched incoherent field emitted from a cavity coupling to a single quantum emitter. We demonstrate this idea by measuring the reflected light of a laser field which drives a double-sided optical microcavity containing a single artificial atom-quantum dot (QD) in the Purcell regime. The reflected light consists of a superposition of the driving field with the cavity output field. We achieve the second-order autocorrelation g2(0)=0.030+-0.002 and the two-photon interference visibility 94.3%+-0.2. By separating the coherent and incoherent fields in the reflected light, we observe that the incoherent field from the cavity exhibits super-bunching with g2(0)=41+-2 while the coherent field remains Poissonian statistics. By controlling the relative amplitude of coherent and incoherent fields, we verify that photon statistics of reflected light is tuneable from perfect anti-bunching to super-bunching in agreement with our predictions. Our results demonstrate photon statistics of light as a quantum interference phenomenon that a single QD can scatter two photons simultaneously at low driving fields in contrast to the common picture that a single two-level quantum emitter can only scatter (or absorb and emit) single photons. This work opens the door to tailoring photon statistics of laser light via cavity or waveguide quantum electrodynamics and interference.

categories: quant-ph cond-mat.mes-hall physics.atom-ph physics.optics


title: A Hybrid Approach To Aspect Based Sentiment Analysis Using Transfer Learning

abstract: Aspect-Based Sentiment Analysis (ABSA) aims to identify terms or multiword expressions (MWEs) on which sentiments are expressed and the sentiment polarities associated with them. The development of supervised models has been at the forefront of research in this area. However, training these models requires the availability of manually annotated datasets which is both expensive and time-consuming. Furthermore, the available annotated datasets are tailored to a specific domain, language, and text type. In this work, we address this notable challenge in current state-of-the-art ABSA research. We propose a hybrid approach for Aspect Based Sentiment Analysis using transfer learning. The approach focuses on generating weakly-supervised annotations by exploiting the strengths of both large language models (LLM) and traditional syntactic dependencies. We utilise syntactic dependency structures of sentences to complement the annotations generated by LLMs, as they may overlook domain-specific aspect terms. Extensive experimentation on multiple datasets is performed to demonstrate the efficacy of our hybrid method for the tasks of aspect term extraction and aspect sentiment classification. Keywords: Aspect Based Sentiment Analysis, Syntactic Parsing, large language model (LLM)


title: Decoding the visual attention of pathologists to reveal their level of expertise

abstract: We present a method for classifying the expertise of a pathologist based on how they allocated their attention during a cancer reading. We engage this decoding task by developing a novel method for predicting the attention of pathologists as they read whole-slide Images (WSIs) of prostate and make cancer grade classifications. Our ground truth measure of a pathologists' attention is the x, y and z (magnification) movement of their viewport as they navigated through WSIs during readings, and to date we have the attention behavior of 43 pathologists reading 123 WSIs. These data revealed that specialists have higher agreement in both their attention and cancer grades compared to general pathologists and residents, suggesting that sufficient information may exist in their attention behavior to classify their expertise level. To attempt this, we trained a transformer-based model to predict the visual attention heatmaps of resident, general, and specialist (GU) pathologists during Gleason grading. Based solely on a pathologist's attention during a reading, our model was able to predict their level of expertise with 75.3%, 56.1%, and 77.2% accuracy, respectively, better than chance and baseline models. Our model therefore enables a pathologist's expertise level to be easily and objectively evaluated, important for pathology training and competency assessment. Tools developed from our model could also be used to help pathology trainees learn how to read WSIs like an expert.


title: Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Models

abstract: Generative foundation AI models have recently shown great success in synthesizing natural signals with high perceptual quality using only textual prompts and conditioning signals to guide the generation process. This enables semantic communications at extremely low data rates in future wireless networks. In this paper, we develop a latency-aware semantic communications framework with pre-trained generative models. The transmitter performs multi-modal semantic decomposition on the input signal and transmits each semantic stream with the appropriate coding and communication schemes based on the intent. For the prompt, we adopt a re-transmission-based scheme to ensure reliable transmission, and for the other semantic modalities we use an adaptive modulation/coding scheme to achieve robustness to the changing wireless channel. Furthermore, we design a semantic and latency-aware scheme to allocate transmission power to different semantic modalities based on their importance subjected to semantic quality constraints. At the receiver, a pre-trained generative model synthesizes a high fidelity signal using the received multi-stream semantics. Simulation results demonstrate ultra-low-rate, low-latency, and channel-adaptive semantic communications.


title: Statistical Inference on Hierarchical Simultaneous Autoregressive Models with Missing Data

abstract: Efficient estimation methods for simultaneous autoregressive (SAR) models with missing data in the response variable have been well-developed in the literature. It is common practice to introduce a measurement error into SAR models. The measurement error serves to distinguish the noise component from the spatial process. However, the previous literature has not considered adding a measurement error to the SAR models with missing data. The maximum likelihood estimation for such models with large datasets is challenging and computationally expensive. This paper proposes two efficient likelihood-based estimation methods: the marginal maximum likelihood (ML) and expectation-maximisation (EM) algorithms for estimating SAR models with both measurement errors and missing data in the response variable. The spatial error model (SEM) and the spatial autoregressive model (SAM), two popular SAR model types, are considered. The missing data mechanism is assumed to follow missing at random (MAR). While naive calculation approaches lead to computational complexities of $O(n^3)$, where n is the total number of observations, our computational approaches for both the marginal ML and EM algorithms are designed to reduce the computational complexity. The performance of the proposed methods is investigated empirically using simulated and real datasets.


title: NS5-brane backgrounds and coset CFT partition functions

abstract: Worldsheet string theory is solvable for a variety of backgrounds involving Neveu-Schwarz fivebranes, in terms of gauged nonlinear sigma models on group manifolds. We compute the worldsheet torus partition function of these models, and propose gauging of null isometries as a unifying principle and conceptual framework for this large family of string backgrounds. In the process, we explain how partition functions of asymmetrically gauged Wess-Zumino-Witten models can be computed from the path integral, and organize and systematize various results scattered throughout the literature.


title: Diffusion-based Negative Sampling on Graphs for Link Prediction

abstract: Link prediction is a fundamental task for graph analysis with important applications on the Web, such as social network analysis and recommendation systems, etc. Modern graph link prediction methods often employ a contrastive approach to learn robust node representations, where negative sampling is pivotal. Typical negative sampling methods aim to retrieve hard examples based on either predefined heuristics or automatic adversarial approaches, which might be inflexible or difficult to control. Furthermore, in the context of link prediction, most previous methods sample negative nodes from existing substructures of the graph, missing out on potentially more optimal samples in the latent space. To address these issues, we investigate a novel strategy of multi-level negative sampling that enables negative node generation with flexible and controllable ``hardness'' levels from the latent space. Our method, called Conditional Diffusion-based Multi-level Negative Sampling (DMNS), leverages the Markov chain property of diffusion models to generate negative nodes in multiple levels of variable hardness and reconcile them for effective graph link prediction. We further demonstrate that DMNS follows the sub-linear positivity principle for robust negative sampling. Extensive experiments on several benchmark datasets demonstrate the effectiveness of DMNS.


title: On line arrangements with odd multiplicities

abstract: We give restrictions on the weak combinatorics of line arrangements with singular points of odd multiplicity using topological arguments on locally-flat spheres in 4-manifolds. As a corollary, we show that there is no line arrangement comprising 13 lines and with only triple points.


title: Distributed Simulation of Large Multi-body Systems

abstract: We present a technique designed for parallelizing large rigid body simulations, capable of exploiting multiple CPU cores within a computer and across a network. Our approach can be applied to simulate both unilateral and bilateral constraints, requiring straightforward modifications to the underlying physics engine. Starting from an approximate partitioning, we identify interface bodies and add them to overlapping sets such that they are simulated by multiple workers. At each timestep, we blend the states of overlap bodies using weights based on graph geodesic distances within the constraint graph. The use of overlap simulation also allows us to perform load balancing using efficient local evaluations of the constraint graph. We demonstrate our technique's scalability and load-balancing capabilities using several large-scale scenes.


title: Tian's stabilization problem for toric Fanos

abstract: In 1988, Tian posed the stabilization problem for equivariant global log canonical thresholds. We solve it in the case of toric Fano manifolds. This is the first general result on Tian's problem. A key new estimate involves expressing complex singularity exponents associated to orbits of a group action in terms of support and gauge functions from convex geometry. These techniques also yield a resolution of another conjecture of Tian from 2012 on more general thresholds associated to Grassmannians of plurianticanonical series.


title: Exact results for giant graviton four-point correlators

abstract: We study the four-point correlator $\langle \mathcal{O}_2 \mathcal{O}_2 \mathcal{D} \mathcal{D} \rangle$ in $\mathcal{N}=4$ super Yang-Mills theory (SYM) with $SU(N)$ gauge group, where $\mathcal{O}_2$ represents the superconformal primary operator with dimension two, while $\mathcal{D}$ denotes a determinant operator of dimension $N$, which is holographically dual to a giant graviton D3-brane extending along $S^5$. We analyse the integrated correlator associated with this observable, obtained after integrating out the spacetime dependence over a supersymmetric invariant measure. Similarly to other classes of integrated correlators in $\mathcal{N}=4$ SYM, this integrated correlator can be computed through supersymmetric localisation on the four-sphere. Employing matrix-model recursive techniques, we demonstrate that the integrated correlator can be reformulated as an infinite sum of protected three-point functions with known coefficients. This insight allows us to circumvent the complexity associated with the dimension-$N$ determinant operator, significantly streamlining the large-$N$ expansion of the integrated correlator. In the planar limit and beyond, we derive exact results for the integrated correlator valid for all values of the 't Hooft coupling, and investigate the resurgent properties of their strong coupling expansion. Additionally, in the large-$N$ expansion with fixed (complexified) Yang-Mills coupling, we deduce the $SL(2, \mathbb{Z})$ completion of these results in terms of the non-holomorphic Eisenstein series. The proposed modular functions are confirmed by explicit instanton calculations from the matrix model, and agree with expectations from the holographic dual picture of known results in type IIB string theory.


title: EXPLORA: A teacher-apprentice methodology for eliciting natural child-computer interactions

abstract: Investigating child-computer interactions within their contexts is vital for designing technology that caters to children's needs. However, determining what aspects of context are relevant for designing child-centric technology remains a challenge. We introduce EXPLORA, a multimodal, multistage online methodology comprising three pivotal stages: (1) building a teacher-apprentice relationship,(2) learning from child-teachers, and (3) assessing and reinforcing researcher-apprentice learning. Central to EXPLORA is the collection of attitudinal data through pre-observation interviews, offering researchers a deeper understanding of children's characteristics and contexts. This informs subsequent online observations, allowing researchers to focus on frequent interactions. Furthermore, researchers can validate preliminary assumptions with children. A means-ends analysis framework aids in the systematic analysis of data, shedding light on context, agency and homework-information searching processes children employ in their activities. To illustrate EXPLORA's capabilities, we present nine single case studies investigating Brazilian child-caregiver dyads' (children ages 9-11) use of technology in homework information-searching.


title: Cache-Enabled Millimetre-Wave Fluid Antenna Systems: Modeling and Performance

abstract: This letter investigates the performance of content caching in a heterogeneous cellular network (HetNet) consisting of fluid antenna system (FAS)-equipped mobile users (MUs) and millimeter-wave (mm-wave) single-antenna small base stations (SBSs), distributed according to the independent homogeneous Poisson point processes (HPPP). In particular, it is assumed that the most popular contents are cached in the SBSs to serve the FAS-equipped MUs requests. To assess the system performance, we derive compact expressions for the successful content delivery probability (SCDP) and the content delivery delay (CDD) using the Gauss-Laguerre quadrature technique. Our numerical results show that the performance of cache-enabled mm-wave HetNets can be greatly improved, when the FAS is utilized at the MUs instead of traditional fixed-antenna system deployment.


title: Exploring CausalWorld: Enhancing robotic manipulation via knowledge transfer and curriculum learning

abstract: This study explores a learning-based tri-finger robotic arm manipulating task, which requires complex movements and coordination among the fingers. By employing reinforcement learning, we train an agent to acquire the necessary skills for proficient manipulation. To enhance the efficiency and effectiveness of the learning process, two knowledge transfer strategies, fine-tuning and curriculum learning, were utilized within the soft actor-critic architecture. Fine-tuning allows the agent to leverage pre-trained knowledge and adapt it to new tasks. Several variations like model transfer, policy transfer, and across-task transfer were implemented and evaluated. To eliminate the need for pretraining, curriculum learning decomposes the advanced task into simpler, progressive stages, mirroring how humans learn. The number of learning stages, the context of the sub-tasks, and the transition timing were found to be the critical design parameters. The key factors of two learning strategies and corresponding effects were explored in context-aware and context-unaware scenarios, enabling us to identify the scenarios where the methods demonstrate optimal performance, derive conclusive insights, and contribute to a broader range of learning-based engineering applications.


title: Black hole mass estimate in OJ 287 based on the bulk-motion comptonization model

abstract: The multi-wavelength outburst activity in the BL Lacertae source OJ 287 has sparked a lot of controversy about whether the source contains one or two black holes (BHs) and what characteristics of this black hole binary would be. In this article we present the results of analysis of the X-ray flaring activity of OJ 287 using the data of Swift/XRT observations. We discovered that the energy spectra in all spectral states can be adequately fit with the XSPEC BMC model (the Comptonization one). As a result we found that the X-ray photon index of the BMC model, $\Gamma$ correlates with the mass accretion rate, $\dot M$. We found the photon index $\Gamma$ to increase monotonically with accretion rate $\dot M$ from $\Gamma\sim 2$ in the intermediate state (IS) to $\Gamma\sim2.5$ the high/soft state (HSS) with subsequent saturation at $\Gamma\sim$ 2.6 level at higher luminosities. This type of behavior of the spectral index is remarkably similar to the pattern observed in a number of established stellar-mass black hole candidates. Assuming the universality of the observed pattern of the correlation between the photon index and mass accretion rate, we estimate the BH mass in OJ 287 to be around $2\times10^8$ solar masses, using the well studied BH binaries GX 339-4 and XTE J1859-226 to calibrate the model.


title: Synthetic active liquid crystals powered by acoustic waves

abstract: Active nematics are materials composed of mobile, elongated particles that can transform energy from the environment into a mechanical motion. Current experimental realizations of the active nematics are of biological origin and include cell layers, suspensions of elongated bacteria in liquid crystal, and combinations of bio-filaments with molecular motors. Here, we report the realization of a fully synthetic active nematic system comprised of a lyotropic chromonic liquid crystal energized by ultrasonic waves. This artificial active liquid crystal is free from biological degradation and variability, exhibits stable material properties, and enables precise and rapid activity control over a significantly extended range. We demonstrate that the energy of the acoustic field is converted into microscopic extensile stresses disrupting long-range nematic order and giving rise to an undulation instability, development of active turbulence, and proliferation of topological defects. We reveal the emergence of unconventional free-standing persistent vortices in the nematic director field at high activity levels. The results provide a foundation for the design of externally energized active nematic fluids with stable material properties and tunable topological defects dynamics crucial for the realization of reconfigurable microfluidic systems.


title: Robust integration of fast flavor conversions in classical neutrino transport

abstract: The quantum kinetic evolution of neutrinos in dense environments, such as the core-collapse supernovae or the neutron star mergers, can result in fast flavor conversion (FFC), presenting a significant challenge to achieving robust astrophysical modeling of these systems. Recent works that directly simulate the quantum kinetic transport of neutrinos in localized domains have suggested that the asymptotic outcome of FFCs can be modeled by simple analytical prescriptions. In this Letter, we incorporate the analytical prescriptions into global simulations that solve the classical neutrino transport equation including collisions and advection under spherical symmetry. We demonstrate excellent agreement between results obtained using this approach and those directly from the corresponding global quantum kinetic simulations. In particular, this effective method can also precisely capture the collisional feedback effect for cases where the FFC happens inside the neutrinosphere. Our work highlights that a robust integration of FFCs in classical neutrino transport used in astrophysical simulation can be feasible.


title: Human Stress Response and Perceived Safety during Encounters with Quadruped Robots

abstract: Despite the rise of mobile robot deployments in home and work settings, perceived safety of users and bystanders is understudied in the human-robot interaction (HRI) literature. To address this, we present a study designed to identify elements of a human-robot encounter that correlate with observed stress response. Stress is a key component of perceived safety and is strongly associated with human physiological response. In this study a Boston Dynamics Spot and a Unitree Go1 navigate autonomously through a shared environment occupied by human participants wearing multimodal physiological sensors to track their electrocardiography (ECG) and electrodermal activity (EDA). The encounters are varied through several trials and participants self-rate their stress levels after each encounter. The study resulted in a multidimensional dataset archiving various objective and subjective aspects of a human-robot encounter, containing insights for understanding perceived safety in such encounters. To this end, acute stress responses were decoded from the human participants' ECG and EDA and compared across different human-robot encounter conditions. Statistical analysis of data indicate that on average (1) participants feel more stress during encounters compared to baselines, (2) participants feel more stress encountering multiple robots compared to a single robot and (3) participants stress increases during navigation behavior compared with search behavior.


title: Galaxy spin direction asymmetry in JWST deep fields

abstract: The unprecedented imaging power of JWST provides new abilities to observe the shapes of objects in the early Universe in a way that has not been possible before. Recently, JWST acquired a deep field image inside the same field imaged in the past as the HST Ultra Deep Field. Computer-based quantitative analysis of spiral galaxies in that field shows that among 34 galaxies for which their rotation of direction can be determined by the shapes of the arms, 24 rotate clockwise, and just 10 rotate counterclockwise. The one-tailed binomial distribution probability to have asymmetry equal or stronger than the observed asymmetry by chance is $\sim$0.012. While the analysis is limited by the small size of the data, the observed asymmetry is aligned with all relevant previous large-scale analyses from all premier digital sky surveys, all show a higher number of galaxies rotating clockwise in that part of the sky, and the magnitude of the asymmetry increases as the redshift gets higher. This paper also provides data and analysis to reproduce previous experiments suggesting that the distribution of galaxy rotation in the Universe is random, to show that the exact same data used in these studies in fact show non-random distribution, and in excellent agreement with the results shown here. These findings reinforce consideration of the possibility that the directions of rotation of spiral galaxies as observed from Earth are not necessarily randomly distributed. The explanation can be related to the large-scale structure of the Universe, but can also be related to a possible anomaly in the physics of galaxy rotation.


title: Optimal Operation of Reconfigurable Active Distribution Networks Aiming at Resiliency Improvement

abstract: As natural disasters bring about power outage and financial losses, network resiliency is an important challenge for distribution network operators (DNOs). On the other side, power loss reduction during normal operating condition is a major concern of DNOs. In this paper, optimal scheduling of active distribution network (ADN) is addressed through simultaneous minimization of power loss in normal condition and load shedding in critical condition after natural disasters. A new formulation is developed for the network reconfiguration to optimize the system operation in both normal and emergency conditions in the presence of conventional and renewable-energy-based distributed generation (DG) as well as energy storage systems (ESSs). The line flow based (LFB) algorithm is used for the AC power flow calculations, and all the developed relations have been convexified to construct a mixed-integer quadratically-constrained programming (MIQCP) optimization model. The simulations have been implemented on the IEEE 33-bus system in GAMS, and the results are investigated.


title: Exact block encoding of imaginary time evolution with universal quantum neural networks

abstract: We develop a constructive approach to generate quantum neural networks capable of representing the exact thermal states of all many-body qubit Hamiltonians. The Trotter expansion of the imaginary-time propagator is implemented through an exact block encoding by means of a unitary, restricted Boltzmann machine architecture. Marginalization over the hidden-layer neurons (auxiliary qubits) creates the non-unitary action on the visible layer. Then, we introduce a unitary deep Boltzmann machine architecture, in which the hidden-layer qubits are allowed to couple laterally to other hidden qubits. We prove that this wave function ansatz is closed under the action of the imaginary-time propagator and, more generally, can represent the action of a universal set of quantum gate operations. We provide analytic expressions for the coefficients for both architectures, thus enabling exact network representations of thermal states without stochastic optimization of the network parameters. In the limit of large imaginary time, the ansatz yields the ground state of the system. The number of qubits grows linearly with the system size and total imaginary time for a fixed interaction order. Both networks can be readily implemented on quantum hardware via mid-circuit measurements of auxiliary qubits. If only one auxiliary qubit is measured and reset, the circuit depth scales linearly with imaginary time and system size, while the width is constant. Alternatively, one can employ a number of auxiliary qubits linearly proportional to the system size, and circuit depth grows linearly with imaginary time only.


title: Worpitzky-compatible sets and the freeness of arrangements between Shi and Catalan

abstract: Given an irreducible root system, the Worpitzky-compatible subsets are defined by a geometric property of the alcoves inside the fundamental parallelepiped of the root system. This concept is motivated and mainly understood through a lattice point counting formula concerning the characteristic and Ehrhart quasi-polynomials. In this paper, we show that the Worpitzky-compatibility has a simple combinatorial characterization in terms of roots. As a byproduct, we obtain a complete characterization by means of Worpitzky-compatibility for the freeness of the arrangements interpolating between the extended Shi and Catalan arrangements. This is a completion of the earlier result by Yoshinaga in 2010 which was done for simply-laced root systems.


title: 200Gb/s VCSEL transmission using 60m OM4 MMF and KP4 FEC for AI computing clusters

abstract: We show a beyond 200Gb/s VCSEL transmission experiment. Results are based on 35GHz VCSEL and advanced DSP. We show an AIR of 245Gb/s PAM-6 back-to-back, and 200Gb/s PAM-4 over 60m OM4 fiber assuming KP4-FEC.


title: Teaming-up radio and submm-FIR observations to probe dusty star-forming galaxies

abstract: In this paper, we investigate the benefits of teaming up data from the radio to the far- 1 infrared (FIR) regime for the characterization of Dusty Star-Forming Galaxies (DSFGs). These galaxies 2 are thought to be the star-forming progenitors of local massive quiescent galaxies, and play a pivotal 3 role in the reconstruction of the cosmic star formation rate density up to high redshift. Due to their 4 dust-enshrouded nature, DSFGs are often invisible in the near-infrared/Optical/UV bands. Therefore, 5 they necessitate observations at longer wavelengths, primarily the FIR, where dust emission occurs, 6 and radio, which is not affected by dust absorption. Combining data from these two spectral windows 7 makes it possible to characterize even the dustiest objects, enabling the retrieval of information about 8 their age, dust temperature, and star-formation status, and facilitates the differentiation between 9 various galaxy populations that evolve throughout cosmic history. Despite the detection of faint radio 10 sources being a challenging task, this study demonstrates that an effective strategy to build statistically 11 relevant samples of DSFGs would be reaching deep sensitivities in the radio band, even restricted to 12 smaller areas, and then combining these radio observations with FIR/submm data. Additionally, 13 the paper quantifies the improvement in the Spectral Energy Distribution (SED) reconstruction of 14 DSFGs by incorporating ALMA band measurements, in particular, in its upgraded status thanks to 15 the anticipated Wideband Sensitivity Upgrade.


title: Relational Network Verification

abstract: Relational network verification is a new approach to validating network changes. In contrast to traditional network verification, which analyzes specifications for a single network snapshot, relational network verification analyzes specifications concerning two network snapshots (e.g., pre- and post-change snapshots) and captures their similarities and differences. Relational change specifications are compact and precise because they specify the flows or paths that change between snapshots and then simply mandate that other behaviors of the network "stay the same", without enumerating them. To achieve similar guarantees, single-snapshot specifications need to enumerate all flow and path behaviors that are not expected to change, so we can check that nothing has accidentally changed. Thus, precise single-snapshot specifications are proportional to network size, which makes them impractical to generate for many real-world networks. To demonstrate the value of relational reasoning, we develop a high-level relational specification language and a tool called Rela to validate network changes. Rela first compiles input specifications and network snapshot representations to finite state transducers. It then checks compliance using decision procedures for automaton equivalence. Our experiments using data on complex changes to a global backbone (with over 10^3 routers) find that Rela specifications need fewer than 10 terms for 93% of them and it validates 80% of them within 20 minutes.


title: A unimodular Kaluza-Klein theory

abstract: Unimodular gravity became an object of increasing interest in the late $80$-ties and was recently used in primordial Universe modeling with cosmological constant, in the context of the Brans-Dicke gravity including scalar field. In the present article we investigate the possibility of imposing the unimodular condition within the $5$-dimensional Kaluza-Klein theory including the scalar field. The variational principle is formulated in $5$ dimensions first, and dimensional reduction is applied to the resulting set of equations. A cosmological model based on these equations is then presented and discussed.


title: Stellar Spin Down in Post-Mass Transfer Binary Systems

abstract: Motivated by measurements of the rotation speed of accretor stars in post-mass-transfer (post-MT) systems, we investigate how magnetic braking affects the spin-down of individual stars during binary evolution with the MESAbinary module. Unlike the conventional assumption of tidal synchronization coupled with magnetic braking in binaries, we first calculate whether tides are strong enough to synchronize the orbit. Subsequently, this influences the spin-down of stars and the orbital separation. In this study, we apply four magnetic braking prescriptions to reduce the spin angular momentum of the two stars throughout the entire binary evolution simulation. Our findings reveal that despite magnetic braking causing continuous spin-down of the accretor, when the donor begins to transfer material onto the accretor, the accretor can rapidly spin up to its critical rotation rate. After MT, magnetic braking becomes more important in affecting the angular momentum evolution of the stars. Post-MT accretor stars thus serve as a valuable testbed for observing how the magnetic braking prescriptions operate in spinning down stars from their critical rotation, including the saturation regimes of the magnetic braking. The rotation rate of the accretor star, combined with its mass, could provide age information since the cessation of MT. By comparing the models against observation, the magnetic braking prescription by Garraffo et al. (2018b) is found to better align with the rotation data of post-MT accretors.


title: The flavor structures on magnetized orbifold models and 4D modular symmetric models

abstract: We study quark and lepton flavor structures on magnetized $T^2/\mathbb{Z}_2$ twisted orbifold model. There are 6,460 number of flavor models but most of them cannot lead to realistic flavor observables because of the difficulties on realizing mass hierarchies and small (large) mixing angles of quarks (leptons). We find that certain zero point patterns of zero-modes of fermions and Higgs fields give the flavor models being able to avoid these difficulties. We classify such flavor models and show numerical example. Next we study four-dimensional (4D) modular symmetric quark flavor models without fine-tuning. Mass matrices become hierarchical as close to the modular symmetric points depending on its residual charges. Actually the residual $Z_N$ symmetries with $N\geq 6$ can originate the large quark mass hierarchies. Also the products of residual symmetries such as $Z_3\times Z_3\times Z_3$ have such possibility. We study the quark flavor model with $\Gamma_6$ symmetry and $A_4\times A_4\times A_4$ symmetry. We assume the vicinity of the cusp $\tau=i\infty$ where residual $Z_6$ and $Z_3\times Z_3\times Z_3$ symmetry remain. Consequently we find the models realizing the order of the quark mass ratios and the absolute values of the Cabibbo-Kobayashi-Maskawa (CKM) matrix elements without fine-tuning. Finally we construct the Siegel modular forms. Zero-modes on $T^6$ at $\vec{z}=0$ are the Siegel modular forms of weight 1/2 for the subgroup of $Sp(6,\mathbb{Z})$. They have several moduli parameters and therefore have the possibility realizing the flavor structures including the CP phases. We study the Siegel modular forms transformed by $\widetilde{\Delta}(96)$ and show numerical example. We find one of moduli parameters $\omega_1$ works on the large mass hierarchies and $\omega_2$ works on the CP violation successfully in our model.


title: Automate Knowledge Concept Tagging on Math Questions with LLMs

abstract: Knowledge concept tagging for questions plays a crucial role in contemporary intelligent educational applications, including learning progress diagnosis, practice question recommendations, and course content organization. Traditionally, these annotations have been conducted manually with help from pedagogical experts, as the task requires not only a strong semantic understanding of both question stems and knowledge definitions but also deep insights into connecting question-solving logic with corresponding knowledge concepts. In this paper, we explore automating the tagging task using Large Language Models (LLMs), in response to the inability of prior manual methods to meet the rapidly growing demand for concept tagging in questions posed by advanced educational applications. Moreover, the zero/few-shot learning capability of LLMs makes them well-suited for application in educational scenarios, which often face challenges in collecting large-scale, expertise-annotated datasets. By conducting extensive experiments with a variety of representative LLMs, we demonstrate that LLMs are a promising tool for concept tagging in math questions. Furthermore, through case studies examining the results from different LLMs, we draw some empirical conclusions about the key factors for success in applying LLMs to the automatic concept tagging task.


title: D-inverse constellations

abstract: We give an algebraic characterisation of ordered groupoids, namely, we show that there is a categorical isomophism between the category of ordered groupoids and the category of $D$-inverse constellations. Here constellations are partial algebras in the sense that they possess a partial product, and a unary operation $D$. We consider constellations in which elements have a suitable notion of inverse, giving the notion of a D-inverse constellation.


title: Mesoscale Polymer Arrays: High Aspect Ratio Surface Structures and Their Digital Reconstruction

abstract: Inspired by adhesive bio-filamentous structure, such as bacterial pili, this work details the methods used to fabricate and characterize a surface-anchored array of thin, flexible and shape-responsive mesoscale polymer ribbons with a length-to-thickness aspect ratio of up to 100,000. The resulting structures exhibit geometrically complex and dynamic morphologies consistent with elastocapillary bending that experience an increase in curvature over hours of aging due to creep. We develop a computational image analysis framework to generate 3D reconstructions of these densely crowded geometries and extract quantitative descriptors to demonstrate morphological changes due to aging. We demonstrate the robustness of this quantitative method by characterizing the creep-induced change in an aging ribbon array's shape and develop a scaling relationship to describe the importance of ribbon thickness for shape and dynamical observations. These methods demonstrate an essential baseline to probe morphology-property relationships of mesoscale polymer ribbon arrays fabricated from a variety of materials in numerous environments. Through the introduction of perfluorodecalin droplets, we illustrate the potential of these ribbon arrays towards applications in adhesive, microrobotic, and biomedical devices.


title: Common Ground Tracking in Multimodal Dialogue

abstract: Within Dialogue Modeling research in AI and NLP, considerable attention has been spent on ``dialogue state tracking'' (DST), which is the ability to update the representations of the speaker's needs at each turn in the dialogue by taking into account the past dialogue moves and history. Less studied but just as important to dialogue modeling, however, is ``common ground tracking'' (CGT), which identifies the shared belief space held by all of the participants in a task-oriented dialogue: the task-relevant propositions all participants accept as true. In this paper we present a method for automatically identifying the current set of shared beliefs and ``questions under discussion'' (QUDs) of a group with a shared goal. We annotate a dataset of multimodal interactions in a shared physical space with speech transcriptions, prosodic features, gestures, actions, and facets of collaboration, and operationalize these features for use in a deep neural model to predict moves toward construction of common ground. Model outputs cascade into a set of formal closure rules derived from situated evidence and belief axioms and update operations. We empirically assess the contribution of each feature type toward successful construction of common ground relative to ground truth, establishing a benchmark in this novel, challenging task.


title: An Analysis of Switchback Designs in Reinforcement Learning

abstract: This paper offers a detailed investigation of switchback designs in A/B testing, which alternate between baseline and new policies over time. Our aim is to thoroughly evaluate the effects of these designs on the accuracy of their resulting average treatment effect (ATE) estimators. We propose a novel "weak signal analysis" framework, which substantially simplifies the calculations of the mean squared errors (MSEs) of these ATEs in Markov decision process environments. Our findings suggest that (i) when the majority of reward errors are positively correlated, the switchback design is more efficient than the alternating-day design which switches policies in a daily basis. Additionally, increasing the frequency of policy switches tends to reduce the MSE of the ATE estimator. (ii) When the errors are uncorrelated, however, all these designs become asymptotically equivalent. (iii) In cases where the majority of errors are negative correlated, the alternating-day design becomes the optimal choice. These insights are crucial, offering guidelines for practitioners on designing experiments in A/B testing. Our analysis accommodates a variety of policy value estimators, including model-based estimators, least squares temporal difference learning estimators, and double reinforcement learning estimators, thereby offering a comprehensive understanding of optimal design strategies for policy evaluation in reinforcement learning.


title: Cognitively Biased Users Interacting with Algorithmically Biased Results in Whole-Session Search on Debated Topics

abstract: When interacting with information retrieval (IR) systems, users, affected by confirmation biases, tend to select search results that confirm their existing beliefs on socially significant contentious issues. To understand the judgments and attitude changes of users searching online, our study examined how cognitively biased users interact with algorithmically biased search engine result pages (SERPs). We designed three-query search sessions on debated topics under various bias conditions. We recruited 1,321 crowdsourcing participants and explored their attitude changes, search interactions, and the effects of confirmation bias. Three key findings emerged: 1) most attitude changes occur in the initial query of a search session; 2) Confirmation bias and result presentation on SERPs affect the number and depth of clicks in the current query and perceived familiarity with clicked results in subsequent queries; 3) The bias position also affects attitude changes of users with lower perceived openness to conflicting opinions. Our study goes beyond traditional simulation-based evaluation settings and simulated rational users, sheds light on the mixed effects of human biases and algorithmic biases in information retrieval tasks on debated topics, and can inform the design of bias-aware user models, human-centered bias mitigation techniques, and socially responsible intelligent IR systems.


title: Not All Federated Learning Algorithms Are Created Equal: A Performance Evaluation Study

abstract: Federated Learning (FL) emerged as a practical approach to training a model from decentralized data. The proliferation of FL led to the development of numerous FL algorithms and mechanisms. Many prior efforts have given their primary focus on accuracy of those approaches, but there exists little understanding of other aspects such as computational overheads, performance and training stability, etc. To bridge this gap, we conduct extensive performance evaluation on several canonical FL algorithms (FedAvg, FedProx, FedYogi, FedAdam, SCAFFOLD, and FedDyn) by leveraging an open-source federated learning framework called Flame. Our comprehensive measurement study reveals that no single algorithm works best across different performance metrics. A few key observations are: (1) While some state-of-the-art algorithms achieve higher accuracy than others, they incur either higher computation overheads (FedDyn) or communication overheads (SCAFFOLD). (2) Recent algorithms present smaller standard deviation in accuracy across clients than FedAvg, indicating that the advanced algorithms' performances are stable. (3) However, algorithms such as FedDyn and SCAFFOLD are more prone to catastrophic failures without the support of additional techniques such as gradient clipping. We hope that our empirical study can help the community to build best practices in evaluating FL algorithms.


title: Sparse-Graph-Enabled Formation Planning for Large-Scale Aerial Swarms

abstract: The formation trajectory planning using complete graphs to model collaborative constraints becomes computationally intractable as the number of drones increases due to the curse of dimensionality. To tackle this issue, this paper presents a sparse graph construction method for formation planning to realize better efficiency-performance trade-off. Firstly, a sparsification mechanism for complete graphs is designed to ensure the global rigidity of sparsified graphs, which is a necessary condition for uniquely corresponding to a geometric shape. Secondly, a good sparse graph is constructed to preserve the main structural feature of complete graphs sufficiently. Since the graph-based formation constraint is described by Laplacian matrix, the sparse graph construction problem is equivalent to submatrix selection, which has combinatorial time complexity and needs a scoring metric. Via comparative simulations, the Max-Trace matrix-revealing metric shows the promising performance. The sparse graph is integrated into the formation planning. Simulation results with 72 drones in complex environments demonstrate that when preserving 30\% connection edges, our method has comparative formation error and recovery performance w.r.t. complete graphs. Meanwhile, the planning efficiency is improved by approximate an order of magnitude. Benchmark comparisons and ablation studies are conducted to fully validate the merits of our method.


title: Linear Numerical Schemes for a $\textbf{Q}$-Tensor System for Nematic Liquid Crystals

abstract: In this work, we present three linear numerical schemes to model nematic liquid crystals using the Landau-de Gennes $\textbf{Q}$-tensor theory. The first scheme is based on using a truncation procedure of the energy, which allows for an unconditionally energy stable first order accurate decoupled scheme. The second scheme uses a modified second order accurate optimal dissipation algorithm, which gives a second order accurate coupled scheme. Finally, the third scheme uses a new idea to decouple the unknowns from the second scheme which allows us to obtain accurate dynamics while improving computational efficiency. We present several numerical experiments to offer a comparative study of the accuracy, efficiency and the ability of the numerical schemes to represent realistic dynamics.


title: A Conjecture on Rainbow Hamiltonian Cycle Decomposition

abstract: Wu in 1999 conjectured that if $H$ is a subgraph of the complete graph $K_{2n+1}$ with $n$ edges, then there is a Hamiltonian cycle decomposition of $K_{2n+1}$ such that each edge of $H$ is in a separate Hamiltonian cycle. The conjecture was partially settled by Liu and Chen (2023) in cases that $|V(H)|\leq n+1$, $H$ is a linear forest, or $n\leq 5$. In this paper, we settle the conjecture completely. This result can be viewed as a complete graph analogous of Evans conjecture and has some applications in linear arboricity conjecture and restricted size Ramsey numbers.


title: Probabilistic Generation of Finite Almost Simple Groups

abstract: We prove that if G is a sufficiently large finite almost simple group of Lie type, then given a fixed nontrivial element x in G and a coset of G modulo its socle, the probability that x and a random element of the coset generate a subgroup containing the socle is uniformly bounded away from 0 (and goes to 1 if the field size goes to infinity). This is new even if G is simple. Together with results of Lucchini and Burness--Guralnick--Harper, this proves a conjecture of Lucchini and has an application to profinite groups. A key step in the proof is the determination of the limits for the proportion of elements in a classical group which fix no subspace of any bounded dimension.


title: G\'en\'eralisation du Th\'eor\`eme de Zeckendorf

abstract: We consist of first presenting Zeckendorf Theorem with these two versions Fibonacci and Luca. In this document we obtain results on the generalized of the Zeckendorf theorem for Fibonacci numbers (multibonacci). Such results find applications in coding theory.


title: Tracing and segmentation of molecular patterns in 3-dimensional cryo-et/em density maps through algorithmic image processing and deep learning-based techniques

abstract: Understanding the structures of biological macromolecules is highly important as they are closely associated with cellular functionalities. Comprehending the precise organization actin filaments is crucial because they form the dynamic cytoskeleton, which offers structural support to cells and connects the cell's interior with its surroundings. However, determining the precise organization of actin filaments is challenging due to the poor quality of cryo-electron tomography (cryo-ET) images, which suffer from low signal-to-noise (SNR) ratios and the presence of missing wedge, as well as diverse shape characteristics of actin filaments. To address these formidable challenges, the primary component of this dissertation focuses on developing sophisticated computational techniques for tracing actin filaments. In particular, three novel methodologies have been developed: i) BundleTrac, for tracing bundle-like actin filaments found in Stereocilium, ii) Spaghetti Tracer, for tracing filaments that move individually with loosely cohesive movements, and iii) Struwwel Tracer, for tracing randomly orientated actin filaments in the actin network. The second component of the dissertation introduces a convolutional neural network (CNN) based segmentation model to determine the location of protein secondary structures, such as helices and beta-sheets, in medium-resolution (5-10 Angstrom) 3-dimensional cryo-electron microscopy (cryo-EM) images. This methodology later evolved into a tool named DeepSSETracer. The final component of the dissertation presents a novel algorithm, cylindrical fit measure, to estimate image structure match at helix regions in medium-resolution cryo-EM images. Overall, my dissertation has made significant contributions to addressing critical research challenges in structural biology by introducing various computational methods and tools.


title: Maximum A Posteriori Ly-alpha Estimator (MAPLE): Band-power and covariance estimation of the 3D Ly-alpha forest power spectrum

abstract: We present a novel maximum a posteriori estimator to jointly estimate band-powers and the covariance of the three-dimensional power spectrum (P3D) of Lyman-alpha forest flux fluctuations, called MAPLE. Our Wiener-filter based algorithm reconstructs a window-deconvolved P3D in the presence of complex survey geometries typical for Lyman-alpha surveys that are sparsely sampled transverse to and densely sampled along the line-of-sight. We demonstrate our method on idealized Gaussian random fields with two selection functions: (i) a sparse sampling of 30 background sources per square degree designed to emulate the currently observing the Dark Energy Spectroscopic Instrument (DESI); (ii) a dense sampling of 900 background sources per square degree emulating the upcoming Prime Focus Spectrograph Galaxy Evolution Survey. Our proof-of-principle shows promise, especially since the algorithm can be extended to marginalize jointly over nuisance parameters and contaminants, i.e.offsets introduced by continuum fitting. Our code is implemented in JAX and is publicly available on GitHub.


title: Vortex Fiber Nulling for Exoplanet Observations: First Direct Detection of M Dwarf Companions around HIP 21543, HIP 94666, and HIP 50319

abstract: Vortex fiber nulling (VFN) is a technique for detecting and characterizing faint companions at small separations from their host star. A near-infrared ($\sim2.3 \mu$m) VFN demonstrator mode was deployed on the Keck Planet Imager and Characterizer (KPIC) instrument at the Keck Observatory and presented earlier. In this paper, we present the first VFN companion detections. Three targets, HIP 21543 Ab, HIP 94666 Ab, and HIP 50319 B, were detected with host-companion flux ratios between 70 and 430 at and within one diffraction beamwidth ($\lambda/D$). We complement the spectra from KPIC VFN with flux ratio and position measurements from the CHARA Array to validate the VFN results and provide a more complete characterization of the targets. This paper reports the first direct detection of these three M dwarf companions, yielding their first spectra and flux ratios. Our observations provide measurements of bulk properties such as effective temperatures, radial velocities, and v$\sin{i}$, and verify the accuracy of the published orbits. These detections corroborate earlier predictions of the KPIC VFN performance, demonstrating that the instrument mode is ready for science observations.


title: Hawk: Accurate and Fast Privacy-Preserving Machine Learning Using Secure Lookup Table Computation

abstract: Training machine learning models on data from multiple entities without direct data sharing can unlock applications otherwise hindered by business, legal, or ethical constraints. In this work, we design and implement new privacy-preserving machine learning protocols for logistic regression and neural network models. We adopt a two-server model where data owners secret-share their data between two servers that train and evaluate the model on the joint data. A significant source of inefficiency and inaccuracy in existing methods arises from using Yao's garbled circuits to compute non-linear activation functions. We propose new methods for computing non-linear functions based on secret-shared lookup tables, offering both computational efficiency and improved accuracy. Beyond introducing leakage-free techniques, we initiate the exploration of relaxed security measures for privacy-preserving machine learning. Instead of claiming that the servers gain no knowledge during the computation, we contend that while some information is revealed about access patterns to lookup tables, it maintains epsilon-dX-privacy. Leveraging this relaxation significantly reduces the computational resources needed for training. We present new cryptographic protocols tailored to this relaxed security paradigm and define and analyze the leakage. Our evaluations show that our logistic regression protocol is up to 9x faster, and the neural network training is up to 688x faster than SecureML. Notably, our neural network achieves an accuracy of 96.6% on MNIST in 15 epochs, outperforming prior benchmarks that capped at 93.4% using the same architecture.


title: InternLM2 Technical Report

abstract: The evolution of Large Language Models (LLMs) like ChatGPT and GPT-4 has sparked discussions on the advent of Artificial General Intelligence (AGI). However, replicating such advancements in open-source models has been challenging. This paper introduces InternLM2, an open-source LLM that outperforms its predecessors in comprehensive evaluations across 6 dimensions and 30 benchmarks, long-context modeling, and open-ended subjective evaluations through innovative pre-training and optimization techniques. The pre-training process of InternLM2 is meticulously detailed, highlighting the preparation of diverse data types including text, code, and long-context data. InternLM2 efficiently captures long-term dependencies, initially trained on 4k tokens before advancing to 32k tokens in pre-training and fine-tuning stages, exhibiting remarkable performance on the 200k ``Needle-in-a-Haystack" test. InternLM2 is further aligned using Supervised Fine-Tuning (SFT) and a novel Conditional Online Reinforcement Learning from Human Feedback (COOL RLHF) strategy that addresses conflicting human preferences and reward hacking. By releasing InternLM2 models in different training stages and model sizes, we provide the community with insights into the model's evolution.


title: Utilizing (Al, Ga)2O3/Ga2O3 superlattices to measure cation vacancy diffusion and vacancy-concentration-dependent diffusion of Al, Sn, and Fe in \b{eta} -Ga2O3

abstract: Diffusion of native defects such as vacancies and their interactions with impurities are fundamental in semiconductor crystal growth, device processing, and long-term aging of equilibration and transient diffusion of vacancies are rarely investigated. We used aluminum-gallium oxide/gallium oxide superlattices (SLs) to detect and analyze transient diffusion of cation vacancies during annealing in O2 at 1000-1100 C. Using a novel finite difference scheme for the diffusion equation with time- and space-varying diffusion constant, we extract diffusion constants for Al, Fe, and cation vacancies under the given conditions, including the vacancy concentration dependence for Al. indicate that vacancies present in the substrate transiently diffuse through the SLs, interacting with Sn as it also diffuses. In the case of SLs grown on Sn-doped beta-gallium oxide substrates, gradients observed in the extent of Al diffusion indicate that vacancies present in the substrate transiently diffuse through the SLs, interacting with Sn as it also diffuses. In the case of SLs grown on (010) Fe-doped substrates, the Al diffusion is uniform through the SLs, indicating a depth-uniform concentration of vacancies. We find no evidence in either case for the introduction of gallium vacancies from the free surface at rates sufficient to affect Al diffusion down to ppm concentrations, which has important bearing on the validity of typically-made assumptions of vacancy equilibration. Additionally, we show that unintentional impurities in Sn-doped gallium oxide such as Fe, Ni, Mn, Cu, and Li also diffuse towards the surface and accumulate. Many of these likely have fast interstitial diffusion modes capable of destabilizing devices over time, thus highlighting the importance of controlling unintentional impurities in beta-gallium oxide wafers.


title: Decoding Probing: Revealing Internal Linguistic Structures in Neural Language Models using Minimal Pairs

abstract: Inspired by cognitive neuroscience studies, we introduce a novel `decoding probing' method that uses minimal pairs benchmark (BLiMP) to probe internal linguistic characteristics in neural language models layer by layer. By treating the language model as the `brain' and its representations as `neural activations', we decode grammaticality labels of minimal pairs from the intermediate layers' representations. This approach reveals: 1) Self-supervised language models capture abstract linguistic structures in intermediate layers that GloVe and RNN language models cannot learn. 2) Information about syntactic grammaticality is robustly captured through the first third layers of GPT-2 and also distributed in later layers. As sentence complexity increases, more layers are required for learning grammatical capabilities. 3) Morphological and semantics/syntax interface-related features are harder to capture than syntax. 4) For Transformer-based models, both embeddings and attentions capture grammatical features but show distinct patterns. Different attention heads exhibit similar tendencies toward various linguistic phenomena, but with varied contributions.


title: Suzaku observation of an iron K-shell line in the spiral galaxy NGC 6946

abstract: An emission line at ~6.7 keV is attributable to a He-like iron K-shell transition, which indicates existence of a thin thermal plasma with a temperature of several keV. Using Suzaku archival data, we searched for the iron K-line from the spiral galaxy NGC 6946, and found the iron K-line at 6.68+/-0.07 keV at the 3.1 sigma level in the central r<2.'5 region. The iron line luminosity from the central region was estimated to be (2.3+/-1.2)x10^{37} erg s^{-1} at a distance of 5.5 Mpc. The origin of the iron emission line is discussed.


title: Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Driving

abstract: Deep learning-based monocular depth estimation (MDE), extensively applied in autonomous driving, is known to be vulnerable to adversarial attacks. Previous physical attacks against MDE models rely on 2D adversarial patches, so they only affect a small, localized region in the MDE map but fail under various viewpoints. To address these limitations, we propose 3D Depth Fool (3D$^2$Fool), the first 3D texture-based adversarial attack against MDE models. 3D$^2$Fool is specifically optimized to generate 3D adversarial textures agnostic to model types of vehicles and to have improved robustness in bad weather conditions, such as rain and fog. Experimental results validate the superior performance of our 3D$^2$Fool across various scenarios, including vehicles, MDE models, weather conditions, and viewpoints. Real-world experiments with printed 3D textures on physical vehicle models further demonstrate that our 3D$^2$Fool can cause an MDE error of over 10 meters.


title: So Long Sucker: Endgame Analysis

abstract: So Long Sucker is a strategy board game requiring 4 players, each with $c$ chips of their designated color, and a board made of $k$ empty piles. With a clear set-up come intricate rules, such as: players taking turns but not in a fixed order, agreements between some players being made and broken at any time, and a player winning the game even without any chips in hand. One of the main points of interest in studying this game, is finding when a player has a winning strategy. The game begins with four players that get eliminated successively until the winner is left. To study winning strategies, it is of interest to look at endgame situations. We present the following game set-up: there are two players left in the game, Blue and Red, and only their respective chip colors. In this paper, we characterize Blue's winning situations and strategies through inductive reasoning.


title: Two Birds with One Stone: Differential Privacy by Low-power SRAM Memory

abstract: The software-based implementation of differential privacy mechanisms has been shown to be neither friendly for lightweight devices nor secure against side-channel attacks. In this work, we aim to develop a hardware-based technique to achieve differential privacy by design. In contrary to the conventional software-based noise generation and injection process, our design realizes local differential privacy (LDP) by harnessing the inherent hardware noise into controlled LDP noise when data is stored in the memory. Specifically, the noise is tamed through a novel memory design and power downscaling technique, which leads to double-faceted gains in privacy and power efficiency. A well-round study that consists of theoretical design and analysis and chip implementation and experiments is presented. The results confirm that the developed technique is differentially private, saves 88.58% system power, speeds up software-based DP mechanisms by more than 10^6 times, while only incurring 2.46% chip overhead and 7.81% estimation errors in data recovery.


title: Alfv\'en Waves at Mars

abstract: The solar wind upstream of Mars's bow shock can be described in terms of Alfv\'enic turbulence, with an incompressible energy cascade rate of $10^{-17}$ J m$^{-3}$ s$^{-1}$ at magnetohydrodynamics (MHD) scales. The solar wind has more Alfv\'en waves propagating outwards from the Sun (than inwards) and a median Alfv\'en ratio of $\sim0.33$. Newly ionized planetary protons associated with the extended hydrogen corona generate waves at the local proton cyclotron frequency. These 'proton cyclotron waves' (PCW) mostly correspond to fast magnetosonic waves, although the ion cyclotron (Alfv\'enic) wave mode is possible for large Interplanetary Magnetic Field cone angles. PCW do not show significant effects on the solar wind energy cascade rates at MHD scales but could affect smaller scales. The magnetosheath displays high amplitude wave activity, with high occurrence rate of Alfv\'en waves. Turbulence appears not fully developed in the magnetosheath, suggesting fluctuations do not have enough time to interact in this small-size region. Some studies suggest PCW affect turbulence in the magnetosheath. Overall, wave activity is reduced inside the magnetic pile-up region and the Martian ionosphere. However, under certain conditions, upstream waves can reach the upper ionosphere. So far, there have not been conclusive observations of Alfv\'en waves in the ionosphere or along crustal magnetic fields, which could be due to the lack of adequate observations.


title: The Brenier-Schr\"odinger problem with respect to Feller semimartingales and non-local Hamilton-Jacobi-Bellman equations

abstract: Motivated by a problem from incompressible fluid mechanics of Brenier (JAMS 1989), and its recent entropic relaxation by Arnaudo, Cruizero, L\'eonard & Zambrini (AIHP PS 2020), we study a problem of entropic minimization on the path space when the reference measure is a generic Feller semimartingale. We show that, under some regularity condition, our problem connects naturally with a, possibly non-local, version of the Hamilton-Jacobi-Bellman equation. Additionally, we study existence of minimizers when the reference measure in a Ornstein-Uhlenbeck process.


title: Visual Hallucination: Definition, Quantification, and Prescriptive Remediations

abstract: The troubling rise of hallucination presents perhaps the most significant impediment to the advancement of responsible AI. In recent times, considerable research has focused on detecting and mitigating hallucination in Large Language Models (LLMs). However, it's worth noting that hallucination is also quite prevalent in Vision-Language models (VLMs). In this paper, we offer a fine-grained discourse on profiling VLM hallucination based on two tasks: i) image captioning, and ii) Visual Question Answering (VQA). We delineate eight fine-grained orientations of visual hallucination: i) Contextual Guessing, ii) Identity Incongruity, iii) Geographical Erratum, iv) Visual Illusion, v) Gender Anomaly, vi) VLM as Classifier, vii) Wrong Reading, and viii) Numeric Discrepancy. We curate Visual HallucInation eLiciTation (VHILT), a publicly available dataset comprising 2,000 samples generated using eight VLMs across two tasks of captioning and VQA along with human annotations for the categories as mentioned earlier.


title: HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification

abstract: Existing self-supervised methods in natural language processing (NLP), especially hierarchical text classification (HTC), mainly focus on self-supervised contrastive learning, extremely relying on human-designed augmentation rules to generate contrastive samples, which can potentially corrupt or distort the original information. In this paper, we tend to investigate the feasibility of a contrastive learning scheme in which the semantic and syntactic information inherent in the input sample is adequately reserved in the contrastive samples and fused during the learning process. Specifically, we propose an information lossless contrastive learning strategy for HTC, namely \textbf{H}ierarchy-aware \textbf{I}nformation \textbf{L}ossless contrastive \textbf{L}earning (HILL), which consists of a text encoder representing the input document, and a structure encoder directly generating the positive sample. The structure encoder takes the document embedding as input, extracts the essential syntactic information inherent in the label hierarchy with the principle of structural entropy minimization, and injects the syntactic information into the text representation via hierarchical representation learning. Experiments on three common datasets are conducted to verify the superiority of HILL.


title: Neural Multimodal Topic Modeling: A Comprehensive Evaluation

abstract: Neural topic models can successfully find coherent and diverse topics in textual data. However, they are limited in dealing with multimodal datasets (e.g., images and text). This paper presents the first systematic and comprehensive evaluation of multimodal topic modeling of documents containing both text and images. In the process, we propose two novel topic modeling solutions and two novel evaluation metrics. Overall, our evaluation on an unprecedented rich and diverse collection of datasets indicates that both of our models generate coherent and diverse topics. Nevertheless, the extent to which one method outperforms the other depends on the metrics and dataset combinations, which suggests further exploration of hybrid solutions in the future. Notably, our succinct human evaluation aligns with the outcomes determined by our proposed metrics. This alignment not only reinforces the credibility of our metrics but also highlights the potential for their application in guiding future multimodal topic modeling endeavors.


title: Tensor network renormalization approach to antiferromagnetic 6-state clock model on the Union Jack lattice

abstract: Using the nuclear norm regularization techniques on tensor network renormalization algorithm, we study the phase diagram, the critical behavior and the duality property of the antiferromagnetic 6-state clock model on the Union Jack lattice. We find that this model undergoes multiple phase transitions; there is the Berezinskii-Kosterlitz-Thouless, $Z_{6}$ symmetry breaking and chiral transition with decreasing temperature. Furthermore, we provide convincing numerical evidence that its quasi-long range order is well explained by the compactified boson conformal field theory (CFT) and the chiral transition is in perfect agreement with the Ising CFT, including central charge, scaling dimension spectrum, and operator product expansion coefficients.


title: Raman peak shift and broadening in crystalline nanoparticles with lattice impurities

abstract: The effect of point-like lattice impurities on nanoparticle Raman spectra (RS) is studied using both numerical and analytical methods. Particular cases of replacement atoms of various masses, vacancies, and disorder in interatomic bonds are considered. It is shown that the disorder leads not only to the broadening of optical phonon lines but also to the shift of the corresponding Raman peak. The latter can be either positive (i.e., blueshift) or negative (redshift) depending on the type of impurities. Thus there is an additional contribution to the well-known redshift that occurs due to the size-quantization (confinement) effect. Considering nanometer-sized diamond particles as a representative example, we show that the broadening and the shift are, as a rule, of the same order of magnitude. The results are discussed in the framework of the self-consistent T-matrix approach. It is argued that both effects should be considered for accurate treatment of experimental Raman spectra. Simple recipes to do so are formulated for several important cases including NV centers in nanodiamonds.


title: Uniqueness and convergence of resistance forms on unconstrained Sierpinski carpets

abstract: We prove the uniqueness of self-similar $D_4$-symmetric resistance forms on unconstrained Sierpinski carpets ($\mathcal{USC}$'s). Moreover, on a sequence of $\mathcal{USC}$'s $K_n, n\geq 1$ converging in Hausdorff metric, we show that the associated diffusion processes converge in distribution if and only if the geodesic metrics on $K_n, n\geq 1$ are equicontinuous with respect to the Euclidean metric.


title: ALISA: Accelerating Large Language Model Inference via Sparsity-Aware KV Caching

abstract: The Transformer architecture has significantly advanced natural language processing (NLP) and has been foundational in developing large language models (LLMs) such as LLaMA and OPT, which have come to dominate a broad range of NLP tasks. Despite their superior accuracy, LLMs present unique challenges in practical inference, concerning the compute and memory-intensive nature. Thanks to the autoregressive characteristic of LLM inference, KV caching for the attention layers in Transformers can effectively accelerate LLM inference by substituting quadratic-complexity computation with linear-complexity memory accesses. Yet, this approach requires increasing memory as demand grows for processing longer sequences. The overhead leads to reduced throughput due to I/O bottlenecks and even out-of-memory errors, particularly on resource-constrained systems like a single commodity GPU. In this paper, we propose ALISA, a novel algorithm-system co-design solution to address the challenges imposed by KV caching. On the algorithm level, ALISA prioritizes tokens that are most important in generating a new token via a Sparse Window Attention (SWA) algorithm. SWA introduces high sparsity in attention layers and reduces the memory footprint of KV caching at negligible accuracy loss. On the system level, ALISA employs three-phase token-level dynamical scheduling and optimizes the trade-off between caching and recomputation, thus maximizing the overall performance in resource-constrained systems. In a single GPU-CPU system, we demonstrate that under varying workloads, ALISA improves the throughput of baseline systems such as FlexGen and vLLM by up to 3X and 1.9X, respectively.


title: The Physical Origin of the Mass-Size Relation and Its Scatter of Disk Galaxies

abstract: Utilizing a kinematic decomposition of simulated galaxies, we focus on galaxies with tiny kinematically inferred stellar halos, indicative of weak external influences. We investigate the intricate interplay between internal (natural) and external (nurture) processes in shaping the scaling relationships of specific angular momentum ($j_\star$), stellar mass ($M_\star$), and size of disk galaxies within the IllustrisTNG simulation. The correlation among mass, size, and angular momentum of galaxies is examined by comparing simulations with observations and the theoretical predictions of the exponential hypothesis. Galaxies with tiny stellar halos exhibit a large scatter in the $j_\star$-$M_\star$ relation, which suggests that it is inherently present in their initial conditions. The analysis reveals that the disks of these galaxies adhere to the exponential hypothesis, resulting in a tight fiducial $j_\star$-$M_\star$-scale length (size) relation that is qualitatively consistent with observations. The inherent scatter in $j_\star$ provides a robust explanation for the mass-size relation and its substantial variability. Notably, galaxies that are moderately influenced by external processes closely adhere to a scaling relation akin to that of galaxies with tiny stellar halos. This result underscores the dominant role of internal processes in shaping the overall $j_\star$-$M_\star$ and mass-size relation, with external effects playing a relatively minor role in disk galaxies. Furthermore, the correlation between galaxy size and the virial radius of the dark matter halo exists but fails to provide strong evidence of the connection between galaxies and their parent dark matter halos.


title: Project MOSLA: Recording Every Moment of Second Language Acquisition

abstract: Second language acquisition (SLA) is a complex and dynamic process. Many SLA studies that have attempted to record and analyze this process have typically focused on a single modality (e.g., textual output of learners), covered only a short period of time, and/or lacked control (e.g., failed to capture every aspect of the learning process). In Project MOSLA (Moments of Second Language Acquisition), we have created a longitudinal, multimodal, multilingual, and controlled dataset by inviting participants to learn one of three target languages (Arabic, Spanish, and Chinese) from scratch over a span of two years, exclusively through online instruction, and recording every lesson using Zoom. The dataset is semi-automatically annotated with speaker/language IDs and transcripts by both human annotators and fine-tuned state-of-the-art speech models. Our experiments reveal linguistic insights into learners' proficiency development over time, as well as the potential for automatically detecting the areas of focus on the screen purely from the unannotated multimodal data. Our dataset is freely available for research purposes and can serve as a valuable resource for a wide range of applications, including but not limited to SLA, proficiency assessment, language and speech processing, pedagogy, and multimodal learning analytics.


title: Arithmetic properties of multiplier polynomials for certain polynomial maps

abstract: We investigate the arithmetic properties of the multiplier polynomials for certain $1$-parameter families of polynomials. In particular, we prove integrality theorems of multiplier polynomials for $z^d+c$, $(z-c)z^d + c$ and $z^{d+1}+cz$. As a corollary, we obtain the uniform upper bound of the naive height of parabolic parameters of unicritical polynomials. Moreover, we determined the quadratic parabolic parameters for $z^2 + c$. We also conditionally list parabolic parameters for $z^2 + c$ of fixed degrees.


title: Recent advances on the spherical metal oxides for sustainable degradation of antibiotics

abstract: Due to the permanent harm to human health and ecosystem balance, antibiotic pollution in water has become an important direction of current environmental governance. Spherical metal oxides (SMOs) have been frequently utilized as effective heterogeneous photocatalysts for the efficient degradation of antibiotics due to the unique properties (e.g., strong light absorption ability, high separation efficiency of photo-generated electron hole pairs, and good catalytic activity). This review will firstly focus on summarizing the rational design and synthesis of SMOs with various tuned microstructures such as hollow, porous shell, yolk shell, core shell, and nanoflowers. These structures can expose more active sites, achieve a higher utilization rate of light, enhance the mass transfer efficiency and improve the effective diffusion of reactive oxygen species (ROS). Secondly, this review will mainly analyze the intrinsic relationship between the structure of SMOs and its photocatalytic property, the ability to generate ROS, and the degradation pathway for antibiotics. Moreover, the photocatalytic mechanisms and recent progress of different SMOs catalysts for degrading typical antibiotics are compared in detail. Finally, challenges and prospects of future direction in the development of SMOs for antibiotic degradation are reviewed. It is expected to provide a rational design of SMOs catalysts for efficient photocatalytic degradation of environmental pollutants.


title: Rethinking Polarization in Wurtzite Semiconductors

abstract: Polarization arising from non-centrosymmetric wurtzite lattice underpins the physics and functionality of gallium nitride (GaN)-the most produced semiconductor materials second only to silicon. However, recent direct experimental measurements unveiled remanent polarization of unexpectedly large magnitudes and opposite orientations to traditionally anticipated. This significant discrepancy not only poses a formidable challenge to our existing theoretical paradigms but also accentuates the need for a critical rethinking and methodological refinement to integrate these novel observations with established knowledge, mitigating potential misunderstandings and misconceptions in this rapidly evolving field.


title: Statistical analysis and method to propagate the impact of measurement uncertainty on dynamic mode decomposition

abstract: We apply random matrix theory to study the impact of measurement uncertainty on dynamic mode decomposition. Specifically, when the measurements follow a normal probability density function, we show how the moments of that density propagate through the dynamic mode decomposition. While we focus on the first and second moments, the analytical expressions we derive are general and can be extended to higher-order moments. Further, the proposed numerical method to propagate uncertainty is agnostic of specific dynamic mode decomposition formulations. Of particular relevance, the estimated second moments provide confidence bounds that may be used as a metric of trustworthiness, that is, how much one can rely on a finite-dimensional linear operator to represent an underlying dynamical system. We perform numerical experiments on two canonical systems and verify the estimated confidence levels by comparing the moments to those obtained from Monte Carlo simulations.


title: JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset

abstract: Dialogue datasets are crucial for deep learning-based task-oriented dialogue system research. While numerous English language multi-domain task-oriented dialogue datasets have been developed and contributed to significant advancements in task-oriented dialogue systems, such a dataset does not exist in Japanese, and research in this area is limited compared to that in English. In this study, towards the advancement of research and development of task-oriented dialogue systems in Japanese, we constructed JMultiWOZ, the first Japanese language large-scale multi-domain task-oriented dialogue dataset. Using JMultiWOZ, we evaluated the dialogue state tracking and response generation capabilities of the state-of-the-art methods on the existing major English benchmark dataset MultiWOZ2.2 and the latest large language model (LLM)-based methods. Our evaluation results demonstrated that JMultiWOZ provides a benchmark that is on par with MultiWOZ2.2. In addition, through evaluation experiments of interactive dialogues with the models and human participants, we identified limitations in the task completion capabilities of LLMs in Japanese.


title: Leveraging Symmetry in RL-based Legged Locomotion Control

abstract: Model-free reinforcement learning is a promising approach for autonomously solving challenging robotics control problems, but faces exploration difficulty without information of the robot's kinematics and dynamics morphology. The under-exploration of multiple modalities with symmetric states leads to behaviors that are often unnatural and sub-optimal. This issue becomes particularly pronounced in the context of robotic systems with morphological symmetries, such as legged robots for which the resulting asymmetric and aperiodic behaviors compromise performance, robustness, and transferability to real hardware. To mitigate this challenge, we can leverage symmetry to guide and improve the exploration in policy learning via equivariance/invariance constraints. In this paper, we investigate the efficacy of two approaches to incorporate symmetry: modifying the network architectures to be strictly equivariant/invariant, and leveraging data augmentation to approximate equivariant/invariant actor-critics. We implement the methods on challenging loco-manipulation and bipedal locomotion tasks and compare with an unconstrained baseline. We find that the strictly equivariant policy consistently outperforms other methods in sample efficiency and task performance in simulation. In addition, symmetry-incorporated approaches exhibit better gait quality, higher robustness and can be deployed zero-shot in real-world experiments.


title: A Bayesian shrinkage estimator for transfer learning

abstract: Transfer learning (TL) has emerged as a powerful tool to supplement data collected for a target task with data collected for a related source task. The Bayesian framework is natural for TL because information from the source data can be incorporated in the prior distribution for the target data analysis. In this paper, we propose and study Bayesian TL methods for the normal-means problem and multiple linear regression. We propose two classes of prior distributions. The first class assumes the difference in the parameters for the source and target tasks is sparse, i.e., many parameters are shared across tasks. The second assumes that none of the parameters are shared across tasks, but the differences are bounded in $\ell_2$-norm. For the sparse case, we propose a Bayes shrinkage estimator with theoretical guarantees under mild assumptions. The proposed methodology is tested on synthetic data and outperforms state-of-the-art TL methods. We then use this method to fine-tune the last layer of a neural network model to predict the molecular gap property in a material science application. We report improved performance compared to classical fine tuning and methods using only the target data.


title: A novel directly energy-preserving method for charged particle dynamics

abstract: In this paper, we apply the coordinate increment discrete gradient (CIDG) method to solve the Lorentz force system which can be written as a non-canonical Hamiltonian system. Then we can obtain a new energy-preserving CIDG-I method for the system. The CIDG-I method can combine with its adjoint method CIDG-II which is also a energy-preserving method to form a new method, namely CIDG-C method. The CIDG-C method is symmetrical and can conserve the Hamiltonian energy directly and exactly. With comparison to the well-used Boris method, numerical experiments indicate that the CIDG-C method holds advantage over the Boris method in terms of energy-conserving.


title: On the Impact of Random Node Sampling on Adaptive Diffusion Networks

abstract: In this paper, we analyze the effects of random sampling on adaptive diffusion networks. These networks consist in a collection of nodes that can measure and process data, and that can communicate with each other to pursue a common goal of estimating an unknown system. In particular, we consider in our theoretical analysis the diffusion least-mean-squares algorithm in a scenario in which the nodes are randomly sampled. Hence, each node may or may not adapt its local estimate at a certain iteration. Our model shows that, if the nodes cooperate, a reduction in the sampling probability leads to a slight decrease in the steady-state Network Mean-Square Deviation (NMSD), assuming that the environment is stationary and that all other parameters of the algorithm are kept fixed. Furthermore, under certain circumstances, this can also ensure the stability of the algorithm in situations in which it would otherwise be unstable. Although counter-intuitive, our findings are backed by simulation results, which match the theoretical curves well.


title: Unsupervised Learning for Joint Beamforming Design in RIS-aided ISAC Systems

abstract: It is critical to design efficient beamforming in reconfigurable intelligent surface (RIS)-aided integrated sensing and communication (ISAC) systems for enhancing spectrum utilization. However, conventional methods often have limitations, either incurring high computational complexity due to iterative algorithms or sacrificing performance when using heuristic methods. To achieve both low complexity and high spectrum efficiency, an unsupervised learning-based beamforming design is proposed in this work. We tailor image-shaped channel samples and develop an ISAC beamforming neural network (IBF-Net) model for beamforming. By leveraging unsupervised learning, the loss function incorporates key performance metrics like sensing and communication channel correlation and sensing channel gain, eliminating the need of labeling. Simulations show that the proposed method achieves competitive performance compared to benchmarks while significantly reduces computational complexity.


title: A possibly solar metallicity atmosphere escaping from HAT-P-32b revealed by H$\alpha$ and He absorption

abstract: This paper presents a hydrodynamic simulation that couples detailed non-local thermodynamic equilibrium (NLTE) calculations of the hydrogen and helium level populations to model the H$\alpha$ and He 10830 transmission spectra of the hot Jupiter HAT-P-32b. A Monte Carlo simulation is applied to calculate the number of Ly$\alpha$ resonance scatterings, which is the main process for populating H(2). In the examined parameter space, only the models with H/He $\geq$ 99.5/0.5, $(0.5 \sim 3.0)$ times the fiducial value of $F_{\rm XUV}$, $\beta_m = 0.16\sim 0.3$, can explain the H$\alpha$ and He 10830 lines simultaneously. We find a mass-loss rate of $\sim (1.0\sim 3.1) \times 10^{13}$ g s$^{-1}$, consistent with previous studies. Moreover, we find that the stellar Ly$\alpha$ flux should be as high as $4 \times 10^{5}$ erg cm$^{-2}$ s$^{-1}$, indicating high stellar activity during the observation epoch of the two absorption lines. Despite the fact that the metallicity in the lower atmosphere of HAT-P-32b may be super-solar, our simulations tentatively suggest it is close to solar in the upper atmosphere. The difference in metallicity between the lower and upper atmospheres is essential for future atmospheric characterisations.


title: Unveiling the origin of unconventional moire ferroelectricity

abstract: Interfacial ferroelectricity emerges in heterostructures consisting of nonpolar van der Waals (vdW) layers, greatly expanding the scope of two dimensional ferroelectrics. In particular, the unconventional moire ferroelectricity observed in bilayer graphene/boron nitride (BN) heterostructures, exhibits promising functionalities with topological current, superconductivity and synaptic responses. However, the debate about its mechanism - correlation driven charge transfer between two graphene layers - limits device reproducibility and hence large-scale production. Here by designing a single-layer graphene encapsulated by lattice-mismatched WSe2, we identify the ferroelectricity as stemming from - instead of graphene moire bands - the particular BN, where interfacial sliding ferroelectricity must play a role. With similar structures, multilayer twisted MoS2 is found to reproduce the ferroelectricity. The key is a conductive moire ferroelectric, where the screened gate and the pinned domain wall together result in unchanged electronic states, i.e. anomalous screening. The intimate connection to interfacial sliding ferroelectricity thus provides advantages of diverse choices of constituent materials and robust polarization switching while preserving the unique anomalous screening, paving the way to reproducible and reliable memory-based devices in artificial intelligence.


title: Accuracy enhancement method for speech emotion recognition from spectrogram using temporal frequency correlation and positional information learning through knowledge transfer

abstract: In this paper, we propose a method to improve the accuracy of speech emotion recognition (SER) by using vision transformer (ViT) to attend to the correlation of frequency (y-axis) with time (x-axis) in spectrogram and transferring positional information between ViT through knowledge transfer. The proposed method has the following originality i) We use vertically segmented patches of log-Mel spectrogram to analyze the correlation of frequencies over time. This type of patch allows us to correlate the most relevant frequencies for a particular emotion with the time they were uttered. ii) We propose the use of image coordinate encoding, an absolute positional encoding suitable for ViT. By normalizing the x, y coordinates of the image to -1 to 1 and concatenating them to the image, we can effectively provide valid absolute positional information for ViT. iii) Through feature map matching, the locality and location information of the teacher network is effectively transmitted to the student network. Teacher network is a ViT that contains locality of convolutional stem and absolute position information through image coordinate encoding, and student network is a structure that lacks positional encoding in the basic ViT structure. In feature map matching stage, we train through the mean absolute error (L1 loss) to minimize the difference between the feature maps of the two networks. To validate the proposed method, three emotion datasets (SAVEE, EmoDB, and CREMA-D) consisting of speech were converted into log-Mel spectrograms for comparison experiments. The experimental results show that the proposed method significantly outperforms the state-of-the-art methods in terms of weighted accuracy while requiring significantly fewer floating point operations (FLOPs). Overall, the proposed method offers an promising solution for SER by providing improved efficiency and performance.


title: Learning Traffic Signal Control via Genetic Programming

abstract: The control of traffic signals is crucial for improving transportation efficiency. Recently, learning-based methods, especially Deep Reinforcement Learning (DRL), garnered substantial success in the quest for more efficient traffic signal control strategies. However, the design of rewards in DRL highly demands domain knowledge to converge to an effective policy, and the final policy also presents difficulties in terms of explainability. In this work, a new learning-based method for signal control in complex intersections is proposed. In our approach, we design a concept of phase urgency for each signal phase. During signal transitions, the traffic light control strategy selects the next phase to be activated based on the phase urgency. We then proposed to represent the urgency function as an explainable tree structure. The urgency function can calculate the phase urgency for a specific phase based on the current road conditions. Genetic programming is adopted to perform gradient-free optimization of the urgency function. We test our algorithm on multiple public traffic signal control datasets. The experimental results indicate that the tree-shaped urgency function evolved by genetic programming outperforms the baselines, including a state-of-the-art method in the transportation field and a well-known DRL-based method.