title: Continual Segment: Towards a Single, Unified and Accessible Continual Segmentation Model of 143 Whole-body Organs in CT Scans

abstract: Deep learning empowers the mainstream medical image segmentation methods. Nevertheless current deep segmentation approaches are not capable of efficiently and effectively adapting and updating the trained models when new incremental segmentation classes (along with new training datasets or not) are required to be added. In real clinical environment, it can be preferred that segmentation models could be dynamically extended to segment new organs/tumors without the (re-)access to previous training datasets due to obstacles of patient privacy and data storage. This process can be viewed as a continual semantic segmentation (CSS) problem, being understudied for multi-organ segmentation. In this work, we propose a new architectural CSS learning framework to learn a single deep segmentation model for segmenting a total of 143 whole-body organs. Using the encoder/decoder network structure, we demonstrate that a continually-trained then frozen encoder coupled with incrementally-added decoders can extract and preserve sufficiently representative image features for new classes to be subsequently and validly segmented. To maintain a single network model complexity, we trim each decoder progressively using neural architecture search and teacher-student based knowledge distillation. To incorporate with both healthy and pathological organs appearing in different datasets, a novel anomaly-aware and confidence learning module is proposed to merge the overlapped organ predictions, originated from different decoders. Trained and validated on 3D CT scans of 2500+ patients from four datasets, our single network can segment total 143 whole-body organs with very high accuracy, closely reaching the upper bound performance level by training four separate segmentation models (i.e., one model per dataset/task).


title: FLSTRA: Federated Learning in Stratosphere

abstract: We propose a federated learning (FL) in stratosphere (FLSTRA) system, where a high altitude platform station (HAPS) facilitates a large number of terrestrial clients to collaboratively learn a global model without sharing the training data. FLSTRA overcomes the challenges faced by FL in terrestrial networks, such as slow convergence and high communication delay due to limited client participation and multi-hop communications. HAPS leverages its altitude and size to allow the participation of more clients with line-of-sight (LOS) links and the placement of a powerful server. However, handling many clients at once introduces computing and transmission delays. Thus, we aim to obtain a delay-accuracy trade-off for FLSTRA. Specifically, we first develop a joint client selection and resource allocation algorithm for uplink and downlink to minimize the FL delay subject to the energy and quality-of-service (QoS) constraints. Second, we propose a communication and computation resource-aware (CCRA-FL) algorithm to achieve the target FL accuracy while deriving an upper bound for its convergence rate. The formulated problem is non-convex; thus, we propose an iterative algorithm to solve it. Simulation results demonstrate the effectiveness of the proposed FLSTRA system, compared to terrestrial benchmarks, in terms of FL delay and accuracy.


title: Detection of Tomato Ripening Stages using Yolov3-tiny

abstract: One of the most important agricultural products in Mexico is the tomato (Solanum lycopersicum), which occupies the 4th place national most produced product . Therefore, it is necessary to improve its production, building automatic detection system that detect, classify an keep tacks of the fruits is one way to archieve it. So, in this paper, we address the design of a computer vision system to detect tomatoes at different ripening stages. To solve the problem, we use a neural network-based model for tomato classification and detection. Specifically, we use the YOLOv3-tiny model because it is one of the lightest current deep neural networks. To train it, we perform two grid searches testing several combinations of hyperparameters. Our experiments showed an f1-score of 90.0% in the localization and classification of ripening stages in a custom dataset.


title: A Brief Overview of Software-Defined Networking

abstract: The Internet is the driving force of the new digital world, which has created a revolution. With the concept of the Internet of Things (IoT), almost everything is being connected to the internet. However, with the traditional IP network system, it is computationally very complex and costly to manage and configure the network, where the data plane and the control plane are tightly coupled. In order to simplify the network management tasks, software-defined networking (SDN) has been proposed as a promising paradigm shift towards an externalized and logically centralized network control plane. SDN decouples the control plane and the data plane and provides programmability to configure the network. To address the overwhelming advancement of this new technology, a holistic overview of SDN is provided in this paper by describing different layers and their functionalities in SDN. The paper presents a simple but effective overview of SDN, which will pave the way for the readers to understand this new technology and contribute to this field.


title: Market-Based Coordination of Price-Responsive Demand Using Dantzig-Wolfe Decomposition Method

abstract: With the increased share of Distributed Generation (DG) and Demand Responsive (DR) loads in the power systems, new approaches based on the game theory framework have been proposed to tackle the problem of coordination of Price Responsive Devices (PRD). The PRDs are modeled as self-benefiting players who try to optimize their consumption based on the price. In this paper, for the first time, a new algorithm based on the Dantzig-Wolfe (DW) Decomposition method to solve the coordination problem of self-benefiting PRDs in a distributed fashion has been proposed. By utilizing the distributed nature of Dantzig-Wolfe, the PRD's self-benefiting algorithms are modeled as sub-problems of the DW, and the coordinator (or the grid operator) who collects energy consumption of PRDs (their energy bid), solves the master problem of the DW and calculate the price signal accordingly. The proposed algorithm is fast since the subproblem in DW (which could be millions of PRDs) can be solved simultaneously. Furthermore, based on the DW theory, if the PRDs subproblems are convex, reaching the optimal point (Equal to Nash Equilibrium) in limited iterations is guaranteed. A simulation with 8 participant households has been conducted to evaluate the model. Each house is equipped with two types of loads: an Electric Vehicle (EV) as a sample of interruptible loads and an Electric Water Heater (EWH) as a sample of Thermostatically Control Loads (TCA). The results show that when the algorithm reaches the optimal point, the generation cost and the user payment (based on the marginal cost of generation) decrease. Furthermore, the aggregate load's Peak to Average (PAR) reduces significantly.


title: Materia cu\'antica y din\'amica por mediciones

abstract: This article discusses some details of the course on "Quantum matter and measurement induced dynamics" given in the Summer School of Physics XXIX at UNAM in 2022. The notes describe useful concepts to study the dynamics induced by photon losses, the method for simulation (quantum trajectories) is summarized and details of models in optical lattices and high-Q cavities are given. The notes are in Spanish. En este art\'iculo se discuten algunos detalles del curso sobre "Materia cu\'antica y din\'amica inducida por medici\'on" de la escuela de verano de F\'isica XXIX (2022) en la UNAM. Las notas describen conceptos \'utiles para estudiar la din\'amica emergente por efectos de medici\'on de fotones, se resume el m\'etodo para simulaci\'on (trayectorias cu\'anticas) y se dan detalles de modelos de materia cu\'antica y cavidades de alta reflectancia.

categories: cond-mat.quant-gas physics.atom-ph physics.optics quant-ph


title: Multi-Objective Optimization Approach Using Deep Reinforcement Learning for Energy Efficiency in Heterogeneous Computing System

abstract: The growing demand for optimal and low-power energy consumption paradigms for Internet of Things (IoT) devices has garnered significant attention due to their cost-effectiveness, simplicity, and intelligibility. We propose an Artificial Intelligence (AI) hardware energy-efficient framework to achieve optimal energy savings in heterogeneous computing through appropriate power consumption management. A deep reinforcement learning framework is employed, utilizing the Actor-Critic architecture to provide a simple and precise method for power saving. The results of the study demonstrate the proposed approach's suitability for different hardware configurations, achieving notable energy consumption control while adhering to strict performance requirements. The evaluation of the proposed power-saving framework shows that it is more stable, and has achieved more than 23% efficiency improvement, outperforming other methods by more than 5%.


title: Streaming Software Development: Accountability, Community, and Learning

abstract: People use the Internet to learn new skills, stay connected with friends, and find new communities to engage with. Live streaming platforms like Twitch.tv, YouTube Live, and Facebook Gaming provide a place where all three of these activities intersect and enable users to live-stream themselves playing a video game or live-coding software and game development, as well as the ability to participate in chat while watching someone else engage in an activity. Through fifteen interviews with software and game development streamers, we investigate why people choose to stream themselves programming and if they perceive themselves improving their programming skills by live streaming. We found that the motivations to stream included accountability, self-education, community, and visibility of the streamers' work, and streamers perceived a positive influence on their ability to write source code. Our findings implicate that alternative learning methods like live streaming programming are a beneficial tool in the age of the virtual classroom. This work also contributes to and extends research efforts surrounding educational live streaming and collaboration in developer communities.


title: Diffusion Models for High-Resolution Solar Forecasts

abstract: Forecasting future weather and climate is inherently difficult. Machine learning offers new approaches to increase the accuracy and computational efficiency of forecasts, but current methods are unable to accurately model uncertainty in high-dimensional predictions. Score-based diffusion models offer a new approach to modeling probability distributions over many dependent variables, and in this work, we demonstrate how they provide probabilistic forecasts of weather and climate variables at unprecedented resolution, speed, and accuracy. We apply the technique to day-ahead solar irradiance forecasts by generating many samples from a diffusion model trained to super-resolve coarse-resolution numerical weather predictions to high-resolution weather satellite observations.


title: Active Uncertainty Reduction for Safe and Efficient Interaction Planning: A Shielding-Aware Dual Control Approach

abstract: The ability to accurately predict others' behavior is central to the safety and efficiency of interactive robotics. Unfortunately, robots often lack access to key information on which these predictions may hinge, such as other agents' goals, attention, and willingness to cooperate. Dual control theory addresses this challenge by treating unknown parameters of a predictive model as stochastic hidden states and inferring their values at runtime using information gathered during system operation. While able to optimally and automatically trade off exploration and exploitation, dual control is computationally intractable for general interactive motion planning. In this paper, we present a novel algorithmic approach to enable active uncertainty reduction for interactive motion planning based on the implicit dual control paradigm. Our approach relies on sampling-based approximation of stochastic dynamic programming, leading to a model predictive control problem that can be readily solved by real-time gradient-based optimization methods. The resulting policy is shown to preserve the dual control effect for a broad class of predictive models with both continuous and categorical uncertainty. To ensure the safe operation of the interacting agents, we use a runtime safety filter (also referred to as a "shielding" scheme), which overrides the robot's dual control policy with a safety fallback strategy when a safety-critical event is imminent. We then augment the dual control framework with an improved variant of the recently proposed shielding-aware robust planning scheme, which proactively balances the nominal planning performance with the risk of high-cost emergency maneuvers triggered by low-probability agent behaviors. We demonstrate the efficacy of our approach with both simulated driving studies and hardware experiments using 1/10 scale autonomous vehicles.


title: From a superconductor NdNiO$_2$ to a Mott multiferroic BiNiO$_2$

abstract: Motivated by the recently discovered superconductivity in Sr-doped nickelate oxides NdNiO$_2$, we predict a material BiNiO$_2$ that provides an opportunity to study the intertwined ferroelectricity, metallicity, and magnetism in a crystal with very simple atomic structures. There is a ferroelectric structural transition from the nonpolar phase with the P4/mmm space group to the polar phase with the P4mm space group, which is driven by the lone pair on Bi. Calculations based on the Heyd-Scuseria-Ernzerhof hybrid density functional reveal that both the nonmagnetic and ferromagnetic states are metallic for nonpolar and polar phases, while the lowest energy ground-state for polar BiNiO$_2$ is a Hubbard Mott insulator with the G-type antiferromagnetic spin configurations. As a ferroelectric material with an electric polarization of 0.49 C/m2, it may be possible to control the magnetic order in BiNiO$_2$ by an applied electric field. The replacement of Nd by Bi serves as a connecting link between a high-temperature superconductor and a Mott multiferroic. Our work supports a route towards strongly correlated ferroelectrics.


title: Efficiency of neural-network state representations of one-dimensional quantum spin systems

abstract: Neural-network state representations of quantum many-body systems are attracting great attention and more rigorous quantitative analysis about their expressibility and complexity is warranted. Our analysis of the restricted Boltzmann machine (RBM) state representation of one-dimensional (1D) quantum spin systems provides new insight into their computational complexity. We define a class of long-range-fast-decay (LRFD) RBM states with quantifiable upper bounds on truncation errors and provide numerical evidence for a large class of 1D quantum systems that may be approximated by LRFD RBMs of at most polynomial complexities. These results lead us to conjecture that the ground states of a wide range of quantum systems may be exactly represented by LRFD RBMs or a variant of them, even in cases where other state representations become less efficient. At last, we provide the relations between multiple typical state manifolds. Our work proposes a paradigm for doing complexity analysis for generic long-range RBMs which naturally yields a further classification of this manifold. This paradigm and our characterization of their nonlocal structures may pave the way for understanding the natural measure of complexity for quantum many-body states described by RBMs and are generalizable for higher-dimensional systems and deep neural-network quantum states.


title: Under the Bridge: Trolling and the Challenges of Recruiting Software Developers for Empirical Research Studies

abstract: Much of software engineering research focuses on tools, algorithms, and optimization of software. Recently, we, as a community, have come to acknowledge that there is a gap in meta-research and addressing the human-factors in software engineering research. Through meta research, we aim to deepen our understanding of online participant recruitment and human-subjects software engineering research. In this paper we motivate the need to consider the unique challenges that human studies pose in software engineering research. We present several challenges faced by our research team in several distinct research studies, how they affected research, and motivate how, as researchers, we can address these challenges. We present results from a pilot study and categorize issues faced into three broad categories including participant recruitment, community engagement, and data poisoning. We further discuss how we can address these challenges and outline the benefits a full-study could provide to the software engineering research community.


title: Doubling of asymptotically flat half-spaces and the Riemannian Penrose inequality

abstract: Building on previous works of H. L. Bray, of P. Miao, and of S. Almaraz, E. Barbosa, and L. L. de Lima, we develop a doubling procedure for asymptotically flat half-spaces $(M,g)$ with horizon boundary $\Sigma\subset M$ and mass $m\in\mathbb{R}$. If $3\leq \dim(M)\leq 7$, $(M,g)$ has non-negative scalar curvature, and the boundary $\partial M$ is mean-convex, we obtain the Riemannian Penrose-type inequality $$ m\geq\left(\frac{1}{2}\right)^{\frac{n}{n-1}}\,\left(\frac{|\Sigma|}{\omega_{n-1}}\right)^{\frac{n-2}{n-1}} $$ as a corollary. Moreover, in the case where $\partial M$ is not totally geodesic, we show how to construct local perturbations of $(M,g)$ that increase the scalar curvature. As a consequence, we show that equality holds in the above inequality if and only if the exterior region of $(M,g)$ is isometric to a Schwarzschild half-space. Previously, these results were only known in the case where $\dim(M)=3$ and $\Sigma$ is a connected free boundary hypersurface.


title: Reanalysis of the X-ray burst associated FRB 200428 with Insight-HXMT observations

abstract: A double-peak X-ray burst from the Galactic magnetar SGR J1935+2154 was discovered as associated with the two radio pulses of FRB 200428 separated by 28.97+-0.02 ms. Precise measurements of the timing and spectral properties of the X-ray bursts are helpful for understanding the physical origin of fast radio bursts (FRBs). In this paper, we have reconstructed some information about the hard X-ray events, which were lost because the High Energy X-ray Telescope (HE) onboard the Insight-HXMT mission was saturated by this extremely bright burst, and used the information to improve the temporal and spectral analyses of the X-ray burst. The arrival times of the two X-ray peaks by fitting the new Insight-HXMT/HE lightcurve with multi-Gaussian profiles are 2.77+-0.45 ms and 34.30+-0.56 ms after the first peak of FRB 200428, respectively, while these two parameters are 2.57+-0.52 ms and 32.5+-1.4 ms if the fitting profile is a fast rise and exponential decay function. The spectrum of the two X-ray peaks could be described by a cutoff power-law with cutoff energy ~60 keV and photon index ~1.4, the latter is softer than that of the underlying bright and broader X-ray burst when the two X-ray peaks appeared.


title: No Infinite Spin for Planar Total Collision

abstract: The infinite spin problem concerns the rotational behavior of total collision orbits in the $n$-body problem. It has long been known that when a solution tends to total collision then its normalized configuration curve must converge to the set of normalized central configurations. In the planar n-body problem every normalized configuration determines a circle of rotationally equivalent normalized configurations and, in particular, there are circles of normalized central configurations. It's conceivable that by means of an infinite spin, a total collision solution could converge to such a circle instead of to a particular point on it. Here we prove that this is not possible, at least if the limiting circle of central configurations is isolated from other circles of central configurations. (It is believed that all central configurations are isolated, but this is not known in general.) Our proof relies on combining the center manifold theorem with the Lojasiewicz gradient inequality.


title: Program Generation from Diverse Video Demonstrations

abstract: The ability to use inductive reasoning to extract general rules from multiple observations is a vital indicator of intelligence. As humans, we use this ability to not only interpret the world around us, but also to predict the outcomes of the various interactions we experience. Generalising over multiple observations is a task that has historically presented difficulties for machines to grasp, especially when requiring computer vision. In this paper, we propose a model that can extract general rules from video demonstrations by simultaneously performing summarisation and translation. Our approach differs from prior works by framing the problem as a multi-sequence-to-sequence task, wherein summarisation is learnt by the model. This allows our model to utilise edge cases that would otherwise be suppressed or discarded by traditional summarisation techniques. Additionally, we show that our approach can handle noisy specifications without the need for additional filtering methods. We evaluate our model by synthesising programs from video demonstrations in the Vizdoom environment achieving state-of-the-art results with a relative increase of 11.75% program accuracy on prior works


title: Stable Attribute Group Editing for Reliable Few-shot Image Generation

abstract: Few-shot image generation aims to generate data of an unseen category based on only a few samples. Apart from basic content generation, a bunch of downstream applications hopefully benefit from this task, such as low-data detection and few-shot classification. To achieve this goal, the generated images should guarantee category retention for classification beyond the visual quality and diversity. In our preliminary work, we present an ``editing-based'' framework Attribute Group Editing (AGE) for reliable few-shot image generation, which largely improves the generation performance. Nevertheless, AGE's performance on downstream classification is not as satisfactory as expected. This paper investigates the class inconsistency problem and proposes Stable Attribute Group Editing (SAGE) for more stable class-relevant image generation. SAGE takes use of all given few-shot images and estimates a class center embedding based on the category-relevant attribute dictionary. Meanwhile, according to the projection weights on the category-relevant attribute dictionary, we can select category-irrelevant attributes from the similar seen categories. Consequently, SAGE injects the whole distribution of the novel class into StyleGAN's latent space, thus largely remains the category retention and stability of the generated images. Going one step further, we find that class inconsistency is a common problem in GAN-generated images for downstream classification. Even though the generated images look photo-realistic and requires no category-relevant editing, they are usually of limited help for downstream classification. We systematically discuss this issue from both the generative model and classification model perspectives, and propose to boost the downstream classification performance of SAGE by enhancing the pixel and frequency components.


title: CP Violation In Baryon Decays At LHCb

abstract: Observation in astronomy suggests that our Universe contains an abundance of matter over antimatter, which can only be explained if the combined CP symmetry is violated. Studies of CP violation have driven the flavor physics with the aim of testing the Standard Model of particle physics and searching for physics beyond. CP violation is discovered in strange, beauty and charm meson systems, however no conclusive sign of CP violation in baryon decays has been observed yet. This review summarizes CP violation studies performed by the LHCb experiment in charmless decays and rare decays of beauty baryons and singly Cabibbo suppressed decays of charm baryons. A brief prospects for future LHCb measurements are also discussed.


title: Dwarf Galaxies United by Dark Bosons

abstract: Low mass galaxies in the Local Group are dominated by dark matter and comprise the well studied ``dwarf Spheroidal" (dSph) class, with typical masses of $10^{9-10}M_\odot$ and also the equally numerous ``ultra faint dwarfs" (UFD), discovered recently, that are distinctly smaller and denser with masses of only $10^{7-8}M_\odot$. This bimodality amongst low mass galaxies contrasts with the scale free continuity expected for galaxies formed under gravity, as in the standard Cold Dark Matter (CDM) model for heavy particles. Within each dwarf class we find the core radius $R_c$ is inversely related to velocity dispersion $\sigma$, quite the opposite of standard expectations, but indicative of dark matter in a Bose-Einstein state, where the Uncertainty Principle requires $R_c \times \sigma$ is fixed by Planks constant, $h$. The corresponding boson mass, $m_b=h/R_c \sigma$, differs by one order of magnitude between the UDF and dSph classes, with $10^{-21.4}$eV and $10^{-20.3}$eV respectively. Two boson species is reinforced by parallel relations seen between the central density and radius of UDF and dSph dwarfs respectively, each matching the steep prediction, $\rho_c \propto R_c^{-4}$, for soliton cores in the ground state. Furthermore, soliton cores accurately fit the stellar profiles of UDF and dSph dwarfs where prominent, dense cores appear surrounded by low density halos, as predicted by our simulations. Multiple bosons may point to a String Theory interpretation for dark matter, where a discrete mass spectrum of axions is generically predicted to span many decades in mass, offering a unifying "Axiverse" interpretation for the observed "diversity" of dark matter dominated dwarf galaxies.


title: Fractional focusing peaks and collective dynamics in two-dimensional Fermi liquids

abstract: Carrier transport in materials is often diffusive due to momentum-relaxing scattering with phonons and defects. Suppression of momentum-relaxing scattering can lead to the ballistic and hydrodynamic transport regimes, wherein complex non-Ohmic current flow patterns, including current vortices, can emerge. In the ballistic regime addressed here, transverse magnetic focusing is habitually understood in a familiar single-particle picture of carriers injected from a source, following ballistic cyclotron orbits and reaching a detector. We report on a distinctive nonlocal magnetoresistance phenomenon exclusive to fermions, in an enclosed mesoscopic geometry wherein transverse focusing magnetoresistance peaks also occur at values of the cyclotron diameter that are incommensurate with the distance between the source and detector. In low-temperature experiments and simulations using GaAs/AlGaAs heterostructures with high electron mobility, we show that the peaks occur independently of the location of the detector, and only depend on the source-drain separation. We reproduce the experimental findings using simulations of ballistic transport in both semiclassical and quantum-coherent transport models. The periodicity of magnetic field at which the peaks occur is matched to the lithographically defined device scale. It is found that, unlike in transverse magnetic focusing, the magnetoresistance structure cannot be attributed to any set of ordered single-particle trajectories but instead requires accounting for the collective dynamics of the fermion distribution and of all particle trajectories. The magnetoresistance is further associated with current flow vorticity, a collective phenomenon.


title: Criteria for Dynamical Timescale Mass Transfer of Metal-poor Intermediate-mass Stars

abstract: The stability criteria of rapid mass transfer and common envelope evolution are fundamental in binary star evolution. They determine the mass, mass ratio and orbital distribution of many important systems, such as X-ray binaries, Type Ia supernovae and merging gravitational wave sources. We use our adiabatic mass-loss model to systematically survey the intermediate-mass stars' thresholds for dynamical-timescale mass transfer. The impact of metallicity on the stellar responses and critical mass ratios is explored. Both tables ($Z=0.001$) and fitting formula ($Z=0.001$ and $Z=0.02$) of critical mass ratios of intermediate-mass stars are provided. An application of our results to intermediate-mass X-ray binaries (IMXBs) is discussed. We find that the predicted upper limit to mass ratios, as a function of orbital period, is consistent with the observed IMXBs that undergo thermal or nuclear timescale mass transfer. According to the observed peak X-ray luminosity $L_\mathrm{X}$, we predict the range of $L_\mathrm{X}$ for IMXBs as a function of the donor mass and the mass transfer timescale.


title: There are no extremal eutactic stars other than root systems

abstract: A eutactic star on an integral lattice is called extremal if it induces a holomorphic Jacobi form of lattice index and singular weight via the theta block. The famous Macdonald identities imply that root systems are extremal as eutactic stars. In this paper we prove that every extremal eutactic star arises as a root system. This answers a question posed by Skoruppa.


title: Ensuring reliability: what is the optimal time for power plant maintenance in Texas as the climate changes?

abstract: We analyzed data for the Electric Reliability Council of Texas (ERCOT) to assess shoulder seasons -- that is, the 45 days of lowest total energy use and peak demand in the spring and fall typically used for power plant maintenance -- and whether their occurrence has changed over time. Over the period 1996--2022, the shoulder seasons never started earlier than late March nor later than mid-October, corresponding well with the minimum of total degree days. In the temperature record 1959--2022, the minimum in degree days in the spring moved earlier, from early March to early February, and in the fall moved later, from early to mid-November. Warming temperatures might cause these minima in degree days to merge into a single annual minimum in December or January by the mid-2040s, a time when there is a non-trivial risk of 1-day record energy use and peak demand from winter storms.


title: Magnetochemical coupling effects on thermodynamics, point-defect formation and diffusion in Fe-Ni alloys: a theoretical study

abstract: This thesis is a theoretical study of thermodynamic, point-defect formation and diffusion properties in Fe-Ni alloys with a focus on the magnetochemical effects. The results are derived from density functional theory (DFT) calculations and Monte Carlo (MC) simulations using a DFT-parametrized effective interaction model (EIM) with explicit atomic and spin variables. The first part of this work is focused on thermodynamics. We compute via DFT energetic, magnetic and vibrational properties and the bcc-fcc phase diagram, revealing the relative importance between magnetic and vibrational entropies. Combining MC simulations with the EIM, we obtain an fcc phase diagram across the Curie points. We also discuss Mn and Cr effects on phase stability. The second part of the work is dedicated to point-defect properties. We develop MC schemes to compute vacancy formation free energy in alloys. We show that vacancy formation in fcc Fe and Ni exhibits features that are well distinct from those in bcc Fe. The results in fcc Fe-Ni alloys reveal that magnetic disorder tends to increase vacancy formation free energy, while chemical disorder shows an opposite effect. We also study magnetic effects on the properties of self-interstitials in fcc Fe and Ni. The final part of the work is devoted to vacancy-mediated diffusion. We evaluate diffusion properties over the whole concentration range, probe into the magnetochemical effects on diffusion. This work fully takes into account the impacts of transversal and longitudinal spin fluctuations and the magnetochemical interplay. It provides an accurate and consistent prediction of thermodynamic, defect formation and diffusion properties in the Fe-Ni system, and contributes to a better understanding of effects of magnetism in austenitic steels. The applied approach is also transferable to the investigation of other magnetic alloys.


title: Classification of time-reversal-invariant crystals with gauge structures

abstract: A peculiar feature of quantum states is that they may embody so-called projective representations of symmetries rather than ordinary representations. Projective representations of space groups-the defining symmetry of crystals-remain largely unexplored. Despite recent advances in artificial crystals, whose intrinsic gauge structures necessarily require a projective description, a unified theory is yet to be established. Here, we establish such a unified theory by exhaustively classifying and representing all 458 projective symmetry algebras of time-reversal-invariant crystals from 17 wallpaper groups in two dimensions-189 of which are algebraically non-equivalent. We discover three physical signatures resulting from projective symmetry algebras, including the shift of high-symmetry momenta, an enforced nontrivial Zak phase, and a spinless eight-fold nodal point. Our work offers a theoretical foundation for the field of artificial crystals and opens the door to a wealth of topological states and phenomena beyond the existing paradigms.


title: Deep Learning Approach to Predict Hemorrhage in Moyamoya Disease

abstract: Objective: Reliable tools to predict moyamoya disease (MMD) patients at risk for hemorrhage could have significant value. The aim of this paper is to develop three machine learning classification algorithms to predict hemorrhage in moyamoya disease. Methods: Clinical data of consecutive MMD patients who were admitted to our hospital between 2009 and 2015 were reviewed. Demographics, clinical, radiographic data were analyzed to develop artificial neural network (ANN), support vector machine (SVM), and random forest models. Results: We extracted 33 parameters, including 11 demographic and 22 radiographic features as input for model development. Of all compared classification results, ANN achieved the highest overall accuracy of 75.7% (95% CI, 68.6%-82.8%), followed by SVM with 69.2% (95% CI, 56.9%-81.5%) and random forest with 70.0% (95% CI, 57.0%-83.0%). Conclusions: The proposed ANN framework can be a potential effective tool to predict the possibility of hemorrhage among adult MMD patients based on clinical information and radiographic features.


title: Detecting Lexical Borrowings from Dominant Languages in Multilingual Wordlists

abstract: Language contact is a pervasive phenomenon reflected in the borrowing of words from donor to recipient languages. Most computational approaches to borrowing detection treat all languages under study as equally important, even though dominant languages have a stronger impact on heritage languages than vice versa. We test new methods for lexical borrowing detection in contact situations where dominant languages play an important role, applying two classical sequence comparison methods and one machine learning method to a sample of seven Latin American languages which have all borrowed extensively from Spanish. All methods perform well, with the supervised machine learning system outperforming the classical systems. A review of detection errors shows that borrowing detection could be substantially improved by taking into account donor words with divergent meanings from recipient words.


title: Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulation

abstract: This paper presents a new approach for 3D shape generation, inversion, and manipulation, through a direct generative modeling on a continuous implicit representation in wavelet domain. Specifically, we propose a compact wavelet representation with a pair of coarse and detail coefficient volumes to implicitly represent 3D shapes via truncated signed distance functions and multi-scale biorthogonal wavelets. Then, we design a pair of neural networks: a diffusion-based generator to produce diverse shapes in the form of the coarse coefficient volumes and a detail predictor to produce compatible detail coefficient volumes for introducing fine structures and details. Further, we may jointly train an encoder network to learn a latent space for inverting shapes, allowing us to enable a rich variety of whole-shape and region-aware shape manipulations. Both quantitative and qualitative experimental results manifest the compelling shape generation, inversion, and manipulation capabilities of our approach over the state-of-the-art methods.


title: Shutter, the Robot Photographer: Leveraging Behavior Trees for Public, In-the-Wild Human-Robot Interactions

abstract: Deploying interactive systems in-the-wild requires adaptability to situations not encountered in lab environments. Our work details our experience about the impact of architecture choice on behavior reusability and reactivity while deploying a public interactive system. In particular, we introduce Shutter, a robot photographer and a platform for public interaction. In designing Shutter's architecture, we focused on adaptability for in-the-wild deployment, while developing a reusable platform to facilitate future research in public human-robot interaction. We find that behavior trees allow reactivity, especially in group settings, and encourage designing reusable behaviors.


title: Density peak clustering using tensor network

abstract: Tensor networks, which have been traditionally used to simulate many-body physics, have recently gained significant attention in the field of machine learning due to their powerful representation capabilities. In this work, we propose a density-based clustering algorithm inspired by tensor networks. We encode classical data into tensor network states on an extended Hilbert space and train the tensor network states to capture the features of the clusters. Here, we define density and related concepts in terms of fidelity, rather than using a classical distance measure. We evaluate the performance of our algorithm on six synthetic data sets, four real world data sets, and three commonly used computer vision data sets. The results demonstrate that our method provides state-of-the-art performance on several synthetic data sets and real world data sets, even when the number of clusters is unknown. Additionally, our algorithm performs competitively with state-of-the-art algorithms on the MNIST, USPS, and Fashion-MNIST image data sets. These findings reveal the great potential of tensor networks for machine learning applications.


title: $\rm A^2Q$: Aggregation-Aware Quantization for Graph Neural Networks

abstract: As graph data size increases, the vast latency and memory consumption during inference pose a significant challenge to the real-world deployment of Graph Neural Networks (GNNs). While quantization is a powerful approach to reducing GNNs complexity, most previous works on GNNs quantization fail to exploit the unique characteristics of GNNs, suffering from severe accuracy degradation. Through an in-depth analysis of the topology of GNNs, we observe that the topology of the graph leads to significant differences between nodes, and most of the nodes in a graph appear to have a small aggregation value. Motivated by this, in this paper, we propose the Aggregation-Aware mixed-precision Quantization ($\rm A^2Q$) for GNNs, where an appropriate bitwidth is automatically learned and assigned to each node in the graph. To mitigate the vanishing gradient problem caused by sparse connections between nodes, we propose a Local Gradient method to serve the quantization error of the node features as the supervision during training. We also develop a Nearest Neighbor Strategy to deal with the generalization on unseen graphs. Extensive experiments on eight public node-level and graph-level datasets demonstrate the generality and robustness of our proposed method. Compared to the FP32 models, our method can achieve up to a 18.6x (i.e., 1.70bit) compression ratio with negligible accuracy degradation. Morever, compared to the state-of-the-art quantization method, our method can achieve up to 11.4\% and 9.5\% accuracy improvements on the node-level and graph-level tasks, respectively, and up to 2x speedup on a dedicated hardware accelerator.


title: Free Lunch for Domain Adversarial Training: Environment Label Smoothing

abstract: A fundamental challenge for machine learning models is how to generalize learned models for out-of-distribution (OOD) data. Among various approaches, exploiting invariant features by Domain Adversarial Training (DAT) received widespread attention. Despite its success, we observe training instability from DAT, mostly due to over-confident domain discriminator and environment label noise. To address this issue, we proposed Environment Label Smoothing (ELS), which encourages the discriminator to output soft probability, which thus reduces the confidence of the discriminator and alleviates the impact of noisy environment labels. We demonstrate, both experimentally and theoretically, that ELS can improve training stability, local convergence, and robustness to noisy environment labels. By incorporating ELS with DAT methods, we are able to yield state-of-art results on a wide range of domain generalization/adaptation tasks, particularly when the environment labels are highly noisy.


title: Weight Prediction Boosts the Convergence of AdamW

abstract: In this paper, we introduce weight prediction into the AdamW optimizer to boost its convergence when training the deep neural network (DNN) models. In particular, ahead of each mini-batch training, we predict the future weights according to the update rule of AdamW and then apply the predicted future weights to do both forward pass and backward propagation. In this way, the AdamW optimizer always utilizes the gradients w.r.t. the future weights instead of current weights to update the DNN parameters, making the AdamW optimizer achieve better convergence. Our proposal is simple and straightforward to implement but effective in boosting the convergence of DNN training. We performed extensive experimental evaluations on image classification and language modeling tasks to verify the effectiveness of our proposal. The experimental results validate that our proposal can boost the convergence of AdamW and achieve better accuracy than AdamW when training the DNN models.


title: An Axiomatic Characterization of CFMMs and Equivalence to Prediction Markets

abstract: Constant-function market makers (CFMMs), such as Uniswap, are automated exchanges offering trades among a set of assets. We study their technical relationship to another class of automated market makers, cost-function prediction markets. We first introduce axioms for market makers and show that CFMMs with concave potential functions characterize "good" market makers according to these axioms. We then show that every such CFMM on $n$ assets is equivalent to a cost-function prediction market for events with $n$ outcomes. Our construction directly converts a CFMM into a prediction market and vice versa. Conceptually, our results show that desirable market-making axioms are equivalent to desirable information-elicitation axioms, i.e., markets are good at facilitating trade if and only if they are good at revealing beliefs. For example, we show that every CFMM implicitly defines a proper scoring rule for eliciting beliefs; the scoring rule for Uniswap is unusual, but known. From a technical standpoint, our results show how tools for prediction markets and CFMMs can interoperate. We illustrate this interoperability by showing how liquidity strategies from both literatures transfer to the other, yielding new market designs.


title: Minute-cadence Observations of the LAMOST Fields with the TMTS: III. Statistic Study of the Flare Stars from the First Two Years

abstract: Tsinghua University-Ma Huateng Telescopes for Survey (TMTS) aims to detect fast-evolving transients in the Universe, which has led to the discovery of thousands of short-period variables and eclipsing binaries since 2020. In this paper, we present the observed properties of 125 flare stars identified by the TMTS within the first two years, with an attempt to constrain their eruption physics. As expected, most of these flares were recorded in late-type red stars with $G_{\rm BP}-G_{\rm RP}$ > 2.0 mag, however, the flares associated with bluer stars tend to be on average more energetic and have broader profiles. The peak flux (F_peak) of the flare is found to depend strongly on the equivalent duration (ED) of the energy release, i.e., $F_{{\rm peak}} \propto {\rm ED}^{0.72\pm0.04}$, which is consistent with results derived from the Kepler and Evryscope samples. This relation is likely related to the magnetic loop emission, while -- for the more popular non-thermal electron heating model -- a specific time evolution may be required to generate this relation. We notice that flares produced by hotter stars have a flatter $F_{{\rm peak}} \propto {\rm ED}$ relation compared to that from cooler stars. This is related to the statistical discrepancy in light-curve shape of flare events with different colors. In spectra from LAMOST, we find that flare stars have apparently stronger H alpha emission than inactive stars, especially at the low temperature end, suggesting that chromospheric activity plays an important role in producing flares. On the other hand, the subclass having frequent flares are found to show H alpha emission of similar strength in their spectra to that recorded with only a single flare but similar effective temperature, implying that the chromospheric activity may not be the only trigger for eruptions.


title: A fuzzy adaptive metaheuristic algorithm for identifying sustainable, economical, lightweight, and earthquake-resistant reinforced concrete cantilever retaining walls

abstract: In earthquake-prone zones, the seismic performance of reinforced concrete cantilever (RCC) retaining walls is significant. In this study, the seismic performance was investigated using horizontal and vertical pseudo-static coefficients. To tackle RCC weights and forces resulting from these earth pressures, 26 constraints for structural strengths and geotechnical stability along with 12 geometric variables are associated with each design. These constraints and design variables form a constraint optimization problem with a twelve-dimensional solution space. To conduct effective search and produce sustainable, economical, lightweight RCC designs robust against earthquake hazards, a novel adaptive fuzzy-based metaheuristic algorithm is applied. The proposed method divides the search space to sub-regions and establishes exploration, information sharing, and exploitation search capabilities based on its novel search components. Further, fuzzy inference systems were employed to address parameterization and computational cost evaluation issues. It was found that the proposed algorithm can achieve low-cost, low-weight, and low CO2 emission RCC designs under nine seismic conditions in comparison with several classical and best-performing design optimizers.


title: Adjacency matrices over a finite prime field and their direct sum decompositions

abstract: In this paper, we discuss the adjacency matrices of finite undirected simple graphs over a finite prime field $\mathbb{F}_p$. We apply symmetric (row and column) elementary transformations to the adjacency matrix over $\mathbb{F}_p$ in order to get a direct sum decomposition by other adjacency matrices. In this paper, we give a complete description of the direct sum decomposition of the adjacency matrix of any graph over $\mathbb{F}_p$ for any odd prime $p$. Our key tool is quadratic residues of $\mathbb{F}_p$.


title: A Transaction Represented with Weighted Finite-State Transducers

abstract: Not all contracts are good, but all good contracts can be expressed as a finite-state transition system ("State-Transition Contracts"). Contracts that can be represented as State-Transition Contracts discretize fat-tailed risk to foreseeable, managed risk, define the boundary of relevant events governed by the relationship, and eliminate the potential of inconsistent contractual provisions. Additionally, State-Transition Contracts reap the substantial benefit of being able to be analyzed under the rules governing the science of the theory of computation. Simple State-Transition Contracts can be represented as discrete finite automata; more complicated State-Transition Contracts, such as those that have downstream effects on other agreements or complicated pathways of performance, benefit from representation as weighted finite-state transducers, with weights assigned as costs, penalties, or probabilities of transitions. This research paper (the "Research" or "Paper") presents a complex legal transaction represented as weighted finite-state transducers. Furthermore, we show that the mathematics/algorithms permitted by the algebraic structure of weighted finite-state transducers provides actionable, legal insight into the transaction.


title: Bit-balance: Model-Hardware Co-design for Accelerating NNs by Exploiting Bit-level Sparsity

abstract: Bit-serial architectures can handle Neural Networks (NNs) with different weight precisions, achieving higher resource efficiency compared with bit-parallel architectures. Besides, the weights contain abundant zero bits owing to the fault tolerance of NNs, indicating that bit sparsity of NNs can be further exploited for performance improvement. However, the irregular proportion of zero bits in each weight causes imbalanced workloads in the Processing Element (PE) array, which degrades performance or induces overhead for sparse processing. Thus, this paper proposed a bit-sparsity quantization method to maintain the bit sparsity ratio of each weight to no more than a certain value for balancing workloads, with little accuracy loss. Then, we co-designed a sparse bit-serial architecture, called Bit-balance, to improve overall performance, supporting weight-bit sparsity and adaptive bitwidth computation. The whole design was implemented with 65nm technology at 1 GHz and performs at 326-, 30-, 56-, and 218-frame/s for AlexNet, VGG-16, ResNet-50, and GoogleNet respectively. Compared with sparse bit-serial accelerator, Bitlet, Bit-balance achieves 1.8x~2.7x energy efficiency (frame/J) and 2.1x~3.7x resource efficiency (frame/mm2).


title: Semiclassical Electron and Phonon Transport from First Principles: Application to Layered Thermoelectrics

abstract: Thermoelectrics are a promising class of materials for renewable energy owing to their capability to generate electricity from waste heat, with their performance being governed by a competition between charge and thermal transport. A detailed understanding of energy transport at the nanoscale is thus of paramount importance for developing efficient thermoelectrics. Here, we provide a comprehensive overview of the methodologies adopted for the computational design and optimization of thermoelectric materials from first-principles calculations. First, we introduce density-functional theory, the fundamental tool to describe the electronic and vibrational properties of solids. Next, we review charge and thermal transport in the semiclassical framework of the Boltzmann transport equation, with a particular emphasis on the various scattering mechanisms between phonons, electrons, and impurities. Finally, we illustrate how these approaches can be deployed in determining the figure of merit of tin and germanium selenides, an emerging family of layered thermoelectrics that exhibits a promising figure of merit. Overall, this review article offers practical guidelines to achieve an accurate assessment of the thermoelectric properties of materials by means of computer simulations.


title: End-to-End Full-Atom Antibody Design

abstract: Antibody design is an essential yet challenging task in various domains like therapeutics and biology. There are two major defects in current learning-based methods: 1) tackling only a certain subtask of the whole antibody design pipeline, making them suboptimal or resource-intensive. 2) omitting either the framework regions or side chains, thus incapable of capturing the full-atom geometry. To address these pitfalls, we propose dynamic Multi-channel Equivariant grAph Network (dyMEAN), an end-to-end full-atom model for E(3)-equivariant antibody design given the epitope and the incomplete sequence of the antibody. Specifically, we first explore structural initialization as a knowledgeable guess of the antibody structure and then propose shadow paratope to bridge the epitope-antibody connections. Both 1D sequences and 3D structures are updated via an adaptive multi-channel equivariant encoder that is able to process protein residues of variable sizes when considering full atoms. Finally, the updated antibody is docked to the epitope via the alignment of the shadow paratope. Experiments on epitope-binding CDR-H3 design, complex structure prediction, and affinity optimization demonstrate the superiority of our end-to-end framework and full-atom modeling.


title: Observational connection of non-thermal X-ray emission from pulsars with their timing properties and thermal emission

abstract: The origin and radiation mechanisms of high energy emissions from pulsars have remained mysterious since their discovery. Here we report, based on a sample of 68 pulsars, observational connection of non-thermal X-ray emissions from pulsars with their timing properties and thermal emissions, which may provide some constraints on theoretical modeling. Besides strong correlations with the spin-down power $\dot{E}$ and the magnetic field strength at the light cylinder $B_{\rm lc}$, the non-thermal X-ray luminosity in 0.5 - 8 keV, $L_{\rm p}$, represented by the power-law component in the spectral model, is found to be strongly correlated with the highest possible electric field strength in the polar gap, $E_{\rm pc}$, of the pulsar. The spectral power index $\Gamma_{\rm p}$ of that power-law component is also found, for the first time in the literature, to strongly correlate with $\dot{E}$, $B_{\rm lc}$ and $E_{\rm pc}$, thanks to the large sample. In addition, we found that $L_{\rm p}$ can be well described by $L_{\rm p}\propto T^{5.96\pm 0.64}R^{2.24\pm 0.18}$, where $T$ and $R$ are the surface temperature and the emitting-region radius of the surface thermal emission, represented by the black-body component in the spectral model. $\Gamma_{\rm p}$, on the other hand, can be well described only when timing variables are included, and the relation is $\Gamma_{\rm p} = \log(T^{-5.8\pm 1.93}R^{-2.29\pm 0.85}P^{-1.19\pm 0.88}\dot{P}^{0.94\pm 0.44})$ plus a constant. These relations strongly suggest the existence of connections between surface thermal emission and electron-positron pair production in pulsar magnetospheres.


title: Gradient Descent in Neural Networks as Sequential Learning in RKBS

abstract: The study of Neural Tangent Kernels (NTKs) has provided much needed insight into convergence and generalization properties of neural networks in the over-parametrized (wide) limit by approximating the network using a first-order Taylor expansion with respect to its weights in the neighborhood of their initialization values. This allows neural network training to be analyzed from the perspective of reproducing kernel Hilbert spaces (RKHS), which is informative in the over-parametrized regime, but a poor approximation for narrower networks as the weights change more during training. Our goal is to extend beyond the limits of NTK toward a more general theory. We construct an exact power-series representation of the neural network in a finite neighborhood of the initial weights as an inner product of two feature maps, respectively from data and weight-step space, to feature space, allowing neural network training to be analyzed from the perspective of reproducing kernel {\em Banach} space (RKBS). We prove that, regardless of width, the training sequence produced by gradient descent can be exactly replicated by regularized sequential learning in RKBS. Using this, we present novel bound on uniform convergence where the iterations count and learning rate play a central role, giving new theoretical insight into neural network training.


title: Electrode Selection for Noninvasive Fetal Electrocardiogram Extraction using Mutual Information Criteria

abstract: Blind source separation (BSS) techniques have revealed to be promising approaches for, among other, biomedical signal processing applications. Specifically, for the noninvasive extraction of fetal cardiac signals from maternal abdominal recordings, where conventional filtering schemes have failed to extract the complete fetal ECG components. From previous studies, it is now believed that a carefully selected array of electrodes well-placed over the abdomen of a pregnant woman contains the required `information' for BSS, to extract the complete fetal components. Based on this idea, in previous works array recording systems and sensor selection strategies based on the Mutual Information (MI) criterion have been developed. In this paper the previous works have been extended, by considering the 3-dimensional aspects of the cardiac electrical activity. The proposed method has been tested on simulated and real maternal abdominal recordings. The results show that the new sensor selection strategy together with the MI criterion, can be effectively used to select the channels containing the most `information' concerning the fetal ECG components from an array of 72 recordings. The method is hence believed to be useful for the selection of the most informative channels in online applications, considering the different fetal positions and movements.


title: Distributed Traffic Synthesis and Classification in Edge Networks: A Federated Self-supervised Learning Approach

abstract: With the rising demand for wireless services and increased awareness of the need for data protection, existing network traffic analysis and management architectures are facing unprecedented challenges in classifying and synthesizing the increasingly diverse services and applications. This paper proposes FS-GAN, a federated self-supervised learning framework to support automatic traffic analysis and synthesis over a large number of heterogeneous datasets. FS-GAN is composed of multiple distributed Generative Adversarial Networks (GANs), with a set of generators, each being designed to generate synthesized data samples following the distribution of an individual service traffic, and each discriminator being trained to differentiate the synthesized data samples and the real data samples of a local dataset. A federated learning-based framework is adopted to coordinate local model training processes of different GANs across different datasets. FS-GAN can classify data of unknown types of service and create synthetic samples that capture the traffic distribution of the unknown types. We prove that FS-GAN can minimize the Jensen-Shannon Divergence (JSD) between the distribution of real data across all the datasets and that of the synthesized data samples. FS-GAN also maximizes the JSD among the distributions of data samples created by different generators, resulting in each generator producing synthetic data samples that follow the same distribution as one particular service type. Extensive simulation results show that the classification accuracy of FS-GAN achieves over 20% improvement in average compared to the state-of-the-art clustering-based traffic analysis algorithms. FS-GAN also has the capability to synthesize highly complex mixtures of traffic types without requiring any human-labeled data samples.


title: Search for $B$ Mesogenesis at BABAR

abstract: A new mechanism has been proposed to simultaneously explain the presence of dark matter and the matter-antimatter asymmetry in the universe. This scenario predicts exotic $B$ meson decays into a baryon and a dark sector anti-baryon ($\psi_D$) with branching fractions accessible at $B$ factories. We present a search for $B \rightarrow \Lambda \psi_D$ decays using data collected by the $BABAR$ experiment at SLAC. This reaction is identified by fully reconstructing the accompanying $B$ meson and requiring the presence of a single $\Lambda$ baryon in the remaining particles. No significant signal is observed, and bounds on the $B \rightarrow \Lambda \psi_D$ branching fraction are derived in the range $0.13 - 5.2\times 10^{-5}$ for $1.0 < m_{\psi_D} < 4.2$ GeV/$c^{2}$. These results set strong constraints on the parameter space allowed by the theory.


title: Towards Large Certified Radius in Randomized Smoothing using Quasiconcave Optimization

abstract: Randomized smoothing is currently the state-of-the-art method that provides certified robustness for deep neural networks. However, due to its excessively conservative nature, this method of incomplete verification often cannot achieve an adequate certified radius on real-world datasets. One way to obtain a larger certified radius is to use an input-specific algorithm instead of using a fixed Gaussian filter for all data points. Several methods based on this idea have been proposed, but they either suffer from high computational costs or gain marginal improvement in certified radius. In this work, we show that by exploiting the quasiconvex problem structure, we can find the optimal certified radii for most data points with slight computational overhead. This observation leads to an efficient and effective input-specific randomized smoothing algorithm. We conduct extensive experiments and empirical analysis on CIFAR-10 and ImageNet. The results show that the proposed method significantly enhances the certified radii with low computational overhead.


title: Is Stubborn Mining Severe in Imperfect GHOST Bitcoin-like Blockchains? Quantitative Analysis

abstract: GHOST, like the longest-chain protocol, is a chain selection protocol and its capability in resisting selfish mining attack has been validated in imperfect blockchains of Bitcoin and its variants (Bitcoin-like). This paper explores an analytical-model-based method to investigate the impact of stubborn mining attack in imperfect GHOST Bitcoin-like blockchains. We first quantify chain dynamics based on Markov chain and then derive the formulas of miner revenue and system throughput. We also propose a new metric, "Hazard Index", which can be used to compare attack severity and also assist attacker in determining whether it is profitable to conduct an attack. The experiment results show that 1) An attacker with more than 30% computing power can get huge profit and extremely downgrade system throughput by launching stubborn mining attack. 2) A rational attacker should not launch stubborn mining attack if it has less than 25% computing power. 3) Stubborn mining attack causes more damage than selfish mining attack under GHOST. Our work provides insight into stubborn mining attack and is helpful in designing countermeasures.


title: Evoking empathy with visually impaired people through an augmented reality embodiment experience

abstract: To promote empathy with people that have disabilities, we propose a multi-sensory interactive experience that allows sighted users to embody having a visual impairment whilst using assistive technologies. The experiment involves blindfolded sighted participants interacting with a variety of sonification methods in order to locate targets and place objects in a real kitchen environment. Prior to the tests, we enquired about the perceived benefits of increasing said empathy from the blind and visually impaired (BVI) community. To test empathy, we adapted an Empathy and Sympathy Response scale to gather sighted people's self-reported and perceived empathy with the BVI community from both sighted (N = 77) and BVI people (N = 20) respectively. We re-tested sighted people's empathy after the experiment and found that their empathetic and sympathetic responses (N = 15) significantly increased. Furthermore, survey results suggest that the BVI community believes the use of these empathy-evoking embodied experiences may lead to the development of new assistive technologies.


title: Rapid Rotation of an Erupting Prominence and the Associated Coronal Mass Ejection on 13 May 2013

abstract: In this paper, we report the multiwavelength observations of an erupting prominence and the associated CME on 13 May 2013. The event occurs behind the western limb in the field of view of SDO/AIA. The prominence is supported by a highly twisted magnetic flux rope and shows rapid rotation in the counterclockwise direction during the rising motion. The rotation of the prominence lasts for $\sim$47 minutes. The average period, angular speed, and linear speed are $\sim$806 s, $\sim$0.46 rad min$^{-1}$, and $\sim$355 km s$^{-1}$, respectively. The total twist angle reaches $\sim$7$\pi$, which is considerably larger than the threshold for kink instability. Writhing motion during 17:42$-$17:46 UT is clearly observed by SWAP in 174 {\AA} and EUVI on board the behind STEREO spacecraft in 304 {\AA} after reaching an apparent height of $\sim$405\,Mm. Therefore, the prominence eruption is most probably triggered by kink instability. A pair of conjugate flare ribbons and post-flare loops are created and observed by STA/EUVI. The onset time of writhing motion is consistent with the commencement of the impulsive phase of the related flare. The 3D morphology and positions of the associated CME are derived using the graduated cylindrical shell (GCS) modeling. The kinetic evolution of the reconstructed CME is divided into a slow-rise phase ($\sim$330 km s$^{-1}$) and a fast-rise phase ($\sim$1005 km s$^{-1}$) by the writhing motion. The edge-on angular width of the CME is a constant (60$^{\circ}$), while the face-on angular width increases from 96$^{\circ}$ to 114$^{\circ}$, indicating a lateral expansion. The latitude of the CME source region decreases slightly from $\sim$18$^{\circ}$ to $\sim$13$^{\circ}$, implying an equatorward deflection during propagation.


title: Approximating Red-Blue Set Cover and Minimum Monotone Satisfying Assignment

abstract: We provide new approximation algorithms for the Red-Blue Set Cover and Circuit Minimum Monotone Satisfying Assignment (MMSA) problems. Our algorithm for Red-Blue Set Cover achieves $\tilde O(m^{1/3})$-approximation improving on the $\tilde O(m^{1/2})$-approximation due to Elkin and Peleg (where $m$ is the number of sets). Our approximation algorithm for MMSA$_t$ (for circuits of depth $t$) gives an $\tilde O(N^{1-\delta})$ approximation for $\delta = \frac{1}{3}2^{3-\lceil t/2\rceil}$, where $N$ is the number of gates and variables. No non-trivial approximation algorithms for MMSA$_t$ with $t\geq 4$ were previously known. We complement these results with lower bounds for these problems: For Red-Blue Set Cover, we provide a nearly approximation preserving reduction from Min $k$-Union that gives an $\tilde\Omega(m^{1/4 - \varepsilon})$ hardness under the Dense-vs-Random conjecture, while for MMSA we sketch a proof that an SDP relaxation strengthened by Sherali--Adams has an integrality gap of $N^{1-\varepsilon}$ where $\varepsilon \to 0$ as the circuit depth $t\to \infty$.


title: Enhanced Schiff and magnetic quadrupole moments in deformed nuclei and their connection to the search for axion dark matter

abstract: Deformed nuclei possess enhanced moments violating time reversal invariance ($T$) and parity ($P$). Collective magnetic quadrupole moments (MQM) appear in nuclei with a quadrupole deformation (which have ordinary $T$,$P$-conserving collective electric quadrupole moments). Nuclei with an octupole deformation have a collective electric octupole moment, electric dipole moment (EDM), Schiff moment and MQM in the intrinsic frame which rotates with the nucleus. In a state with definite angular momentum in the laboratory frame, these moments are forbidden by $T$ and $P$ conservation, meaning their expectation values vanish due to nuclear rotation. However, nuclei with an octupole deformation have doublets of close opposite parity rotational states with the same spin, which are mixed by $T$,$P$-violating nuclear forces. This mixing polarises the orientation of the nuclear axis along the nuclear spin, and all moments existing in the intrinsic frame appear in the laboratory frame (provided the nuclear spin $I$ is sufficiently large to allow such a moment). Such a mechanism produces enhanced $T$,$P$-violating nuclear moments. This enhancement also takes place in nuclei with a soft octupole vibration mode. In this paper we present updated estimates for the enhanced Schiff moment in isotopes of Eu, Sm, Gd, Dy, Er, Fr, Rn, Ac, Ra, Th, Pa, U, Np and Pu in terms of the CP-violating $\pi$-meson--nucleon interaction constants $\bar{g}_{0},\bar{g}_{1}$ and $\bar{g}_{2}$, the QCD parameter $\bar{\theta}$ and the quark chromo-EDMs. The implications of the enhanced $T$,$P$-violating moments to the search for axion dark matter in solid state experiments are also discussed, with potential alternative candidate compounds in which we may expect enhanced effects suggested.

categories: hep-ph cond-mat.other nucl-th physics.atom-ph


title: Spin relaxation dynamics with a continuous spin environment: the dissipaton equation of motion approach

abstract: We present the quantum dynamics of a spin coupling to a bath of independent spins via the dissipaton equation of motion (DEOM) approach. The bath, characterized by a continuous spectral density function, is composed of spins that are independent level systems described by the su(2) Lie algebra. This represents an extreme class of anharmonic environment. Based on the conclusion drawn by Suarez and Silbey [J. Chem. Phys. 95, 9115 (1991)] and Makri [J. Chem. Phys. 111, 6164 (1999)] that the spin bath can be mapped to a Gaussian environment under its linear response limit, we derive the fluctuation-dissipation theorem (FDT) of the spin bath from a microscopic perspective, and generalize the discussion to the case of arbitrary bath spin quantum number S. Next, the time-domain Prony fitting decomposition scheme is applied to the bare-bath time correlation function (TCF) given by FDT to generate the exponential decay basis (or pseudo modes) for DEOM construction. The accuracy and efficiency of this strategy has been justified by a variety of numerical results. We envision this work provides new insights to extend the hierarchical equations of motion (HEOM) and DEOM approach to certain types of anharmonic enviroments with arbitrary TCF or spectral density


title: EMV-LIO: An Efficient Multiple Vision aided LiDAR-Inertial Odometry

abstract: To deal with the degeneration caused by the incomplete constraints of single sensor, multi-sensor fusion strategies especially in LiDAR-vision-inertial fusion area have attracted much interest from both the industry and the research community in recent years. Considering that a monocular camera is vulnerable to the influence of ambient light from a certain direction and fails, which makes the system degrade into a LiDAR-inertial system, multiple cameras are introduced to expand the visual observation so as to improve the accuracy and robustness of the system. Besides, removing LiDAR's noise via range image, setting condition for nearest neighbor search, and replacing kd-Tree with ikd-Tree are also introduced to enhance the efficiency. Based on the above, we propose an Efficient Multiple vision aided LiDAR-inertial odometry system (EMV-LIO), and evaluate its performance on both open datasets and our custom datasets. Experiments show that the algorithm is helpful to improve the accuracy, robustness and efficiency of the whole system compared with LVI-SAM. Our implementation will be available upon acceptance.


title: Reliable A Posteriori Error Estimator for a Multi-scale Cancer Invasion Model

abstract: In this work, we analyze the residual-based a posteriori error estimation of the multi-scale cancer invasion model, which is a system of three non-stationary reaction-diffusion equations. We present the numerical results of a study on a posteriori error control strategies for FEM approximations of the model. In this paper, we derive a residual type error estimator for the cancer invasion model and illustrate its practical performance on a series of computational tests in three-dimensional spaces. We show that the error estimator is reliable and efficient regarding the model's small perturbation parameters.


title: The projection constant for the trace class

abstract: We study the projection constant of the space of operators on $n$-dimensional Hilbert spaces, with the trace norm, $\mathcal S_1(n)$. We show an integral formula for the projection constant of $\mathcal S_1(n)$; namely $ \boldsymbol{\lambda}\big(\mathcal S_1(n)\big) = n \int_{\mathcal U_n} \vert \text{tr}(U) \vert \,dU \,, $ where the integration is with respect to the Haar probability measure on the group $\mathcal U_n$ of unitary operators. Using a probabilistic approach, we derive the limit formula $ \lim_{n\to \infty} \boldsymbol{\lambda}\big(\mathcal S_1(n)\big)/n = \sqrt{\pi}/2\,. $


title: Knowledge Distillation on Graphs: A Survey

abstract: Graph Neural Networks (GNNs) have attracted tremendous attention by demonstrating their capability to handle graph data. However, they are difficult to be deployed in resource-limited devices due to model sizes and scalability constraints imposed by the multi-hop data dependency. In addition, real-world graphs usually possess complex structural information and features. Therefore, to improve the applicability of GNNs and fully encode the complicated topological information, knowledge distillation on graphs (KDG) has been introduced to build a smaller yet effective model and exploit more knowledge from data, leading to model compression and performance improvement. Recently, KDG has achieved considerable progress with many studies proposed. In this survey, we systematically review these works. Specifically, we first introduce KDG challenges and bases, then categorize and summarize existing works of KDG by answering the following three questions: 1) what to distillate, 2) who to whom, and 3) how to distillate. Finally, we share our thoughts on future research directions.


title: Efficient Scopeformer: Towards Scalable and Rich Feature Extraction for Intracranial Hemorrhage Detection

abstract: The quality and richness of feature maps extracted by convolution neural networks (CNNs) and vision Transformers (ViTs) directly relate to the robust model performance. In medical computer vision, these information-rich features are crucial for detecting rare cases within large datasets. This work presents the "Scopeformer," a novel multi-CNN-ViT model for intracranial hemorrhage classification in computed tomography (CT) images. The Scopeformer architecture is scalable and modular, which allows utilizing various CNN architectures as the backbone with diversified output features and pre-training strategies. We propose effective feature projection methods to reduce redundancies among CNN-generated features and to control the input size of ViTs. Extensive experiments with various Scopeformer models show that the model performance is proportional to the number of convolutional blocks employed in the feature extractor. Using multiple strategies, including diversifying the pre-training paradigms for CNNs, different pre-training datasets, and style transfer techniques, we demonstrate an overall improvement in the model performance at various computational budgets. Later, we propose smaller compute-efficient Scopeformer versions with three different types of input and output ViT configurations. Efficient Scopeformers use four different pre-trained CNN architectures as feature extractors to increase feature richness. Our best Efficient Scopeformer model achieved an accuracy of 96.94\% and a weighted logarithmic loss of 0.083 with an eight times reduction in the number of trainable parameters compared to the base Scopeformer. Another version of the Efficient Scopeformer model further reduced the parameter space by almost 17 times with negligible performance reduction. Hybrid CNNs and ViTs might provide the desired feature richness for developing accurate medical computer vision models


title: Studying phonon coherence with a quantum sensor

abstract: In the field of quantum technology, nanomechanical oscillators offer a host of useful properties given their compact size, long lifetimes, and ability to detect force and motion. Their integration with superconducting quantum circuits shows promise for hardware-efficient computation architectures and error-correction protocols based on superpositions of mechanical coherent states. One limitation of this approach is decoherence processes affecting the mechanical oscillator. Of particular interest are two-level system (TLS) defects in the resonator host material, which have been widely studied in the classical domain, primarily via measurements of the material loss tangent. In this manuscript, we use a superconducting qubit as a quantum sensor to perform phonon number-resolved measurements on a phononic crystal cavity. This enables a high-resolution study of mechanical dissipation and dephasing in coherent states of variable size (mean phonon number $\navg\simeq1-10$). We observe nonexponential energy decay and a state size-dependent reduction of the dephasing rate, which we attribute to interactions with TLS. Using a numerical model, we reproduce the energy decay signatures (and to a lesser extent, the dephasing signatures) via mechanical emission into a small ensemble ($N=5$) of saturable and rapidly dephasing TLS. Our findings comprise a detailed examination of TLS-induced phonon decoherence in the quantum regime.


title: A converse to the Hasse-Arf theorem

abstract: Let $L/K$ be a finite Galois extension of local fields. The Hasse-Arf theorem says that if Gal$(L/K)$ is abelian then the upper ramification breaks of $L/K$ must be integers. We prove the following converse to the Hasse-Arf theorem: Let $G$ be a nonabelian group which is isomorphic to the Galois group of some totally ramified extension $E/F$ of local fields with residue characteristic $p>2$. Then there is a totally ramified extension of local fields $L/K$ with residue characteristic $p$ such that Gal$(L/K)\cong G$ and $L/K$ has at least one nonintegral upper ramification break.


title: Phase space analysis of the bouncing universe with stringy effects

abstract: We use the recently modified Friedmann equations obtained from string T-duality effects that encode the zero-point length (Phys. Lett. B 836 (2023), 137621) to study the phase space analyses of a bouncing early universe. An important implication of such stringy effects is that they can alleviate the initial singularity since the Raychaudhuri equation is modified. We investigate if the Universe can undergo an accelerated expansion phase for a specific domain of the equation of state parameter. The stringy effects are encoded in the parameter $\Gamma$, which depends not only on the zero-point length but also on the state parameter $\omega$. We construct two dynamical systems depending on whether $-1 < \omega \leq -1/3$ and $\omega \geq -1/3$, and we classify the equilibrium points of each system. Exact solutions and cosmological implications are discussed.


title: Human Fall Detection- Multimodality Approach

abstract: Falls have become more frequent in recent years, which has been harmful for senior citizens.Therefore detecting falls have become important and several data sets and machine learning model have been introduced related to fall detection. In this project report, a human fall detection method is proposed using a multi modality approach. We used the UP-FALL detection data set which is collected by dozens of volunteers using different sensors and two cameras. We use wrist sensor with acclerometer data keeping labels to binary classification, namely fall and no fall from the data set.We used fusion of camera and sensor data to increase performance. The experimental results shows that using only wrist data as compared to multi sensor for binary classification did not impact the model prediction performance for fall detection.


title: The Past, Current, and Future of Neonatal Intensive Care Units with Artificial Intelligence

abstract: Machine learning and deep learning are two subsets of artificial intelligence that involve teaching computers to learn and make decisions from any sort of data. Most recent developments in artificial intelligence are coming from deep learning, which has proven revolutionary in almost all fields, from computer vision to health sciences. The effects of deep learning in medicine have changed the conventional ways of clinical application significantly. Although some sub-fields of medicine, such as pediatrics, have been relatively slow in receiving the critical benefits of deep learning, related research in pediatrics has started to accumulate to a significant level, too. Hence, in this paper, we review recently developed machine learning and deep learning-based solutions for neonatology applications. We systematically evaluate the roles of both classical machine learning and deep learning in neonatology applications, define the methodologies, including algorithmic developments, and describe the remaining challenges in the assessment of neonatal diseases by using PRISMA 2020 guidelines. To date, the primary areas of focus in neonatology regarding AI applications have included survival analysis, neuroimaging, analysis of vital parameters and biosignals, and retinopathy of prematurity diagnosis. We have categorically summarized 106 research articles from 1996 to 2022 and discussed their pros and cons, respectively. In this systematic review, we aimed to further enhance the comprehensiveness of the study. We also discuss possible directions for new AI models and the future of neonatology with the rising power of AI, suggesting roadmaps for the integration of AI into neonatal intensive care units.


title: Phonon anharmonicity and soft-phonon mediated structural phase transition in $Cs_3Bi_2Br_9$

abstract: We have carried out temperature-dependent x-ray diffraction and Raman scattering experiments on powder $Cs_3Bi_2Br_9$. Trigonal to monoclinic structural transition at around 95 K is discussed and shown to be driven by the softening of the soft mode. We propose a model to describe the dynamics of the incomplete soft-mode. Raman scattering experiments demonstrate the origin of the soft mode to the rocking motions of Br atoms that participate to form $BiBr_6$ octahedra, which correlates the reported theoretical calculations. Some of the Raman mode frequencies exhibit anomalous temperature dependence due to strong anharmonic phonon-phonon coupling. Temperature-dependent x-ray diffraction analysis estimate the volume thermal expansion coefficient in trigonal phase to be $13.54\times10^{-5} K^{-1}$. In the trigonal phase, the broadening of the full width at half maximum (FWHM) with increase in temperature for $E_g$ and $A_{1g}$ modes is accompanied by decaying of one optical phonon into two acoustic phonons. The volume thermal expansion rather than anharmonic phonon-phonon interaction dominates the frequency shift for the Raman modes in trigonal phase. In the monoclinic phase, the strength of four phonon processes to the frequency shift and linewidth broadening is much smaller than that for three phonon processes for some of the modes. The observed temperature dependence of FWHM of certain Raman modes in both phases suggests unusual electron-phonon coupling in the crystal.


title: A Projective Geometric View for 6D Pose Estimation in mmWave MIMO Systems

abstract: Millimeter-wave (mmWave) systems in the 30--300 GHz bands are among the fundamental enabling technologies of 5G and beyond 5G, providing large bandwidths, not only for high data rate communication, but also for precise positioning services, in support of high accuracy demanding applications such as vehicle positioning. With the possibility to introduce relatively large arrays on user devices with a small footprint, the ability to determine the user orientation becomes unlocked. The estimation of the full user pose (joint 3D position and 3D orientation) is referred to as 6D localization. Conventionally, the problem of 6D localization using antenna arrays has been considered difficult and was solved through a combination of heuristics and optimization. In this paper, we reveal a close connection between the AoA and AoD and the well-studied perspective projection model from computer vision. This connection allows us to solve the 6D localization problem, by adapting state-of-the-art methods from computer vision. More specifically, two problems, namely 6D pose estimation from AoA from multiple single-antenna base stations and 6D SLAM based on single-BS mmWave communication, are first modeled with the perspective projection model, and then solved. Numerical simulations show that the proposed estimators operate close to the theoretical performance bounds. Moreover, the proposed SLAM method is effective even in the absence of the LoS path, or knowledge of the LoS/NLoS condition.


title: Extended MCDHF calculations of energy levels and transition data for N I

abstract: Accurate and extensive atomic data are essential for spectroscopic analyses of stellar atmospheres and other astronomical objects. We present energy levels, lifetimes, and transition probabilities for neutral nitrogen, the sixth most abundant element in the cosmos. The calculations employ the fully relativistic multiconfiguration Dirac-Hartree-Fock and relativistic configuration interaction methods, and span the 103 lowest states up to and including 2s$^2$2p$^2$5s. Our theoretical energies are in excellent agreement with the experimental data, with an average relative difference of 0.07%. In addition, our transition probabilities are in good agreement with available experimental and theoretical data. We further verify the agreement of our data with experimental results via a re-analysis of the solar nitrogen abundance, with the results from the Babushkin and Coulomb gauges consistent to 2% or 0.01 dex. We estimated the uncertainties of the computed transition data based on a statistical analysis of the differences between the transition rates in Babushkin and Coulomb gauges. Out of the 1701 computed electric dipole transitions in this work, 83 (536) are associated with uncertainties less than 5% (10%).


title: Search for Stochastic Gravitational-Wave Background from Massive Gravity in the NANOGrav 12.5-Year Data Set

abstract: Gravitational waves offer a new window to probe the nature of gravity, including answering if the mediating particle, graviton, has a non-zero mass or not. Pulsar timing arrays measure stochastic gravitational wave background (SGWB) at $\sim1-100$~nanohertz. Recently, the North American Nanohertz Observatory for Gravitational Waves (NANOGrav) collaboration reported an uncorrelated common-spectrum process in their 12.5-year data set with no substantial evidence that the process comes from the SGWB predicted by general relativity. In this work, we explore the possibility of an SGWB from massive gravity in the data set and find that a massless graviton is preferred because of the relatively larger Bayes factor. Without statistically significant evidence for dispersion-related correlations predicted by massive gravity, we place upper limits on the amplitude of the SGWB for graviton mass smaller than $10^{-23}$~eV as $A_{\rm{MG}}<3.21\times 10^{-15}$ at $95\%$ confidence level.

categories: gr-qc astro-ph.CO astro-ph.GA astro-ph.HE hep-ph


title: Revisiting the Effects of Maternal Education on Adolescents' Academic Performance: Doubly Robust Estimation in a Network-Based Observational Study

abstract: In many contexts, particularly when study subjects are adolescents, peer effects can invalidate typical statistical requirements in the data. For instance, it is plausible that a student's academic performance is influenced both by their own mother's educational level as well as that of their peers. Since the underlying social network is measured, the Add Health study provides a unique opportunity to examine the impact of maternal college education on adolescent school performance, both direct and indirect. However, causal inference on populations embedded in social networks poses technical challenges, since the typical no interference assumption no longer holds. While inverse probability-of-treatment weighted (IPW) estimators have been developed for this setting, they are often highly unstable. Motivated by the question of maternal education, we propose doubly robust (DR) estimators combining models for treatment and outcome that are consistent and asymptotically normal if either model is correctly specified. We present empirical results that illustrate the DR property and the efficiency gain of DR over IPW estimators even when the treatment model is misspecified. Contrary to previous studies, our robust analysis does not provide evidence of an indirect effect of maternal education on academic performance within adolescents' social circles in Add Health.


title: Projection constants for spaces of Dirichlet polynomials

abstract: Given a frequency sequence $\omega=(\omega_n)$ and a finite subset $J \subset \mathbb{N}$, we study the space $\mathcal{H}_{\infty}^{J}(\omega)$ of all Dirichlet polynomials $D(s) := \sum_{n \in J} a_n e^{-\omega_n s}, \, s \in \mathbb{C}$. The main aim is to prove asymptotically correct estimates for the projection constant $\boldsymbol{\lambda}\big(\mathcal{H}_\infty^{J}(\omega) \big)$ of the finite dimensional Banach space $\mathcal{H}_\infty^{J}(\omega)$ equipped with the norm $\|D\|= \sup_{\text{Re}\,s>0} |D(s)|$. Based on harmonic analysis on $\omega$-Dirichlet groups, we prove the formula $ \boldsymbol{\lambda}\big(\mathcal{H}_\infty^{J}(\omega) \big) = \lim_{T \to \infty} \frac{1}{2T} \int_{-T}^T \Big|\sum_{n \in J} e^{-i\omega_n t}\Big|\,dt\,, $ and apply it to various concrete frequencies $\omega$ and index sets $J$. To see an example, combining with a recent deep result of Harper from probabilistic analytic number theory, we for the space $\mathcal{H}_\infty^{\leq x}\big( (\log n)\big)$ of all ordinary Dirichlet polynomials $D(s) = \sum_{n \leq x} a_n n^{-s}$ of length $x$ show the asymptotically correct order $ \boldsymbol{\lambda}\big(\mathcal{H}_\infty^{\leq x}\big( (\log n)\big)\big) \sim \sqrt{x}/(\log \log x)^{\frac{1}{4}}. $


title: SPIDE: A Purely Spike-based Method for Training Feedback Spiking Neural Networks

abstract: Spiking neural networks (SNNs) with event-based computation are promising brain-inspired models for energy-efficient applications on neuromorphic hardware. However, most supervised SNN training methods, such as conversion from artificial neural networks or direct training with surrogate gradients, require complex computation rather than spike-based operations of spiking neurons during training. In this paper, we study spike-based implicit differentiation on the equilibrium state (SPIDE) that extends the recently proposed training method, implicit differentiation on the equilibrium state (IDE), for supervised learning with purely spike-based computation, which demonstrates the potential for energy-efficient training of SNNs. Specifically, we introduce ternary spiking neuron couples and prove that implicit differentiation can be solved by spikes based on this design, so the whole training procedure, including both forward and backward passes, is made as event-driven spike computation, and weights are updated locally with two-stage average firing rates. Then we propose to modify the reset membrane potential to reduce the approximation error of spikes. With these key components, we can train SNNs with flexible structures in a small number of time steps and with firing sparsity during training, and the theoretical estimation of energy costs demonstrates the potential for high efficiency. Meanwhile, experiments show that even with these constraints, our trained models can still achieve competitive results on MNIST, CIFAR-10, CIFAR-100, and CIFAR10-DVS. Our code is available at https://github.com/pkuxmq/SPIDE-FSNN.


title: Asymptotic insights for projection, Gordon-Lewis and Sidon constants in Boolean cube function spaces

abstract: The main aim of this work is to study important local Banach space constants for Boolean cube function spaces. Specifically, we focus on $\mathcal{B}_{\mathcal{S}}^N$, the finite-dimensional Banach space of all real-valued functions defined on the $N$-dimensional Boolean cube $\{-1, +1\}^N$ that have Fourier--Walsh expansions supported on a fixed~family $\mathcal{S}$ of subsets of $\{1, \ldots, N\}$. Our investigation centers on the projection, Sidon and Gordon--Lewis constants of this function space. We combine tools from different areas to derive exact formulas and asymptotic estimates of these parameters for special types of families $\mathcal{S}$ depending on the dimension $N$ of the Boolean cube and other complexity characteristics of the support set $\mathcal{S}$. Using local Banach space theory, we establish the intimate relationship among these three important constants.


title: Physics of Smart Matter: integrating active matter and control to gain insights into living systems

abstract: We offer our opinion on the benefits of integration of insights from active matter physics with principles of regulatory interactions and control to develop a field we term ``smart matter". This field can provide insight into important principles in living systems as well as aid engineering of responsive, robust and functional collectives.


title: Minimizing Change-Point Estimation Error

abstract: In this paper we consider change-points in multiple sequences with the objective of minimizing the estimation error of a sequence by making use of information from other sequences. This is in contrast to recent interest on change-points in multiple sequences where the focus is on detection of common change-points. We start with the canonical case of a single sequence with constant change-point intensities. We consider two measures of a change-point algorithm. The first is the probability of estimating the change-point with no error. The second is the expected distance between the true and estimated change-points. We provide a theoretical upper bound for the no error probability, and a lower bound for the expected distance, that must be satisfied by all algorithms. We propose a scan-CUSUM algorithm that achieves the no error upper bound and come close to the distance lower bound. We next consider the case of non-constant intensities and establish sharp conditions under which estimation error can go to zero. We propose an extension of the scan-CUSUM algorithm for a non-constant intensity function, and show that it achieves asymptotically zero error at the boundary of the zero-error regime. We illustrate an application of the scan-CUSUM algorithm on multiple sequences sharing an unknown, non-constant intensity function. We estimate the intensity function from the change-point profile likelihoods of all sequences and apply scan-CUSUM on the estimated intensity function.


title: Generative Adversarial Symmetry Discovery

abstract: Despite the success of equivariant neural networks in scientific applications, they require knowing the symmetry group a priori. However, it may be difficult to know which symmetry to use as an inductive bias in practice. Enforcing the wrong symmetry could even hurt the performance. In this paper, we propose a framework, LieGAN, to automatically discover equivariances from a dataset using a paradigm akin to generative adversarial training. Specifically, a generator learns a group of transformations applied to the data, which preserve the original distribution and fool the discriminator. LieGAN represents symmetry as interpretable Lie algebra basis and can discover various symmetries such as the rotation group $\mathrm{SO}(n)$, restricted Lorentz group $\mathrm{SO}(1,3)^+$ in trajectory prediction and top-quark tagging tasks. The learned symmetry can also be readily used in several existing equivariant neural networks to improve accuracy and generalization in prediction.


title: Bridging Physics-Informed Neural Networks with Reinforcement Learning: Hamilton-Jacobi-Bellman Proximal Policy Optimization (HJBPPO)

abstract: This paper introduces the Hamilton-Jacobi-Bellman Proximal Policy Optimization (HJBPPO) algorithm into reinforcement learning. The Hamilton-Jacobi-Bellman (HJB) equation is used in control theory to evaluate the optimality of the value function. Our work combines the HJB equation with reinforcement learning in continuous state and action spaces to improve the training of the value network. We treat the value network as a Physics-Informed Neural Network (PINN) to solve for the HJB equation by computing its derivatives with respect to its inputs exactly. The Proximal Policy Optimization (PPO)-Clipped algorithm is improvised with this implementation as it uses a value network to compute the objective function for its policy network. The HJBPPO algorithm shows an improved performance compared to PPO on the MuJoCo environments.

categories: cs.LG cs.AI cs.NA math.AP math.NA math.OC


title: How to extend closure and interior operations to more modules

abstract: There are several ways to convert a closure or interior operation to a different operation that has particular desirable properties. In this paper, we axiomatize 3 ways to do so, drawing on disparate examples from the literature, including tight closure, basically full closure, and various versions of integral closure. In doing so, we explore several such desirable properties, including *hereditary*, *residual*, and *cofunctorial*, and see how they interact with other properties such as the *finitistic* property.