title: Stacked Intelligent Metasurfaces for Holographic MIMO Aided Cell-Free Networks

abstract: Large-scale multiple-input and multiple-output (MIMO) systems are capable of achieving high date rate. However, given the high hardware cost and excessive power consumption of massive MIMO systems, as a remedy, intelligent metasurfaces have been designed for efficient holographic MIMO (HMIMO) systems. In this paper, we propose a HMIMO architecture based on stacked intelligent metasurfaces (SIM) for the uplink of cell-free systems, where the SIM is employed at the access points (APs) for improving the spectral- and energy-efficiency. Specifically, we conceive distributed beamforming for SIM-assisted cell-free networks, where both the SIM coefficients and the local receiver combiner vectors of each AP are optimized based on the local channel state information (CSI) for the local detection of each user equipment (UE) information. Afterward, the central processing unit (CPU) fuses the local detections gleaned from all APs to detect the aggregate multi-user signal. Specifically, to design the SIM coefficients and the combining vectors of the APs, a low-complexity layer-by-layer iterative optimization algorithm is proposed for maximizing the equivalent gain of the channel spanning from the UEs to the APs. At the CPU, the weight vector used for combining the local detections from all APs is designed based on the minimum mean square error (MMSE) criterion, where the hardware impairments (HWIs) are also taken into consideration based on their statistics. The simulation results show that the SIM-based HMIMO outperforms the conventional single-layer HMIMO in terms of the achievable rate. We demonstrate that both the HWI of the radio frequency (RF) chains at the APs and the UEs limit the achievable rate in the high signal-to-noise-ratio (SNR) region.


title: Fermionic Non-Invertible Symmetries in (1+1)d: Gapped and Gapless Phases, Transitions, and Symmetry TFTs

abstract: We study fermionic non-invertible symmetries in (1+1)d, which are generalized global symmetries that mix fermion parity symmetry with other invertible and non-invertible internal symmetries. Such symmetries are described by fermionic fusion supercategories, which are fusion $\pi$-supercategories with a choice of fermion parity. The aim of this paper is to flesh out the categorical Landau paradigm for fermionic symmetries. We use the formalism of Symmetry Topological Field Theory (SymTFT) to study possible gapped and gapless phases for such symmetries, along with possible deformations between these phases, which are organized into a Hasse phase diagram. The phases can be characterized in terms of sets of condensed, confined and deconfined generalized symmetry charges, reminiscent of notions familiar from superconductivity. Many of the gapless phases also serve as phase transitions between gapped phases. The associated fermionic conformal field theories (CFTs) can be obtained by performing generalized fermionic Kennedy-Tasaki (KT) transformations on bosonic CFTs describing simpler transitions. The fermionic non-invertible symmetries along with their charges and phases discussed here can be obtained from those of bosonic non-invertible symmetries via fermionization or Jordan-Wigner transformation, which is discussed in detail.


title: Collision Avoidance Metric for 3D Camera Evaluation

abstract: 3D cameras have emerged as a critical source of information for applications in robotics and autonomous driving. These cameras provide robots with the ability to capture and utilize point clouds, enabling them to navigate their surroundings and avoid collisions with other objects. However, current standard camera evaluation metrics often fail to consider the specific application context. These metrics typically focus on measures like Chamfer distance (CD) or Earth Mover's Distance (EMD), which may not directly translate to performance in real-world scenarios. To address this limitation, we propose a novel metric for point cloud evaluation, specifically designed to assess the suitability of 3D cameras for the critical task of collision avoidance. This metric incorporates application-specific considerations and provides a more accurate measure of a camera's effectiveness in ensuring safe robot navigation.


title: An Autoencoder and Generative Adversarial Networks Approach for Multi-Omics Data Imbalanced Class Handling and Classification

abstract: In the relentless efforts in enhancing medical diagnostics, the integration of state-of-the-art machine learning methodologies has emerged as a promising research area. In molecular biology, there has been an explosion of data generated from multi-omics sequencing. The advent sequencing equipment can provide large number of complicated measurements per one experiment. Therefore, traditional statistical methods face challenging tasks when dealing with such high dimensional data. However, most of the information contained in these datasets is redundant or unrelated and can be effectively reduced to significantly fewer variables without losing much information. Dimensionality reduction techniques are mathematical procedures that allow for this reduction; they have largely been developed through statistics and machine learning disciplines. The other challenge in medical datasets is having an imbalanced number of samples in the classes, which leads to biased results in machine learning models. This study, focused on tackling these challenges in a neural network that incorporates autoencoder to extract latent space of the features, and Generative Adversarial Networks (GAN) to generate synthetic samples. Latent space is the reduced dimensional space that captures the meaningful features of the original data. Our model starts with feature selection to select the discriminative features before feeding them to the neural network. Then, the model predicts the outcome of cancer for different datasets. The proposed model outperformed other existing models by scoring accuracy of 95.09% for bladder cancer dataset and 88.82% for the breast cancer dataset.


title: Give and Take: An End-To-End Investigation of Giveaway Scam Conversion Rates

abstract: Scams -- fraudulent schemes designed to swindle money from victims -- have existed for as long as recorded history. However, the Internet's combination of low communication cost, global reach, and functional anonymity has allowed scam volumes to reach new heights. Designing effective interventions requires first understanding the context: how scammers reach potential victims, the earnings they make, and any potential bottlenecks for durable interventions. In this short paper, we focus on these questions in the context of cryptocurrency giveaway scams, where victims are tricked into irreversibly transferring funds to scammers under the pretense of even greater returns. Combining data from Twitter, YouTube and Twitch livestreams, landing pages, and cryptocurrency blockchains, we measure how giveaway scams operate at scale. We find that 1 in 1000 scam tweets, and 4 in 100,000 livestream views, net a victim, and that scammers managed to extract nearly \$4.62 million from just hundreds of victims during our measurement window.


title: Spatial-temporal manipulations of visible nanosecond sub-pulse sequences in an actively Q-switched Pr:YLF laser

abstract: Pulsed visible lasers either by Q-switching or mode locking have been attracting intense attentions both in solid-state laser and fiber laser. Here, we report on the simultaneous manipulation of reconfigurable sub-pulse sequences and customizable high-order vortex beams in an actively Q-switched visible laser. On the one hand, pulse sequences with up to 4 sub-pulses could be generated and fully controlled by means of an acoustic-optic modulator driven by an arbitrary waveform generator. Both pulse number and pulse intensity can be manipulated through the programmable step-signal, which is also theoretically simulated through the rate equations. On the other hand, assisted by the off-axis pumping technique and the astigmatic mode conversion, the laser cavity could emit high-quality vortex beams carrying Laguerre-Gaussian modes up to 30th order. To the best of our knowledge, this is the most flexible active manipulations not only on the intensity distribution of the transverse modes but also on the temporal distribution of the pulse sequences in a visible laser. The versatile manipulating techniques in this work could be immediately implemented into all other solid-state lasers to obtain sub-pulse vortex beams, which may provide enhanced functionality and flexibility for a large range of laser systems.


title: Ferroelectricity Driven by Orbital Resonance of Protons in CH$_3$NH$_3$Cl and CH$_3$NH$_3$Br

abstract: The $\beta$ and $\gamma$ phases of methylammonium chloride CH$_3$NH$_3$Cl and methylammonium bromide CH$_3$NH$_3$Br are identified to be ferroelectric $via$ pyroelectric current and dielectric constant measurements. The magnetic susceptibility also exhibits pronounced discontinuities at the Curie temperatures. We attribute the origin of spontaneous polarization to the emergence of two groups of proton orbital magnetic moments from the uncorrelated motion of the CH$_3$ and NH$_3$ groups in the $\beta$ and $\gamma$ phases. The two inequivalent frameworks of intermolecular orbital resonances interact with each other to distort the lattice in a non-centrosymmetric fashion. Our findings indicate that the structural instabilities in molecular frameworks are magnetic in origin as well as provide a new pathway toward uncovering new organic ferroelectrics.


title: Combining RL and IL using a dynamic, performance-based modulation over learning signals and its application to local planning

abstract: This paper proposes a method to combine reinforcement learning (RL) and imitation learning (IL) using a dynamic, performance-based modulation over learning signals. The proposed method combines RL and behavioral cloning (IL), or corrective feedback in the action space (interactive IL/IIL), by dynamically weighting the losses to be optimized, taking into account the backpropagated gradients used to update the policy and the agent's estimated performance. In this manner, RL and IL/IIL losses are combined by equalizing their impact on the policy's updates, while modulating said impact such that IL signals are prioritized at the beginning of the learning process, and as the agent's performance improves, the RL signals become progressively more relevant, allowing for a smooth transition from pure IL/IIL to pure RL. The proposed method is used to learn local planning policies for mobile robots, synthesizing IL/IIL signals online by means of a scripted policy. An extensive evaluation of the application of the proposed method to this task is performed in simulations, and it is empirically shown that it outperforms pure RL in terms of sample efficiency (achieving the same level of performance in the training environment utilizing approximately 4 times less experiences), while consistently producing local planning policies with better performance metrics (achieving an average success rate of 0.959 in an evaluation environment, outperforming pure RL by 12.5% and pure IL by 13.9%). Furthermore, the obtained local planning policies are successfully deployed in the real world without performing any major fine tuning. The proposed method can extend existing RL algorithms, and is applicable to other problems for which generating IL/IIL signals online is feasible. A video summarizing some of the real world experiments that were conducted can be found in https://youtu.be/mZlaXn9WGzw.


title: Receptivity of a supersonic jet due to acoustic excitations near the nozzle lip

abstract: In this paper, we develop an analytical model to investigate the generation of instability waves triggered by the upstream acoustic forcing near the nozzle lip of a supersonic jet. This represents an important stage, i.e. the jet receptivity, of the screech feedback loop. The upstream acoustic forcing, resulting from the shock-instability interaction, reaches the nozzle lip and excites new shear-layer instability waves. To obtain the newly-excited instability wave, we first determine the scattered sound field due to the upstream forcing using the Wiener-Hopf technique, with the kernel function factored using asymptotic expansions and overlapping approximations. Subsequently, the unsteady Kutta condition is imposed at the nozzle lip, enabling the derivation of the dispersion relation for the newly-excited instability wave. A linear transfer function between the upstream forcing and the newly-excited instability wave is obtained. We calculate the amplitude and phase delay in this receptivity process and examine their variations against the frequency. The phase delay enables us to re-evaluate the phase condition for jet screech and propose a new frequency prediction model. The new model shows improved agreement between the predicted screech frequencies and the experimental data compared to classical models. It is hoped that this model may help in developing a full screech model.


title: Reassessment of the dipole in the distribution of quasars on the sky

abstract: We investigate claims of an anomalously large amplitude of the dipole in the distribution of quasars on the sky. Two main issues indicate that the systematic uncertainties in the derived quasar-density dipole are underestimated. Firstly, the spatial distribution of the quasars is not a pure dipole, possessing low-order multipoles of comparable size to the dipole. These multipoles are unexpected and presumably caused by unknown systematic effects; we cannot be confident that the dipole amplitude is not also affected by the same systematics until the origin of these fluctuations is understood. Secondly, the 50 percent sky cut associated with the quasar catalogue strongly couples the multipoles, meaning that the power estimate at ell=1 contains significant contributions from ell>1. In particular, the dominant quadrupole mode in the Galactic mask strongly couples the dipole with the octupole, leading to a large uncertainty in the dipole amplitude. Together these issues mean that the dipole in the quasar catalogue has an uncertainty large enough that consistency with the cosmic microwave background (CMB) dipole cannot be ruled out. More generally, current data sets are insufficiently clean to robustly measure the quasar dipole and future studies will require samples that are larger (preferably covering more of the sky) and free of systematic effects to make strong claims regarding their consistency with the CMB dipole.


title: Fusion Intelligence: Confluence of Natural and Artificial Intelligence for Enhanced Problem-Solving Efficiency

abstract: This paper introduces Fusion Intelligence (FI), a bio-inspired intelligent system, where the innate sensing, intelligence and unique actuation abilities of biological organisms such as bees and ants are integrated with the computational power of Artificial Intelligence (AI). This interdisciplinary field seeks to create systems that are not only smart but also adaptive and responsive in ways that mimic the nature. As FI evolves, it holds the promise of revolutionizing the way we approach complex problems, leveraging the best of both biological and digital worlds to create solutions that are more effective, sustainable, and harmonious with the environment. We demonstrate FI's potential to enhance agricultural IoT system performance through a simulated case study on improving insect pollination efficacy (entomophily).


title: Clearing time randomization and transaction fees for auction market design

abstract: Flaws of a continuous limit order book mechanism raise the question of whether a continuous trading session and a periodic auction session would bring better efficiency. This paper wants to go further in designing a periodic auction when both a continuous market and a periodic auction market are available to traders. In a periodic auction, we discover that a strategic trader could take advantage of the accumulated information available along the auction duration by arriving at the latest moment before the auction closes, increasing the price impact on the market. Such price impact moves the clearing price away from the efficient price and may disturb the efficiency of a periodic auction market. We thus propose and quantify the effect of two remedies to mitigate these flaws: randomizing the auction's closing time and optimally designing a transaction fees policy. Our results show that these policies encourage a strategic trader to send their orders earlier to enhance the efficiency of the auction market, illustrated by data extracted from Alphabet and Apple stocks.


title: Unsupervised Extractive Dialogue Summarization in Hyperdimensional Space

abstract: We present HyperSum, an extractive summarization framework that captures both the efficiency of traditional lexical summarization and the accuracy of contemporary neural approaches. HyperSum exploits the pseudo-orthogonality that emerges when randomly initializing vectors at extremely high dimensions ("blessing of dimensionality") to construct representative and efficient sentence embeddings. Simply clustering the obtained embeddings and extracting their medoids yields competitive summaries. HyperSum often outperforms state-of-the-art summarizers -- in terms of both summary accuracy and faithfulness -- while being 10 to 100 times faster. We open-source HyperSum as a strong baseline for unsupervised extractive summarization.


title: A note on continuity and consistency of measures of risk and variability

abstract: In this short note, we show that every convex, order bounded above functional on a Banach lattice is automatically norm continuous. This improves a result in \cite{RS06} and applies to many deviation and variability measures. We also show that an order-continuous, law-invariant functional on an Orlicz space is strongly consistent everywhere, extending a result in \cite{KSZ14}.


title: Compact quantum algorithms that can potentially maintain quantum advantage for solving time-dependent differential equations

abstract: Many claims of computational advantages have been made for quantum computing over classical, but they have not been demonstrated for practical problems. Here, we present algorithms for solving time-dependent PDEs governing fluid flow problems. We build on an idea based on linear combination of unitaries to simulate non-unitary, non-Hermitian quantum systems, and generate hybrid quantum-classical algorithms that efficiently perform iterative matrix-vector multiplication and matrix inversion operations. These algorithms lead to low-depth quantum circuits that protect quantum advantage, with the best-case asymptotic complexities that are near-optimal. We demonstrate the performance of the algorithms by conducting: (a) ideal state-vector simulations using an in-house, high performance, quantum simulator called $\textit{QFlowS}$; (b) experiments on a real quantum device (IBM Cairo); and (c) noisy simulations using Qiskit Aer. We also provide device specifications such as error-rates (noise) and state sampling (measurement) to accurately perform convergent flow simulations on noisy devices.

categories: quant-ph physics.app-ph physics.comp-ph physics.flu-dyn


title: Evaluating Text-to-Speech Synthesis from a Large Discrete Token-based Speech Language Model

abstract: Recent advances in generative language modeling applied to discrete speech tokens presented a new avenue for text-to-speech (TTS) synthesis. These speech language models (SLMs), similarly to their textual counterparts, are scalable, probabilistic, and context-aware. While they can produce diverse and natural outputs, they sometimes face issues such as unintelligibility and the inclusion of non-speech noises or hallucination. As the adoption of this innovative paradigm in speech synthesis increases, there is a clear need for an in-depth evaluation of its capabilities and limitations. In this paper, we evaluate TTS from a discrete token-based SLM, through both automatic metrics and listening tests. We examine five key dimensions: speaking style, intelligibility, speaker consistency, prosodic variation, spontaneous behaviour. Our results highlight the model's strength in generating varied prosody and spontaneous outputs. It is also rated higher in naturalness and context appropriateness in listening tests compared to a conventional TTS. However, the model's performance in intelligibility and speaker consistency lags behind traditional TTS. Additionally, we show that increasing the scale of SLMs offers a modest boost in robustness. Our findings aim to serve as a benchmark for future advancements in generative SLMs for speech synthesis.


title: The metallicity and carbon-to-oxygen ratio of the ultra-hot Jupiter WASP-76b from Gemini-S/IGRINS

abstract: Measurements of the carbon-to-oxygen (C/O) ratios of exoplanet atmospheres can reveal details about their formation and evolution. Recently, high-resolution cross-correlation analysis has emerged as a method of precisely constraining the C/O ratios of hot Jupiter atmospheres. We present two transits of the ultra-hot Jupiter WASP-76b observed between 1.4-2.4 $\mu$m with Gemini-S/IGRINS. We detected the presence of H$_{2}$O, CO, and OH at signal-to-noise ratios of 6.93, 6.47, and 3.90, respectively. We performed two retrievals on this data set. A free retrieval for abundances of these three species retrieved a volatile metallicity of $\left[\frac{\mathrm{C}+\mathrm{O}} {\mathrm{H}}\right]=-0.70^{+1.27}_{-0.93}$, consistent with the stellar value, and a super-solar carbon-to-oxygen ratio of C/O$=0.80^{+0.07}_{-0.11}$. We also ran a chemically self-consistent grid retrieval, which agreed with the free retrieval within $1\sigma$ but favored a slightly more sub-stellar metallicity and solar C/O ratio ($\left[\frac{\mathrm{C}+\mathrm{O}} {\mathrm{H}}\right]=-0.74^{+0.23}_{-0.17}$ and C/O$=0.59^{+0.13}_{-0.14}$). A variety of formation pathways may explain the composition of WASP-76b. Additionally, we found systemic ($V_{sys}$) and Keplerian ($K_{p}$) velocity offsets which were broadly consistent with expectations from 3D general circulation models of WASP-76b, with the exception of a redshifted $V_{sys}$ for H$_{2}$O. Future observations to measure the phase-dependent velocity offsets and limb differences at high resolution on WASP-76b will be necessary to understand the H$_{2}$O velocity shift. Finally, we find that the population of exoplanets with precisely constrained C/O ratios generally trends toward super-solar C/O ratios. More results from high-resolution observations or JWST will serve to further elucidate any population-level trends.


title: Optimization Techniques for Sentiment Analysis Based on LLM (GPT-3)

abstract: With the rapid development of natural language processing (NLP) technology, large-scale pre-trained language models such as GPT-3 have become a popular research object in NLP field. This paper aims to explore sentiment analysis optimization techniques based on large pre-trained language models such as GPT-3 to improve model performance and effect and further promote the development of natural language processing (NLP). By introducing the importance of sentiment analysis and the limitations of traditional methods, GPT-3 and Fine-tuning techniques are introduced in this paper, and their applications in sentiment analysis are explained in detail. The experimental results show that the Fine-tuning technique can optimize GPT-3 model and obtain good performance in sentiment analysis task. This study provides an important reference for future sentiment analysis using large-scale language models.


title: Harmonizing Generalization and Personalization in Federated Prompt Learning

abstract: Federated Prompt Learning (FPL) incorporates large pre-trained Vision-Language models (VLM) into federated learning through prompt tuning. The transferable representations and remarkable generalization capacity of VLM make them highly compatible with the integration of federated learning. Addressing data heterogeneity in federated learning requires personalization, but excessive focus on it across clients could compromise the model's ability to generalize effectively. To preserve the impressive generalization capability of VLM, it is crucial to strike a balance between personalization and generalization in FPL. To tackle this challenge, we proposed Federated Prompt Learning with CLIP Generalization and low-rank Personalization (FedPGP), which employs pre-trained CLIP to provide knowledge-guidance on the global prompt for improved generalization and incorporates a low-rank adaptation term to personalize the global prompt. Further, FedPGP integrates a prompt-wise contrastive loss to achieve knowledge guidance and personalized adaptation simultaneously, enabling a harmonious balance between personalization and generalization in FPL. We conduct extensive experiments on various datasets to explore base-to-novel generalization in both category-level and domain-level scenarios with heterogeneous data, showing the superiority of FedPGP in balancing generalization and personalization.


title: Energy dependence of the low-frequency quasi-periodic oscillations in Swift J1727.8-1613

abstract: Based on observations from the Insight-Hard X-ray Modulation Telescope (Insight-HXMT), an analysis of Type-C quasi-periodic oscillations (QPOs) observed during the outburst of the new black hole candidate Swift J1727.8-1613 in 2023 was conducted. This analysis scrutinized the QPO's evolution throughout the outburst, particularly noting its rapid frequency escalation during two flare events. Utilizing the energy range covered by Insight-HXMT, a dependency of the QPO frequency on energy was observed. Below approximately 3 Hz, minimal variations in frequency with energy were noted, whereas clear variations with photon energy were observed when it exceeded approximately 3 Hz. Additionally, a sharp drop in the rate of change was observed when the frequency exceeded approximately 8 Hz. This behavior, similar to several previously reported sources, suggests the presence of a common underlying physical mechanism. Moreover, the QPO rms-frequency relationship can be explained by the Lense-Thirring precession model. The relationship between rms-energy and phase lag with frequency suggests the black hole system as a high-inclination source.


title: Advanced Tokamak: The Strongly Reversed Central Magnetic Shear Profile

abstract: This review article will offer a qualitative overview of the strongly reversed shear profile for steady-state operation in tokamaks. For a steady-state reactor to be commercially viable, it is necessary to have a large bootstrap fraction. Currently, there appears great potential in an Advanced Tokamak (AT) regime, namely the hollow current profile (strongly reversed shear). This mode is characterized by high poloidal beta, broad current profiles, strong internal and edge pressure gradients, and relatively good magnetohydrodynamic (MHD) stability against Neoclassical Tearing Modes (NTMs) and ballooning modes. The n=1 and n=2 kink modes, resistive wall modes, and double tearing modes are of concern in the reversed shear profile, and avoidance and/or suppression of these modes is necessary. Although there is a relatively low net plasma current in the reversed shear, the regime appears to have excellent energy confinement properties due to the naturally occurring Internal Transport Barriers (ITBs) caused by the substantial bootstrap currents, and Edge Transport Barriers (ETBs), which can form from ELM-free H-Mode (QH-Mode), to form the Quiescent Double Barrier (QDBs). The reversed shear can be generated by freezing the current profile, through MHD effects or substantial heating and/or current drive during the current ramp up phase, and is sustained by off-axis non-inductive current drive sources, such as the Neutral Beam Current Drive (NBCD), Lower Hybrid Current Drive (LHCD), and Helicon Current Drive (HCD). Experimental results by DIII-D, JT-60U, ASDEX Upgrade, JET, PBX-M, COMPASS-D, and K-STAR, simulation models and codes, such as Lower Hybrid Simulation and STELION, and theoretical reactors, such as ARIES-RS, ARIES-AT and SSTR are referenced.


title: The effect of temperature oscillations on energy storage rectification in harmonic systems

abstract: Rectification, the preferential transport of a current in one direction through a system, has garnered significant attention in molecules because of its importance for controlling thermal and electronic currents at the nanoscale. Here, we report the presence of energy storage rectification effects in a molecular chain. This phenomenon is generated by subjecting a harmonic molecular chain to an oscillating temperature gradient and showing that the energy absorption rate of the system depends on the direction of the gradient. We examine how the energy storage rectification ratios in the chain are affected by the oscillating gradient, asymmetry in the chain, and the system parameters. We find that energy storage rectification can be observed in harmonic lattice structures with time-dependent temperatures and that, correspondingly, anharmonicity is not required to generate this rectification mechanism in such systems.


title: Some exact constants for bilateral approximations in quasi-normed groups

abstract: We establish inverse and direct theorems on best approximations in quasi-normed Abelian groups through bilateral Bernstein-Jackson inequalities with exact constants. Using integral representations for quasi-norms of functions $f$ in Lebesgue's spaces by decreasing rearrangements $f^*$ with the help of approximation $E$-functionals, error estimates are found. Examples of numerical calculations and spectral approximations of self-adjoint operators obtained by obtained estimates are given.


title: Magnetic structure and magnetoelectric coupling in antiferromagnet Co5(TeO3)4Cl2

abstract: The van der Waals (vdW) layered multiferroics, which host simultaneous ferroelectric and magnetic orders, have attracted attention not only for their potentials to be utilized in nanoelectric devices and spintronics, but also offer alternative opportunities for emergent physical phenomena. To date, the vdW layered multiferroic materials are still very rare. In this work, we have investigated the magnetic structure and magnetoelectric effects in Co5(TeO3)4Cl2, a promising new multiferroic compound with antiferromagnetic (AFM) Neel point TN = 18 K. The neutron powder diffraction reveals the non-coplanar AFM state with preferred Neel vector along the c-axis, while a spin re-orientation occurring between 8 K and 15 K is identified, which results from the distinct temperature dependence of the non-equivalent Co sites moment in Co5(TeO3)4Cl2. What is more, it is found that Co5(TeO3)4Cl2 is one of the best vdW multiferroics studied so far in terms of the multiferroic performance. The measured linear ME coefficient exhibits the emergent oscillation dependence of the angle between magnetic field and electric field, and the maximal value is as big as 45 ps/m. It is suggested that Co5(TeO3)4Cl2 is an appreciated platform for exploring the emergent multiferroicity in vdW layered compounds.


title: Rethinking Barely-Supervised Segmentation from an Unsupervised Domain Adaptation Perspective

abstract: This paper investigates an extremely challenging problem, barely-supervised medical image segmentation (BSS), where the training dataset comprises limited labeled data with only single-slice annotations and numerous unlabeled images. Currently, state-of-the-art (SOTA) BSS methods utilize a registration-based paradigm, depending on image registration to propagate single-slice annotations into volumetric pseudo labels for constructing a complete labeled set. However, this paradigm has a critical limitation: the pseudo labels generated by image registration are unreliable and noisy. Motivated by this, we propose a new perspective: training a model using only single-annotated slices as the labeled set without relying on image registration. To this end, we formulate BSS as an unsupervised domain adaptation (UDA) problem. Specifically, we first design a novel noise-free labeled data construction algorithm (NFC) for slice-to-volume labeled data synthesis, which may result in a side effect: domain shifts between the synthesized images and the original images. Then, a frequency and spatial mix-up strategy (FSX) is further introduced to mitigate the domain shifts for UDA. Extensive experiments demonstrate that our method provides a promising alternative for BSS. Remarkably, the proposed method with only one labeled slice achieves an 80.77% dice score on left atrial segmentation, outperforming the SOTA by 61.28%. The code will be released upon the publication of this paper.


title: Beam Pattern Modulation Embedded Hybrid Transceiver Optimization for Integrated Sensing and Communication

abstract: Integrated sensing and communication (ISAC) emerges as a promising technology for B5G/6G, particularly in the millimeter-wave (mmWave) band. However, the widely utilized hybrid architecture in mmWave systems compromises multiplexing gain due to the constraints of limited radio frequency chains. Moreover, additional sensing functionalities exacerbate the impairment of spectrum efficiency (SE). In this paper, we present an optimized beam pattern modulation-embedded ISAC (BPM-ISAC) transceiver design, which spares one RF chain for sensing and the others for communication. To compensate for the reduced SE, index modulation across communication beams is applied. We formulate an optimization problem aimed at minimizing the mean squared error (MSE) of the sensing beampattern, subject to a symbol MSE constraint. This problem is then solved by sequentially optimizing the analog and digital parts. Both the multi-aperture structure (MAS) and the multi-beam structure (MBS) are considered for the design of the analog part. We conduct theoretical analysis on the asymptotic pairwise error probability (APEP) and the Cram\'er-Rao bound (CRB) of direction of arrival (DoA) estimation. Numerical simulations validate the overall enhanced ISAC performance over existing alternatives.


title: Integrating Uncertainty-Aware Human Motion Prediction into Graph-Based Manipulator Motion Planning

abstract: There has been a growing utilization of industrial robots as complementary collaborators for human workers in re-manufacturing sites. Such a human-robot collaboration (HRC) aims to assist human workers in improving the flexibility and efficiency of labor-intensive tasks. In this paper, we propose a human-aware motion planning framework for HRC to effectively compute collision-free motions for manipulators when conducting collaborative tasks with humans. We employ a neural human motion prediction model to enable proactive planning for manipulators. Particularly, rather than blindly trusting and utilizing predicted human trajectories in the manipulator planning, we quantify uncertainties of the neural prediction model to further ensure human safety. Moreover, we integrate the uncertainty-aware prediction into a graph that captures key workspace elements and illustrates their interconnections. Then a graph neural network is leveraged to operate on the constructed graph. Consequently, robot motion planning considers both the dependencies among all the elements in the workspace and the potential influence of future movements of human workers. We experimentally validate the proposed planning framework using a 6-degree-of-freedom manipulator in a shared workspace where a human is performing disassembling tasks. The results demonstrate the benefits of our approach in terms of improving the smoothness and safety of HRC. A brief video introduction of this work is available as the supplemental materials.


title: EFEAR-4D: Ego-Velocity Filtering for Efficient and Accurate 4D radar Odometry

abstract: Odometry is a crucial component for successfully implementing autonomous navigation, relying on sensors such as cameras, LiDARs and IMUs. However, these sensors may encounter challenges in extreme weather conditions, such as snowfall and fog. The emergence of FMCW radar technology offers the potential for robust perception in adverse conditions. As the latest generation of FWCW radars, the 4D mmWave radar provides point cloud with range, azimuth, elevation, and Doppler velocity information, despite inherent sparsity and noises in the point cloud. In this paper, we propose EFEAR-4D, an accurate, highly efficient, and learning-free method for large-scale 4D radar odometry estimation. EFEAR-4D exploits Doppler velocity information delicately for robust ego-velocity estimation, resulting in a highly accurate prior guess. EFEAR-4D maintains robustness against point-cloud sparsity and noises across diverse environments through dynamic object removal and effective region-wise feature extraction. Extensive experiments on two publicly available 4D radar datasets demonstrate state-of-the-art reliability and localization accuracy of EFEAR-4D under various conditions. Furthermore, we have collected a dataset following the same route but varying installation heights of the 4D radar, emphasizing the significant impact of radar height on point cloud quality - a crucial consideration for real-world deployments. Our algorithm and dataset will be available soon at https://github.com/CLASS-Lab/EFEAR-4D.


title: An Independent Implementation of Quantum Machine Learning Algorithms in Qiskit for Genomic Data

abstract: In this paper, we explore the power of Quantum Machine Learning as we extend, implement and evaluate algorithms like Quantum Support Vector Classifier (QSVC), Pegasos-QSVC, Variational Quantum Circuits (VQC), and Quantum Neural Networks (QNN) in Qiskit with diverse feature mapping techniques for genomic sequence classification.


title: Size-invariance Matters: Rethinking Metrics and Losses for Imbalanced Multi-object Salient Object Detection

abstract: This paper explores the size-invariance of evaluation metrics in Salient Object Detection (SOD), especially when multiple targets of diverse sizes co-exist in the same image. We observe that current metrics are size-sensitive, where larger objects are focused, and smaller ones tend to be ignored. We argue that the evaluation should be size-invariant because bias based on size is unjustified without additional semantic information. In pursuit of this, we propose a generic approach that evaluates each salient object separately and then combines the results, effectively alleviating the imbalance. We further develop an optimization framework tailored to this goal, achieving considerable improvements in detecting objects of different sizes. Theoretically, we provide evidence supporting the validity of our new metrics and present the generalization analysis of SOD. Extensive experiments demonstrate the effectiveness of our method. The code is available at https://github.com/Ferry-Li/SI-SOD.


title: LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery

abstract: Large Language Models have recently gained significant attention in scientific discovery for their extensive knowledge and advanced reasoning capabilities. However, they encounter challenges in effectively simulating observational feedback and grounding it with language to propel advancements in physical scientific discovery. Conversely, human scientists undertake scientific discovery by formulating hypotheses, conducting experiments, and revising theories through observational analysis. Inspired by this, we propose to enhance the knowledge-driven, abstract reasoning abilities of LLMs with the computational strength of simulations. We introduce Scientific Generative Agent (SGA), a bilevel optimization framework: LLMs act as knowledgeable and versatile thinkers, proposing scientific hypotheses and reason about discrete components, such as physics equations or molecule structures; meanwhile, simulations function as experimental platforms, providing observational feedback and optimizing via differentiability for continuous parts, such as physical parameters. We conduct extensive experiments to demonstrate our framework's efficacy in constitutive law discovery and molecular design, unveiling novel solutions that differ from conventional human expectations yet remain coherent upon analysis.


title: Online bipartite matching with imperfect advice

abstract: We study the problem of online unweighted bipartite matching with $n$ offline vertices and $n$ online vertices where one wishes to be competitive against the optimal offline algorithm. While the classic RANKING algorithm of Karp et al. [1990] provably attains competitive ratio of $1-1/e > 1/2$, we show that no learning-augmented method can be both 1-consistent and strictly better than $1/2$-robust under the adversarial arrival model. Meanwhile, under the random arrival model, we show how one can utilize methods from distribution testing to design an algorithm that takes in external advice about the online vertices and provably achieves competitive ratio interpolating between any ratio attainable by advice-free methods and the optimal ratio of 1, depending on the advice quality.


title: Interference between distinguishable photons

abstract: Two-photon interference (TPI) lies at the heart of photonic quantum technologies. TPI is generally regarded as quantum interference stemming from the indistinguishability of identical photons, hence a common intuition prevails that TPI would disappear if photons are distinguishable. Here we disprove this perspective and uncover the essence of TPI. We report the first demonstration of TPI between distinguishable photons with their frequency separation up to $10^4$ times larger than their linewidths. We perform time-resolved TPI between an independent laser and single photons with ultralong coherence time ($>10\ \mu$s). We observe a maximum TPI visibility of $72\%\pm 2\%$ well above the $50\%$ classical limit indicating the quantum feature, and simultaneously a broad visibility background and a classical beat visibility of less than $50\%$ reflecting the classical feature. These visibilities are independent of the photon frequency separation and show no difference between distinguishable and indistinguishable photons. Based on a general wave superposition model, we derive the cross-correlation functions which fully reproduce and explain the experiments. Our results reveal that TPI as the fourth-order interference arises from the second-order interference of two photons within the mutual coherence time and TPI is not linked to the photon indistinguishability. This work provides new insights into the nature of TPI with great implications in both quantum optics and photonic quantum technologies.


title: IBD-PSC: Input-level Backdoor Detection via Parameter-oriented Scaling Consistency

abstract: Deep neural networks (DNNs) are vulnerable to backdoor attacks, where adversaries can maliciously trigger model misclassifications by implanting a hidden backdoor during model training. This paper proposes a simple yet effective input-level backdoor detection (dubbed IBD-PSC) as a `firewall' to filter out malicious testing images. Our method is motivated by an intriguing phenomenon, i.e., parameter-oriented scaling consistency (PSC), where the prediction confidences of poisoned samples are significantly more consistent than those of benign ones when amplifying model parameters. In particular, we provide theoretical analysis to safeguard the foundations of the PSC phenomenon. We also design an adaptive method to select BN layers to scale up for effective detection. Extensive experiments are conducted on benchmark datasets, verifying the effectiveness and efficiency of our IBD-PSC method and its resistance to adaptive attacks. Codes are available at \href{https://github.com/THUYimingLi/BackdoorBox}{BackdoorBox}.


title: Analysis of the BraTS 2023 Intracranial Meningioma Segmentation Challenge

abstract: We describe the design and results from the BraTS 2023 Intracranial Meningioma Segmentation Challenge. The BraTS Meningioma Challenge differed from prior BraTS Glioma challenges in that it focused on meningiomas, which are typically benign extra-axial tumors with diverse radiologic and anatomical presentation and a propensity for multiplicity. Nine participating teams each developed deep-learning automated segmentation models using image data from the largest multi-institutional systematically expert annotated multilabel multi-sequence meningioma MRI dataset to date, which included 1000 training set cases, 141 validation set cases, and 283 hidden test set cases. Each case included T2, T2/FLAIR, T1, and T1Gd brain MRI sequences with associated tumor compartment labels delineating enhancing tumor, non-enhancing tumor, and surrounding non-enhancing T2/FLAIR hyperintensity. Participant automated segmentation models were evaluated and ranked based on a scoring system evaluating lesion-wise metrics including dice similarity coefficient (DSC) and 95% Hausdorff Distance. The top ranked team had a lesion-wise median dice similarity coefficient (DSC) of 0.976, 0.976, and 0.964 for enhancing tumor, tumor core, and whole tumor, respectively and a corresponding average DSC of 0.899, 0.904, and 0.871, respectively. These results serve as state-of-the-art benchmarks for future pre-operative meningioma automated segmentation algorithms. Additionally, we found that 1286 of 1424 cases (90.3%) had at least 1 compartment voxel abutting the edge of the skull-stripped image edge, which requires further investigation into optimal pre-processing face anonymization steps.


title: Synthesizing Proteins on the Graphics Card. Protein Folding and the Limits of Critical AI Studies

abstract: This paper investigates the application of the transformer architecture in protein folding, as exemplified by DeepMind's AlphaFold project, and its implications for the understanding of large language models as models of language. The prevailing discourse often assumes a ready-made analogy between proteins -- encoded as sequences of amino acids -- and natural language -- encoded as sequences of discrete symbols. Instead of assuming as given the linguistic structure of proteins, we critically evaluate this analogy to assess the kind of knowledge-making afforded by the transformer architecture. We first trace the analogy's emergence and historical development, carving out the influence of structural linguistics on structural biology beginning in the mid-20th century. We then examine three often overlooked pre-processing steps essential to the transformer architecture, including subword tokenization, word embedding, and positional encoding, to demonstrate its regime of representation based on continuous, high-dimensional vector spaces, which departs from the discrete, semantically demarcated symbols of language. The successful deployment of transformers in protein folding, we argue, discloses what we consider a non-linguistic approach to token processing intrinsic to the architecture. We contend that through this non-linguistic processing, the transformer architecture carves out unique epistemological territory and produces a new class of knowledge, distinct from established domains. We contend that our search for intelligent machines has to begin with the shape, rather than the place, of intelligence. Consequently, the emerging field of critical AI studies should take methodological inspiration from the history of science in its quest to conceptualize the contributions of artificial intelligence to knowledge-making, within and beyond the domain-specific sciences.


title: LeMeViT: Efficient Vision Transformer with Learnable Meta Tokens for Remote Sensing Image Interpretation

abstract: Due to spatial redundancy in remote sensing images, sparse tokens containing rich information are usually involved in self-attention (SA) to reduce the overall token numbers within the calculation, avoiding the high computational cost issue in Vision Transformers. However, such methods usually obtain sparse tokens by hand-crafted or parallel-unfriendly designs, posing a challenge to reach a better balance between efficiency and performance. Different from them, this paper proposes to use learnable meta tokens to formulate sparse tokens, which effectively learn key information meanwhile improving the inference speed. Technically, the meta tokens are first initialized from image tokens via cross-attention. Then, we propose Dual Cross-Attention (DCA) to promote information exchange between image tokens and meta tokens, where they serve as query and key (value) tokens alternatively in a dual-branch structure, significantly reducing the computational complexity compared to self-attention. By employing DCA in the early stages with dense visual tokens, we obtain the hierarchical architecture LeMeViT with various sizes. Experimental results in classification and dense prediction tasks show that LeMeViT has a significant $1.7 \times$ speedup, fewer parameters, and competitive performance compared to the baseline models, and achieves a better trade-off between efficiency and performance.


title: Supermassive black hole formation from Affleck-Dine mechanism with suppressed clustering on large scales

abstract: We study a primordial black hole (PBH) formation model based on the framework of the inhomogeneous Affleck-Dine (AD) mechanism, which can explain the seeds of supermassive black holes (SMBHs). This model, however, predicts strong clustering of SMBHs that is inconsistent with the observation of angular correlation of quasars. In this paper, we propose a modified model that can significantly reduce the PBH clustering on large scales by considering a time-dependent Hubble-induced mass during inflation. The quasar angular correlation is suppressed by the large Hubble-induced mass in the early stage of inflation while the small Hubble-induced mass in the late stage leads to the AD field fluctuations large enough for PBH formation as in the original model. As a result, the modified scenario can successfully explain the seeds of SMBHs.


title: Challenging theories of dark energy with levitated force sensor

abstract: The nature of dark energy is one of the most outstanding problems in physical science, and various theories have been proposed. It is therefore essential to directly verify or rule out these theories experimentally. However, despite substantial efforts in astrophysical observations and laboratory experiments, previous tests have not yet acquired enough accuracy to provide decisive conclusions as to the validity of these theories. Here, using a diamagnetically levitated force sensor, we carry out a test on one of the most compelling explanations for dark energy to date, namely the Chameleon theory, an ultra-light scalar field with screening mechanisms, which couples to normal-matter fields and leaves a detectable fifth force. Our results extend previous results by nearly two orders of magnitude to the entire physical plausible parameter space of cosmologically viable chameleon models. We find no evidence for such a fifth force. Our results decisively rule out the basic chameleon model as a candidate for dark energy. Our work, thus, demonstrates the robustness of laboratory experiments in unveiling the nature of dark energy in the future. The methodology developed here can be further applied to study a broad range of fundamental physics.


title: CMOS-compatible Strain Engineering for High-Performance Monolayer Semiconductor Transistors

abstract: Strain engineering has played a key role in modern silicon electronics, having been introduced as a mobility booster in the 1990s and commercialized in the early 2000s. Achieving similar advances with two-dimensional (2D) semiconductors in a CMOS (complementary metal oxide semiconductor) compatible manner would radically improve the industrial viability of 2D transistors. Here, we show silicon nitride capping layers can impart strain to monolayer MoS2 transistors on conventional silicon substrates, enhancing their electrical performance with a low thermal budget (350 {\deg}C), CMOS-compatible approach. Strained back-gated and dual-gated MoS2 transistors demonstrate median increases up to 60% and 45% in on-state current, respectively. The greatest improvements are found when both transistor channels and contacts are reduced to ~200 nm, reaching saturation currents of 488 uA/um, higher than any previous reports at such short contact pitch. Simulations reveal that most benefits arise from tensile strain lowering the contact Schottky barriers, and that further reducing device dimensions (including contacts) will continue to offer increased strain and performance improvements.


title: Assessing carrier mobility, dopability, and defect tolerance in the chalcogenide perovskite BaZrS$_3$

abstract: The chalcogenide perovskite BaZrS$_3$ has attracted much attention as a promising solar absorber for thin-film photovoltaics. Here, we use first-principles calculations to evaluate its carrier transport and defect properties. We find that BaZrS$_3$ has a phonon-limited electron mobility of 37 cm$^2$/Vs comparable to that in halide perovskites but lower hole mobility of 11 cm$^2$/Vs. The defect computations indicate that BaZrS$_3$ is intrinsically n-type due to shallow sulfur vacancies, but that strong compensation by sulfur vacancies will prevent attempts to make it p-type. We also establish that BaZrS$_3$ is a defect-tolerant absorber with few low formation energy, deep intrinsic defects. Among the deep defects, sulfur interstitials are the strongest nonradiative recombination centers which in sulfur-rich conditions would limit the carrier lifetime to 10 ns. Our work highlights the material's intrinsic limitations in carrier mobility and suggests suppressing the formation of sulfur interstitials to reach long carrier lifetime.


title: Human-AI Safety: A Descendant of Generative AI and Control Systems Safety

abstract: Artificial intelligence (AI) is interacting with people at an unprecedented scale, offering new avenues for immense positive impact, but also raising widespread concerns around the potential for individual and societal harm. Today, the predominant paradigm for human--AI safety focuses on fine-tuning the generative model's outputs to better agree with human-provided examples or feedback. In reality, however, the consequences of an AI model's outputs cannot be determined in isolation: they are tightly entangled with the responses and behavior of human users over time. In this paper, we distill key complementary lessons from AI safety and control systems safety, highlighting open challenges as well as key synergies between both fields. We then argue that meaningful safety assurances for advanced AI technologies require reasoning about how the feedback loop formed by AI outputs and human behavior may drive the interaction towards different outcomes. To this end, we introduce a unifying formalism to capture dynamic, safety-critical human--AI interactions and propose a concrete technical roadmap towards next-generation human-centered AI safety.


title: Attainability of the best constant of Hardy-Sobolev inequality with full boundary singularities

abstract: We consider a type of Hardy-Sobolev inequality, whose weight function is singular on the whole domain boundary. We are concerned with the attainability of the best constant of such inequality. In dimension two, we link the inequality to a conformally invariant one using the conformal radius of the domain. The best constant of such inequality on a smooth bounded domain is achieved if and only if the domain is non-convex. In higher dimensions, the best constant is achieved if the domain has negative mean curvature somewhere. If the mean curvature vanishes but is non-umbilic somewhere, we also establish the attainability for some special cases. In the other direction, we also show the best constant is not achieved if the domain is sufficiently close to a ball in $C^2$ sense.


title: Prototype Design of a Digital Low-level RF System for S-band Deflectors

abstract: S-band deflectors are generally operated on pulsed mode for beam diagnosis. We plan to deploy 5 S-band (2997 MHz) deflectors to accurately measure the longitudinal time distribution of ultra-short electron beam pulses in Shenzhen Superconducting Soft X-ray Free Electron Laser (S3FEL). A microwave system of one deflector consists of a low-level RF system (LLRF), a solid-state amplifier, waveguide couplers, and a klystron, operated in pulse mode with a maximum repetition frequency of 50 Hz. Its microwave amplitude and phase stability must be better than 0.06%/0.08{\deg} (RMS). This article will introduce the prototype design of the hardware, firmware, and software of the digital LLRF system. We use homemade Local Oscillators (LOs) and commercial cards based on the MicroTCA standard in hardware design. The firmware design will use a Non-IQ demodulation and a pulse feedforward algorithm to suppress noise from high voltage of klystron. The software design is based on the EPICS control system architecture, achieving slow control and interface display functions. This report will also show some preliminary test results.


title: Identification of Single-Treatment Effects in Factorial Experiments

abstract: Despite their cost, randomized controlled trials (RCTs) are widely regarded as gold-standard evidence in disciplines ranging from social science to medicine. In recent decades, researchers have increasingly sought to reduce the resource burden of repeated RCTs with factorial designs that simultaneously test multiple hypotheses, e.g. experiments that evaluate the effects of many medications or products simultaneously. Here I show that when multiple interventions are randomized in experiments, the effect any single intervention would have outside the experimental setting is not identified absent heroic assumptions, even if otherwise perfectly realistic conditions are achieved. This happens because single-treatment effects involve a counterfactual world with a single focal intervention, allowing other variables to take their natural values (which may be confounded or modified by the focal intervention). In contrast, observational studies and factorial experiments provide information about potential-outcome distributions with zero and multiple interventions, respectively. In this paper, I formalize sufficient conditions for the identifiability of those isolated quantities. I show that researchers who rely on this type of design have to justify either linearity of functional forms or -- in the nonparametric case -- specify with Directed Acyclic Graphs how variables are related in the real world. Finally, I develop nonparametric sharp bounds -- i.e., maximally informative best-/worst-case estimates consistent with limited RCT data -- that show when extrapolations about effect signs are empirically justified. These new results are illustrated with simulated data.


title: Many-Shot In-Context Learning in Multimodal Foundation Models

abstract: Large language models are well-known to be effective at few-shot in-context learning (ICL). Recent advancements in multimodal foundation models have enabled unprecedentedly long context windows, presenting an opportunity to explore their capability to perform ICL with many more demonstrating examples. In this work, we evaluate the performance of multimodal foundation models scaling from few-shot to many-shot ICL. We benchmark GPT-4o and Gemini 1.5 Pro across 10 datasets spanning multiple domains (natural imagery, medical imagery, remote sensing, and molecular imagery) and tasks (multi-class, multi-label, and fine-grained classification). We observe that many-shot ICL, including up to almost 2,000 multimodal demonstrating examples, leads to substantial improvements compared to few-shot (<100 examples) ICL across all of the datasets. Further, Gemini 1.5 Pro performance continues to improve log-linearly up to the maximum number of tested examples on many datasets. Given the high inference costs associated with the long prompts required for many-shot ICL, we also explore the impact of batching multiple queries in a single API call. We show that batching up to 50 queries can lead to performance improvements under zero-shot and many-shot ICL, with substantial gains in the zero-shot setting on multiple datasets, while drastically reducing per-query cost and latency. Finally, we measure ICL data efficiency of the models, or the rate at which the models learn from more demonstrating examples. We find that while GPT-4o and Gemini 1.5 Pro achieve similar zero-shot performance across the datasets, Gemini 1.5 Pro exhibits higher ICL data efficiency than GPT-4o on most datasets. Our results suggest that many-shot ICL could enable users to efficiently adapt multimodal foundation models to new applications and domains. Our codebase is publicly available at https://github.com/stanfordmlgroup/ManyICL .


title: Direct ab initio calculation of the $^{4}$He nuclear electric dipole polarizability

abstract: The calculation of nuclear electromagnetic sum rules by directly diagonalizing the nuclear Hamiltonian in a large basis is numerically challenging and has not been performed for $A>2$ nuclei. With the significant progress of high performance computing, we show that calculating sum rules using numerous discretized continuum states obtained by directly diagonalizing the ab initio no-core shell model Hamiltonian is achievable numerically. Specifically, we calculate the $^{4}$He electric dipole ($E1$) polarizability, that is an inverse energy weighted sum rule, employing the Daejeon16 $NN$ interaction. We demonstrate that the calculations are numerically tractable as the dimension of the basis increases and are convergent. Our results for the $^{4}$He electric dipole polarizability are consistent with the most recent experimental data and are compared with those of other theoretical studies employing different techniques and various interactions.


title: Manifold Integrated Gradients: Riemannian Geometry for Feature Attribution

abstract: In this paper, we dive into the reliability concerns of Integrated Gradients (IG), a prevalent feature attribution method for black-box deep learning models. We particularly address two predominant challenges associated with IG: the generation of noisy feature visualizations for vision models and the vulnerability to adversarial attributional attacks. Our approach involves an adaptation of path-based feature attribution, aligning the path of attribution more closely to the intrinsic geometry of the data manifold. Our experiments utilise deep generative models applied to several real-world image datasets. They demonstrate that IG along the geodesics conforms to the curved geometry of the Riemannian data manifold, generating more perceptually intuitive explanations and, subsequently, substantially increasing robustness to targeted attributional attacks.


title: Lagrangian Covector Fluid with Free Surface

abstract: This paper introduces a novel Lagrangian fluid solver based on covector flow maps. We aim to address the challenges of establishing a robust flow-map solver for incompressible fluids under complex boundary conditions. Our key idea is to use particle trajectories to establish precise flow maps and tailor path integrals of physical quantities along these trajectories to reformulate the Poisson problem during the projection step. We devise a decoupling mechanism based on path-integral identities from flow-map theory. This mechanism integrates long-range flow maps for the main fluid body into a short-range projection framework, ensuring a robust treatment of free boundaries. We show that our method can effectively transform a long-range projection problem with integral boundaries into a Poisson problem with standard boundary conditions -- specifically, zero Dirichlet on the free surface and zero Neumann on solid boundaries. This transformation significantly enhances robustness and accuracy, extending the applicability of flow-map methods to complex free-surface problems.


title: Analysis and Predictive Modeling of Solar Coronal Holes Using Computer Vision and LSTM Networks

abstract: In the era of space exploration, coronal holes on the sun play a significant role due to their impact on satellites and aircraft through their open magnetic fields and increased solar wind emissions. This study employs computer vision techniques to detect coronal hole regions and estimate their sizes using imagery from the Solar Dynamics Observatory (SDO). Additionally, we utilize deep learning methods, specifically Long Short-Term Memory (LSTM) networks, to analyze trends in the area of coronal holes and predict their areas across various solar regions over a span of seven days. By examining time series data, we aim to identify patterns in coronal hole behavior and understand their potential effects on space weather. This research enhances our ability to anticipate and prepare for space weather events that could affect Earth's technological systems.


title: Quantum annealing for finding maximum-weight independent set of unit-disk graphs

abstract: Recent progress in quantum computing and quantum simulation of many-body systems with arrays of neutral atoms using Rydberg excitation brought unforeseen opportunities towards computational advantage in solving various optimization problems. The problem of maximum-weight independent set (MWIS) of unit-disk graphs is an example of NP-hard optimization problems. It involves finding the largest set of vertices with the maximum sum of their weights for a graph which has edges connecting all pairs of vertices within a unit distance. This problem can be solved using quantum annealing with an array of interacting Rydberg atoms. For a particular graph, a spatial arrangement of atoms represents vertices of the graph, while the detuning from the resonance at Rydberg excitation defines weights of these vertices. The edges of the graph can be drawn according to the unit disk criterion. MWIS can be obtained by applying a variational quantum adiabatic algorithm (VQAA). We consider driving the quantum system of interacting atoms to the many-body ground state using a non-linear quasi-adiabatic profile for sweeping the Rydberg detuning. We also propose using a quantum wire which is a set of auxiliary atoms of a different chemical element to mediate strong coupling between the remote vertices of the graph. We investigate this effect for different lengths of the quantum wire. We also investigate the quantum phases of matter realizing commensurate and incommensurate phases in 1D and 2D spatial arrangement of the atomic array.


title: Quantum $\mathfrak{hs}$-Yang-Mills from the IKKT matrix model

abstract: We study the one-loop effective action of the higher-spin gauge theory induced by the IKKT matrix model on a $\mathcal{M}^{1,3}\times \mathcal{K}$ background, where $\mathcal{M}^{1,3}$ is an FLRW cosmological spacetime brane and $\mathcal{K}$ are compact fuzzy extra dimensions. In particular, we show that all non-abelian ($\mathfrak{hs}$-valued) gauge fields in this model acquire mass via quantum effects, thus avoiding no-go theorems. This leads to a massive non-abelian quantum $\mathfrak{hs}$-Yang-Mills theory, whose detailed structure depends on $\mathcal{K}$. The stabilization of $\mathcal{K}$ at one loop is understood as a result of the coupling between $\mathcal{K}$ and the $U(1)$-flux bundle on space-time. This flux stabilization induces the KK scale into the $\mathcal{N} = 4$ SYM sector of the model, which break superconformal symmetry.


title: SecureLLM: Using Compositionality to Build Provably Secure Language Models for Private, Sensitive, and Secret Data

abstract: Traditional security mechanisms isolate resources from users who should not access them. We reflect the compositional nature of such security mechanisms back into the structure of LLMs to build a provably secure LLM; that we term SecureLLM. Other approaches to LLM safety attempt to protect against bad actors or bad outcomes, but can only do so to an extent making them inappropriate for sensitive data. SecureLLM blends access security with fine-tuning methods. Each data silo has associated with it a separate fine-tuning and a user has access only to the collection of fine-tunings that they have permission for. The model must then perform on compositional tasks at the intersection of those data silos with the combination of those individual fine-tunings. While applicable to any task like document QA or making API calls, in this work we concern ourselves with models that learn the layouts of new SQL databases to provide natural-language-to-SQL translation capabilities. Existing fine-tuning composition methods fail in this challenging environment, as they are not well-equipped for handling compositional tasks. Compositionality remains a challenge for LLMs. We contribute both a difficult new compositional natural-language-to-SQL translation task and a new perspective on LLM security that allows models to be deployed to secure environments today.


title: MediSyn: Text-Guided Diffusion Models for Broad Medical 2D and 3D Image Synthesis

abstract: Diffusion models have recently gained significant traction due to their ability to generate high-fidelity and diverse images and videos conditioned on text prompts. In medicine, this application promises to address the critical challenge of data scarcity, a consequence of barriers in data sharing, stringent patient privacy regulations, and disparities in patient population and demographics. By generating realistic and varying medical 2D and 3D images, these models offer a rich, privacy-respecting resource for algorithmic training and research. To this end, we introduce MediSyn, a pair of instruction-tuned text-guided latent diffusion models with the ability to generate high-fidelity and diverse medical 2D and 3D images across specialties and modalities. Through established metrics, we show significant improvement in broad medical image and video synthesis guided by text prompts.


title: Three-body forces and Efimov physics in nuclei and atoms

abstract: This review article presents historical developments and recent advances in our understanding on the three-body forces and Efimov physics, from an interdisciplinary viewpoint encompassing nuclear physics and cold atoms. Theoretical attempts to elucidate the three-body force with the chiral effective field theory are explained, followed by an overview of experiments aimed at observing signatures of the nuclear three-body force. Some recent experimental and theoretical works in the field of cold atoms devoted to measuring and engineering three-body forces among atoms are also presented. As a phenomenon arising from the three-body effect, Efimov physics in both cold atoms and nuclear systems is reviewed.


title: Phase Retrieval from the Hong-Ou-Mandel Dip to Characterize the Phase Spectrum of Independent Pulses at the Single-Photon Level

abstract: Measuring the phase spectrum at the single-photon level is essential for the full characterization of the temporal-spectral mode of quantum sources. We present a phase retrieval algorithm-based method to recover the phase spectrum difference between two independent pulses from their Hong-Ou-Mandel interference pattern and intensity spectra. Our confirmatory experiment with coherent state pulses confirms the accuracy of the recovered phase spectrum difference to within plus or minus 0.1 rad. The method we employ is readily generalizable to the measurement of single-photon wave packets and even correlated photon pairs.


title: Biomarker Selection for Adaptive Systems

abstract: Biomarkers enable objective monitoring of a given cell or state in a biological system and are widely used in research, biomanufacturing, and clinical practice. However, identifying appropriate biomarkers that are both robustly measurable and capture a state accurately remains challenging. We present a framework for biomarker identification based upon observability guided sensor selection. Our methods, Dynamic Sensor Selection (DSS) and Structure-Guided Sensor Selection (SGSS), utilize temporal models and experimental data, offering a template for applying observability theory to unconventional data obtained from biological systems. Unlike conventional methods that assume well-known, fixed dynamics, DSS adaptively select biomarkers or sensors that maximize observability while accounting for the time-varying nature of biological systems. Additionally, SGSS incorporates structural information and diverse data to identify sensors which are resilient against inaccuracies in our model of the underlying system. We validate our approaches by performing estimation on high dimensional systems derived from temporal gene expression data from partial observations.


title: Trajectory-Based Individualized Treatment Rules

abstract: A core component of precision medicine research involves optimizing individualized treatment rules (ITRs) based on patient characteristics. Many studies used to estimate ITRs are longitudinal in nature, collecting outcomes over time. Yet, to date, methods developed to estimate ITRs often ignore the longitudinal structure of the data. Information available from the longitudinal nature of the data can be especially useful in mental health studies. Although treatment means might appear similar, understanding the trajectory of outcomes over time can reveal important differences between treatments and placebo effects. This longitudinal perspective is especially beneficial in mental health research, where subtle shifts in outcome patterns can hold significant implications. Despite numerous studies involving the collection of outcome data across various time points, most precision medicine methods used to develop ITRs overlook the information available from the longitudinal structure. The prevalence of missing data in such studies exacerbates the issue, as neglecting the longitudinal nature of the data can significantly impair the effectiveness of treatment rules. This paper develops a powerful longitudinal trajectory-based ITR construction method that incorporates baseline variables, via a single-index or biosignature, into the modeling of longitudinal outcomes. This trajectory-based ITR approach substantially minimizes the negative impact of missing data compared to more traditional ITR approaches. The approach is illustrated through simulation studies and a clinical trial for depression, contrasting it with more traditional ITRs that ignore longitudinal information.


title: A Payoff-Based Policy Gradient Method in Stochastic Games with Long-Run Average Payoffs

abstract: Despite the significant potential for various applications, stochastic games with long-run average payoffs have received limited scholarly attention, particularly concerning the development of learning algorithms for them due to the challenges of mathematical analysis. In this paper, we study the stochastic games with long-run average payoffs and present an equivalent formulation for individual payoff gradients by defining advantage functions which will be proved to be bounded. This discovery allows us to demonstrate that the individual payoff gradient function is Lipschitz continuous with respect to the policy profile and that the value function of the games exhibits the gradient dominance property. Leveraging these insights, we devise a payoff-based gradient estimation approach and integrate it with the Regularized Robbins-Monro method from stochastic approximation theory to construct a bandit learning algorithm suited for stochastic games with long-run average payoffs. Additionally, we prove that if all players adopt our algorithm, the policy profile employed will asymptotically converge to a Nash equilibrium with probability one, provided that all Nash equilibria are globally neutrally stable and a globally variationally stable Nash equilibrium exists. This condition represents a wide class of games, including monotone games.


title: Mean-field and cumulant approaches to modelling organic polariton physics

abstract: In this thesis we develop methods for many-body open quantum systems and apply them to systems of organic polaritons. The methods employ a mean-field approach to reduce the dimensionality of large-scale problems. Initially assuming the absence of correlations in the many-body state, this approach is built upon in two ways. First, we show how the mean-field approximation can be combined with matrix product operator methods to efficiently simulate the non-Markovian dynamics of a many-body system with strong coupling to multiple environments. We apply this method to calculate the threshold and photoluminescence for a realistic model of an organic laser. Second, we extend the mean-field description by systematically including higher-order correlations via cumulant expansions of the Heisenberg equations of motion. We investigate the validity and convergence properties of these expansions, both with respect to expansion order and system size, for many-body systems with many-to-one network structures. We then show how the cumulant expansions may be used to calculate spatially resolved dynamics of organic polaritons. This enables a study of organic polariton transport in which we observe reversible conversion to dark exciton states and sub-group-velocity propagation. The methods established in this work offer versatile tools for analysing large, many-body open quantum systems and investigating finite-size effects. Their application reveals the intricate dynamics of organic polaritons resulting from the interplay of strong light-matter coupling and vibrational effects.


title: Revisiting the exclusion principle in epidemiology at its ultimate limit

abstract: The competitive exclusion principle in epidemiology implies that when competing strains of a pathogen provide complete protection for each other, the strain with the largest reproduction number outcompetes the other strains and drives them to extinction. The introduction of various trade-off mechanisms may facilitate the coexistence of competing strains, especially when their respective basic reproduction numbers are close so that the competition between the strains is weak. Yet, one may expect that a substantial competitive advantage of one of the strains will eventually outbalance trade-off mechanisms driving less competitive strains to extinction. The literature, however, lacks a rigorous validation of this statement. In this work, we challenge the validity of the exclusion principle at an ultimate limit in which one strain has a vast competitive advantage over the other strains. We show that when one strain is significantly more transmissible than the others, and under broad conditions, an epidemic system with two strains has a stable endemic equilibrium in which both strains coexist with comparable prevalence. Thus, the competitive exclusion principle does not unconditionally hold beyond the established case of complete immunity.


title: Semantic Gesticulator: Semantics-Aware Co-Speech Gesture Synthesis

abstract: In this work, we present Semantic Gesticulator, a novel framework designed to synthesize realistic gestures accompanying speech with strong semantic correspondence. Semantically meaningful gestures are crucial for effective non-verbal communication, but such gestures often fall within the long tail of the distribution of natural human motion. The sparsity of these movements makes it challenging for deep learning-based systems, trained on moderately sized datasets, to capture the relationship between the movements and the corresponding speech semantics. To address this challenge, we develop a generative retrieval framework based on a large language model. This framework efficiently retrieves suitable semantic gesture candidates from a motion library in response to the input speech. To construct this motion library, we summarize a comprehensive list of commonly used semantic gestures based on findings in linguistics, and we collect a high-quality motion dataset encompassing both body and hand movements. We also design a novel GPT-based model with strong generalization capabilities to audio, capable of generating high-quality gestures that match the rhythm of speech. Furthermore, we propose a semantic alignment mechanism to efficiently align the retrieved semantic gestures with the GPT's output, ensuring the naturalness of the final animation. Our system demonstrates robustness in generating gestures that are rhythmically coherent and semantically explicit, as evidenced by a comprehensive collection of examples. User studies confirm the quality and human-likeness of our results, and show that our system outperforms state-of-the-art systems in terms of semantic appropriateness by a clear margin.


title: A note on the approximation by a sum of two algebras

abstract: We consider the problem of approximation of a continuous function $f$ defined on a compact metric space $X$ by elements from a sum of two algebras. We prove a de la Vall\'{e}e Poussin type theorem, which estimates the approximation error $E(f)$ from below. We also obtain a duality formula for the precise computation of $E(f)$.


title: On the scalar curvature rigidity for mainifolds with non-positive Yamabe invariant

abstract: In this paper, we study scalar curvature rigidity of non-smooth metrics on smooth manifolds with non-positive Yamabe invariant. We prove that if the scalar curvature is not less than the Yamabe invariant in distributional sense, then the manifold must be isometric to an Einstein manifold. This result extends Theorem 1.4 in Jiang, Sheng and the first author (Sci. China Math. 66 (2023) no. 6, 1141-1160), from a special case where the manifolds have zero Yamabe invariant to general cases where the manifolds have non-positive Yamabe invariant. This result depends highly on an analysis and estimates of geometric evolution equations.


title: Active Learning with Fully Bayesian Neural Networks for Discontinuous and Nonstationary Data

abstract: Active learning optimizes the exploration of large parameter spaces by strategically selecting which experiments or simulations to conduct, thus reducing resource consumption and potentially accelerating scientific discovery. A key component of this approach is a probabilistic surrogate model, typically a Gaussian Process (GP), which approximates an unknown functional relationship between control parameters and a target property. However, conventional GPs often struggle when applied to systems with discontinuities and non-stationarities, prompting the exploration of alternative models. This limitation becomes particularly relevant in physical science problems, which are often characterized by abrupt transitions between different system states and rapid changes in physical property behavior. Fully Bayesian Neural Networks (FBNNs) serve as a promising substitute, treating all neural network weights probabilistically and leveraging advanced Markov Chain Monte Carlo techniques for direct sampling from the posterior distribution. This approach enables FBNNs to provide reliable predictive distributions, crucial for making informed decisions under uncertainty in the active learning setting. Although traditionally considered too computationally expensive for 'big data' applications, many physical sciences problems involve small amounts of data in relatively low-dimensional parameter spaces. Here, we assess the suitability and performance of FBNNs with the No-U-Turn Sampler for active learning tasks in the 'small data' regime, highlighting their potential to enhance predictive accuracy and reliability on test functions relevant to problems in physical sciences.


title: Chameleon: Mixed-Modal Early-Fusion Foundation Models

abstract: We present Chameleon, a family of early-fusion token-based mixed-modal models capable of understanding and generating images and text in any arbitrary sequence. We outline a stable training approach from inception, an alignment recipe, and an architectural parameterization tailored for the early-fusion, token-based, mixed-modal setting. The models are evaluated on a comprehensive range of tasks, including visual question answering, image captioning, text generation, image generation, and long-form mixed modal generation. Chameleon demonstrates broad and general capabilities, including state-of-the-art performance in image captioning tasks, outperforms Llama-2 in text-only tasks while being competitive with models such as Mixtral 8x7B and Gemini-Pro, and performs non-trivial image generation, all in a single model. It also matches or exceeds the performance of much larger models, including Gemini Pro and GPT-4V, according to human judgments on a new long-form mixed-modal generation evaluation, where either the prompt or outputs contain mixed sequences of both images and text. Chameleon marks a significant step forward in a unified modeling of full multimodal documents.


title: Automating the Training and Deployment of Models in MLOps by Integrating Systems with Machine Learning

abstract: This article introduces the importance of machine learning in real-world applications and explores the rise of MLOps (Machine Learning Operations) and its importance for solving challenges such as model deployment and performance monitoring. By reviewing the evolution of MLOps and its relationship to traditional software development methods, the paper proposes ways to integrate the system into machine learning to solve the problems faced by existing MLOps and improve productivity. This paper focuses on the importance of automated model training, and the method to ensure the transparency and repeatability of the training process through version control system. In addition, the challenges of integrating machine learning components into traditional CI/CD pipelines are discussed, and solutions such as versioning environments and containerization are proposed. Finally, the paper emphasizes the importance of continuous monitoring and feedback loops after model deployment to maintain model performance and reliability. Using case studies and best practices from Netflix, the article presents key strategies and lessons learned for successful implementation of MLOps practices, providing valuable references for other organizations to build and optimize their own MLOps practices.


title: Densely Distilling Cumulative Knowledge for Continual Learning

abstract: Continual learning, involving sequential training on diverse tasks, often faces catastrophic forgetting. While knowledge distillation-based approaches exhibit notable success in preventing forgetting, we pinpoint a limitation in their ability to distill the cumulative knowledge of all the previous tasks. To remedy this, we propose Dense Knowledge Distillation (DKD). DKD uses a task pool to track the model's capabilities. It partitions the output logits of the model into dense groups, each corresponding to a task in the task pool. It then distills all tasks' knowledge using all groups. However, using all the groups can be computationally expensive, we also suggest random group selection in each optimization step. Moreover, we propose an adaptive weighting scheme, which balances the learning of new classes and the retention of old classes, based on the count and similarity of the classes. Our DKD outperforms recent state-of-the-art baselines across diverse benchmarks and scenarios. Empirical analysis underscores DKD's ability to enhance model stability, promote flatter minima for improved generalization, and remains robust across various memory budgets and task orders. Moreover, it seamlessly integrates with other CL methods to boost performance and proves versatile in offline scenarios like model compression.


title: Evaluating Algorithmic Bias in Models for Predicting Academic Performance of Filipino Students

abstract: Algorithmic bias is a major issue in machine learning models in educational contexts. However, it has not yet been studied thoroughly in Asian learning contexts, and only limited work has considered algorithmic bias based on regional (sub-national) background. As a step towards addressing this gap, this paper examines the population of 5,986 students at a large university in the Philippines, investigating algorithmic bias based on students' regional background. The university used the Canvas learning management system (LMS) in its online courses across a broad range of domains. Over the period of three semesters, we collected 48.7 million log records of the students' activity in Canvas. We used these logs to train binary classification models that predict student grades from the LMS activity. The best-performing model reached AUC of 0.75 and weighted F1-score of 0.79. Subsequently, we examined the data for bias based on students' region. Evaluation using three metrics: AUC, weighted F1-score, and MADD showed consistent results across all demographic groups. Thus, no unfairness was observed against a particular student group in the grade predictions.


title: SEEK: Semantic Reasoning for Object Goal Navigation in Real World Inspection Tasks

abstract: This paper addresses the problem of object-goal navigation in autonomous inspections in real-world environments. Object-goal navigation is crucial to enable effective inspections in various settings, often requiring the robot to identify the target object within a large search space. Current object inspection methods fall short of human efficiency because they typically cannot bootstrap prior and common sense knowledge as humans do. In this paper, we introduce a framework that enables robots to use semantic knowledge from prior spatial configurations of the environment and semantic common sense knowledge. We propose SEEK (Semantic Reasoning for Object Inspection Tasks) that combines semantic prior knowledge with the robot's observations to search for and navigate toward target objects more efficiently. SEEK maintains two representations: a Dynamic Scene Graph (DSG) and a Relational Semantic Network (RSN). The RSN is a compact and practical model that estimates the probability of finding the target object across spatial elements in the DSG. We propose a novel probabilistic planning framework to search for the object using relational semantic knowledge. Our simulation analyses demonstrate that SEEK outperforms the classical planning and Large Language Models (LLMs)-based methods that are examined in this study in terms of efficiency for object-goal inspection tasks. We validated our approach on a physical legged robot in urban environments, showcasing its practicality and effectiveness in real-world inspection scenarios.


title: Boundary Hardy inequality on functions of bounded variation

abstract: Classical boundary Hardy inequality, that goes back to 1988, states that if $1 < p < \infty, \ ~\Omega$ is bounded Lipschitz domain, then for all $u \in C^{\infty}_{c}(\Omega)$, $$\int_{\Omega} \frac{|u(x)|^{p}}{\delta^{p}_{\Omega}(x)} dx \leq C\int_{\Omega} |\nabla u(x) |^{p}dx,$$ where $\delta_\Omega(x)$ is the distance function from $\Omega^c$. In this article, we address the long standing open question on the case $p=1$ by establishing appropriate boundary Hardy inequalities in the space of functions of bounded variation. We first establish appropriate inequalities on fractional Sobolev spaces $W^{s,1}(\Omega)$ and then Brezis, Bourgain and Mironescu's result on limiting behavior of fractional Sobolev spaces as $s\rightarrow 1^{-}$ plays an important role in the proof. Moreover, we also derive an infinite series Hardy inequality for the case $p=1$.


title: Classification of $\pi_1$-injective proper maps between non-compact surfaces

abstract: We show that almost all $\pi_1$-injective proper maps between two non-compact surfaces, where surfaces are possibly of infinite type, can be properly homotoped to finite-sheeted covering maps.


title: A Sample of Compact Object Candidates in Single-lined Spectroscopic Binaries from LAMOST Medium Resolution Survey

abstract: The stellar spectra from LAMOST Medium Resolution Survey can be used to search for compact objects in binaries. The LAMOST DR10 catalog includes > 980, 000 targets with multiple medium resolution spectra. We select the targets with large or rapid radial velocity variation, and obtained an input-sample of 1822 sources. We use light curves and spectra to identify and exclude eclipsing binaries and double-lined spectroscopic binaries in the input-sample. We finally derive a catalog of 89 candidates with well-folded radial velocity, which are all single-lined spectroscopic binaries, indicating an unseen companion residing in each system. The mass function of each system can be well constrained based on the radial velocity curve. In our sample, 26 sources have mass function higher than 0.1 $M_{\odot}$, among which 18 sources have ellipsoidal type light curves. In our opinion, compact objects are likely existent in all these 26 binaries, which are worth follow-up identification.


title: Lie symmetry analysis of (2+1)-dimensional time fractional Kadomtsev-Petviashvili equation

abstract: In this paper, Lie symmetry analysis method is applied to the (2+1)-dimensional time fractional Kadomtsev-Petviashvili (KP) equation with the mixed derivative of Riemann-Liouville time-fractional derivative and integer-order $x$-derivative. We obtained all the Lie symmetries admitted by the KP equation and used them to reduce the (2+1)-dimensional fractional partial differential equation with Riemann-Liouville fractional derivative to some (1+1)-dimensional fractional partial differential equations with Erd\'{e}lyi-Kober fractional derivative or Riemann-Liouville fractional derivative, thereby getting some exact solutions of the reduced equations. In addition, the new conservation theorem and the generalization of Noether operators are developed to construct the conservation laws for the equation studied.

categories: nlin.SI cs.NA math-ph math.AP math.MP math.NA


title: Parallel Backpropagation for Shared-Feature Visualization

abstract: High-level visual brain regions contain subareas in which neurons appear to respond more strongly to examples of a particular semantic category, like faces or bodies, rather than objects. However, recent work has shown that while this finding holds on average, some out-of-category stimuli also activate neurons in these regions. This may be due to visual features common among the preferred class also being present in other images. Here, we propose a deep-learning-based approach for visualizing these features. For each neuron, we identify relevant visual features driving its selectivity by modelling responses to images based on latent activations of a deep neural network. Given an out-of-category image which strongly activates the neuron, our method first identifies a reference image from the preferred category yielding a similar feature activation pattern. We then backpropagate latent activations of both images to the pixel level, while enhancing the identified shared dimensions and attenuating non-shared features. The procedure highlights image regions containing shared features driving responses of the model neuron. We apply the algorithm to novel recordings from body-selective regions in macaque IT cortex in order to understand why some images of objects excite these neurons. Visualizations reveal object parts which resemble parts of a macaque body, shedding light on neural preference of these objects.


title: PillarNeXt: Improving the 3D detector by introducing Voxel2Pillar feature encoding and extracting multi-scale features

abstract: The multi-line LiDAR is widely used in autonomous vehicles, so point cloud-based 3D detectors are essential for autonomous driving. Extracting rich multi-scale features is crucial for point cloud-based 3D detectors in autonomous driving due to significant differences in the size of different types of objects. However, because of the real-time requirements, large-size convolution kernels are rarely used to extract large-scale features in the backbone. Current 3D detectors commonly use feature pyramid networks to obtain large-scale features; however, some objects containing fewer point clouds are further lost during down-sampling, resulting in degraded performance. Since pillar-based schemes require much less computation than voxel-based schemes, they are more suitable for constructing real-time 3D detectors. Hence, we propose the PillarNeXt, a pillar-based scheme. We redesigned the feature encoding, the backbone, and the neck of the 3D detector. We propose the Voxel2Pillar feature encoding, which uses a sparse convolution constructor to construct pillars with richer point cloud features, especially height features. The Voxel2Pillar adds more learnable parameters to the feature encoding, enabling the initial pillars to have higher performance ability. We extract multi-scale and large-scale features in the proposed fully sparse backbone, which does not utilize large-size convolutional kernels; the backbone consists of the proposed multi-scale feature extraction module. The neck consists of the proposed sparse ConvNeXt, whose simple structure significantly improves the performance. We validate the effectiveness of the proposed PillarNeXt on the Waymo Open Dataset, and the object detection accuracy for vehicles, pedestrians, and cyclists is improved. We also verify the effectiveness of each proposed module in detail through ablation studies.