title: Dynamical Phase Transition due to Feedback-induced Skin Effect

abstract: The traditional dynamical phase transition refers to the appearance of singularities in an observable with respect to a control parameter for a late-time state or singularities in the rate function of the Loschmidt echo with respect to time. Here, we study the many-body dynamics in a continuously monitored free fermion system with conditional feedback under open boundary conditions. We surprisingly find a novel dynamical phase transition from a logarithmic scaling of the entanglement entropy to an area-law scaling as time evolves. The transition, which is noticeably different from the conventional dynamical phase transition, arises from the competition between the bulk dynamics and boundary skin effects. In addition, we find that while quasidisorder or disorder cannot drive a transition for the steady state, a transition occurs for the maximum entanglement entropy during the time evolution, which agrees well with the entanglement transition for the steady state of the dynamics under periodic boundary conditions.

categories: quant-ph cond-mat.dis-nn cond-mat.mes-hall cond-mat.quant-gas


title: Agents meet OKR: An Object and Key Results Driven Agent System with Hierarchical Self-Collaboration and Self-Evaluation

abstract: In this study, we introduce the concept of OKR-Agent designed to enhance the capabilities of Large Language Models (LLMs) in task-solving. Our approach utilizes both self-collaboration and self-correction mechanism, facilitated by hierarchical agents, to address the inherent complexities in task-solving. Our key observations are two-fold: first, effective task-solving demands in-depth domain knowledge and intricate reasoning, for which deploying specialized agents for individual sub-tasks can markedly enhance LLM performance. Second, task-solving intrinsically adheres to a hierarchical execution structure, comprising both high-level strategic planning and detailed task execution. Towards this end, our OKR-Agent paradigm aligns closely with this hierarchical structure, promising enhanced efficacy and adaptability across a range of scenarios. Specifically, our framework includes two novel modules: hierarchical Objects and Key Results generation and multi-level evaluation, each contributing to more efficient and robust task-solving. In practical, hierarchical OKR generation decomposes Objects into multiple sub-Objects and assigns new agents based on key results and agent responsibilities. These agents subsequently elaborate on their designated tasks and may further decompose them as necessary. Such generation operates recursively and hierarchically, culminating in a comprehensive set of detailed solutions. The multi-level evaluation module of OKR-Agent refines solution by leveraging feedback from all associated agents, optimizing each step of the process. This ensures solution is accurate, practical, and effectively address intricate task requirements, enhancing the overall reliability and quality of the outcome. Experimental results also show our method outperforms the previous methods on several tasks. Code and demo are available at https://okr-agent.github.io/


title: RTLFixer: Automatically Fixing RTL Syntax Errors with Large Language Models

abstract: This paper presents RTLFixer, a novel framework enabling automatic syntax errors fixing for Verilog code with Large Language Models (LLMs). Despite LLM's promising capabilities, our analysis indicates that approximately 55% of errors in LLM-generated Verilog are syntax-related, leading to compilation failures. To tackle this issue, we introduce a novel debugging framework that employs Retrieval-Augmented Generation (RAG) and ReAct prompting, enabling LLMs to act as autonomous agents in interactively debugging the code with feedback. This framework demonstrates exceptional proficiency in resolving syntax errors, successfully correcting about 98.5% of compilation errors in our debugging dataset, comprising 212 erroneous implementations derived from the VerilogEval benchmark. Our method leads to 32.3% and 10.1% increase in pass@1 success rates in the VerilogEval-Machine and VerilogEval-Human benchmarks, respectively.


title: Multi-Irreducible Spectral Synchronization for Robust Rotation Averaging

abstract: Rotation averaging (RA) is a fundamental problem in robotics and computer vision. In RA, the goal is to estimate a set of $N$ unknown orientations $R_{1}, ..., R_{N} \in SO(3)$, given noisy measurements $R_{ij} \sim R^{-1}_{i} R_{j}$ of a subset of their pairwise relative rotations. This problem is both nonconvex and NP-hard, and thus difficult to solve in the general case. We apply harmonic analysis on compact groups to derive a (convex) spectral relaxation constructed from truncated Fourier decompositions of the individual summands appearing in the RA objective; we then recover an estimate of the RA solution by computing a few extremal eigenpairs of this relaxation, and (approximately) solving a consensus problem. Our approach affords several notable advantages versus prior RA methods: it can be used in conjunction with \emph{any} smooth loss function (including, but not limited to, robust M-estimators), does not require any initialization, and is implemented using only simple (and highly scalable) linear-algebraic computations and parallelizable optimizations over band-limited functions of individual rotational states. Moreover, under the (physically well-motivated) assumption of multiplicative Langevin measurement noise, we derive explicit performance guarantees for our spectral estimator (in the form of probabilistic tail bounds on the estimation error) that are parameterized in terms of graph-theoretic quantities of the underlying measurement network. By concretely linking estimator performance with properties of the underlying measurement graph, our results also indicate how to devise measurement networks that are \emph{guaranteed} to achieve accurate estimation, enabling such downstream tasks as sensor placement, network compression, and active sensing.


title: Unravelling DNS Performance: A Historical Examination of F-ROOT in Southeast Asia

abstract: The DNS root server system uses Anycast technology to provide resolution through widely distributed root nodes. In recent years, the F-root node has seen astonishing growth and now boasts the largest number of nodes among the 13 root servers. Based on Ripe Atlas measurement data, we examined the availability and query latency of the F-root within the Southeast Asian region historically. The collected data illustrates how latency varies with changes in the number of root nodes, how the geographic distribution of responding root nodes changes in different periods, and examines the most recent differences between countries in terms of latency distribution. This study sheds light on the evolving landscape of DNS infrastructure in Southeast Asia.


title: Phase transitions for the $XY$ model in non-uniformly elliptic and Poisson-Voronoi environments

abstract: The goal of this paper is to analyze how the celebrated phase transitions of the $XY$ model are affected by the presence of a non-elliptic quenched disorder. In dimension $d=2$, we prove that if one considers an $XY$ model on the infinite cluster of a supercritical percolation configuration, the Berezinskii-Kosterlitz-Thouless (BKT) phase transition still occurs despite the presence of quenched disorder. The proof works for all $p>p_c$ (site or edge). We also show that the $XY$ model defined on a planar Poisson-Voronoi graph also undergoes a BKT phase transition. When $d\geq 3$, we show in a similar fashion that the continuous symmetry breaking of the $XY$ model at low enough temperature is not affected by the presence of quenched disorder such as supercritical percolation (in $\mathbb{Z}^d$) or Poisson-Voronoi (in $\mathbb{R}^d$). Adapting either Fr\"{o}hlich-Spencer's proof of existence of a BKT phase transition or the more recent proofs of Lammers, van Engelenburg-Lis and Aizenman-Harel-Peled-Shapiro to such non-uniformly elliptic disorders appears to be non-trivial. Instead, our proofs rely on a relatively little known correlation inequality called Wells' inequality.


title: Existence and non-existence results to a mixed Schrodinger system in a plane

abstract: This article focuses on the existence and non-existence of solutions for the following system of local and nonlocal type \begin{equation*} \left\{ \begin{aligned} -\partial_{xx}u + (-\Delta)_{y}^{s_{1}} u + u - u^{2_{s_{1}}^{}-1} = \kappa \alpha h(x,y) u^{\alpha-1}v^{\beta} & \quad \mbox{in} ~ \mathbb{R}^{2}, -\partial_{xx}v + (-\Delta)_{y}^{s_{2}} v + v- v^{2_{s_{2}}^{}-1} = \kappa \beta h(x,y) u^{\alpha}v^{\beta-1} & \quad \mbox{in} ~ \mathbb{R}^{2}, u,v ~ \geq ~0 \quad \mbox{in} ~ \mathbb{R}^{2}, \end{aligned} \right. \end{equation*} where $s_{1},s_{2} \in (0,1),~\alpha,\beta>1,~\alpha+\beta \leq \min \{ 2_{s_{1}}^{},2_{s_{2}}^{}\}$, and $2_{s_i}^{} = \frac{2(1+s_i)}{1-s_i}, i=1,2$. The existence of a ground state solution entirely depends on the behaviour of the parameter $\kappa>0$ and on the function $h$. In this article, we prove that a ground state solution exists in the subcritical case if $\kappa$ is large enough and $h$ satisfies (1.3). Further, if $\kappa$ becomes very small in this case then there does not exist any solution to our system. The study in the critical case, i.e. $s_1=s_2=s, \alpha+\beta=2_s$, is more complex and the solution exists only for large $\kappa$ and radial $h$ satisfying (H1). Finally, we establish a Pohozaev identity which enables us to prove the non-existence results under some smooth assumptions on $h$.


title: Graph theoretic analysis of three-terminal quantum dot thermocouples: Onsager relations and spin-thermoelectric effects

abstract: We introduce a simplified model for a three-terminal quantum thermocouple consisting of two strongly-coupled quantum dots. To elucidate spin-dependent Seebeck and Peltier effects, we employ a microscopic Hamiltonian and map the Lindblad master equation onto a quantum transition network, capturing the key working principles for both reciprocal effects. Our analysis reveals quantum thermodynamic networks encompassing both Coulomb interaction and spin-flipping processes, lead to the emergence of spin-thermolectric effects. Using algebraic graph theory, we recover the phenomenological law of irreversible thermodynamics from the stochastic version of the entropy production rate expressed in terms of cycle flux and cycle forces. Remarkably, Onsager reciprocity and Kelvin relation for transport coefficients find their premises in the properties of cycle flux trajectories within the quantum transition network. This underscores the universal generality of thermodynamic principles across classical and quantum realms, despite their fundamentally different basis from classical laws of irreversible thermodynamics relying on local equilibrium assumptions.


title: Real-space blocking of qubit variables on parallel lattice gauge theory links for quantum simulation

abstract: One of the methods proposed in the last years for studying non-perturbative gauge theory physics is quantum simulation, where lattice gauge theories are mapped onto quantum devices which can be built in the laboratory, or quantum computers. While being very promising and already showing some experimental results, these methods still face several challenges related to the interface between the technological capabilities and the demands of the simulated models; in particular, one such challenge is the need to simulate infinitely dimensional local Hilbert spaces, describing the gauge fields on the links in the case of compact Lie gauge groups, requiring some truncations and approximations which are not completely understood or controllable in the general case. This work proposes a way to obtain arbitrarily large such local Hilbert spaces by using coarse graining of simple, low dimensional qubit systems, made of components available on most quantum simulation platforms, and thus opening the way of new types of lattice gauge theory quantum simulations.


title: Pulse shape discrimination technique for diffuse supernova neutrino background search with JUNO

abstract: Pulse shape discrimination (PSD) is widely used in particle and nuclear physics. Specifically in liquid scintillator detectors, PSD facilitates the classification of different particle types based on their energy deposition patterns. This technique is particularly valuable for studies of the Diffuse Supernova Neutrino Background (DSNB), nucleon decay, and dark matter searches. This paper presents a detailed investigation of the PSD technique, applied in the DSNB search performed with the Jiangmen Underground Neutrino Observatory (JUNO). Instead of using conventional cut-and-count methods, we employ methods based on Boosted Decision Trees and Neural Networks and compare their capability to distinguish the DSNB signals from the atmospheric neutrino neutral-current background events. The two methods demonstrate comparable performance, resulting in a 50\% to 80\% improvement in signal efficiency compared to a previous study performed for JUNO~\cite{JUNO:2015zny}. Moreover, we study the dependence of the PSD performance on the visible energy and final state composition of the events and find a significant dependence on the presence/absence of $^{11}$C. Finally, we evaluate the impact of the detector effects (photon propagation, PMT dark noise, and waveform reconstruction) on the PSD performance.


title: Thermally-activated precipitation strengthening

abstract: Precipitation strengthening is a key strengthening method for metallic materials. However, the temperature effect on precipitation strengthening is still unclear to date. Based on dislocation theory, a thermally-activated precipitation strengthening model is built by considering the competition between shear and bypass mechanisms. For medium-sized precipitate particles, the thermally-activated shear mechanism dominates the precipitation strengthening, resulting in a plateau region. While, for large or very fine precipitate particles, the thermally-activated bypass mechanism dominates the precipitation strengthening, leading to the strengthening or weakening regions. Moreover, the effects of precipitate phase volume fraction, temperature, shear modulus, strain rate, and mobile dislocation density on precipitation strengthening are also investigated. This study not only provides new insights into precipitation strengthening from the perspective of thermal activation but also offers clear guidance for the design of new materials.


title: HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors

abstract: Various heuristic objectives for modeling hand-object interaction have been proposed in past work. However, due to the lack of a cohesive framework, these objectives often possess a narrow scope of applicability and are limited by their efficiency or accuracy. In this paper, we propose HandyPriors, a unified and general pipeline for pose estimation in human-object interaction scenes by leveraging recent advances in differentiable physics and rendering. Our approach employs rendering priors to align with input images and segmentation masks along with physics priors to mitigate penetration and relative-sliding across frames. Furthermore, we present two alternatives for hand and object pose estimation. The optimization-based pose estimation achieves higher accuracy, while the filtering-based tracking, which utilizes the differentiable priors as dynamics and observation models, executes faster. We demonstrate that HandyPriors attains comparable or superior results in the pose estimation task, and that the differentiable physics module can predict contact information for pose refinement. We also show that our approach generalizes to perception tasks, including robotic hand manipulation and human-object pose estimation in the wild.


title: Magnon interactions in a moderately correlated Mott insulator

abstract: Quantum fluctuations in low-dimensional systems and near quantum phase transitions have significant influences on material properties. Yet, it is difficult to experimentally gauge the strength and importance of quantum fluctuations. Here we provide a resonant inelastic x-ray scattering study of magnon excitations in Mott insulating cuprates. From the thin film of SrCuO$_2$, single- and bi-magnon dispersions are derived. Using an effective Heisenberg Hamiltonian generated from the Hubbard model, we show that the single-magnon dispersion is only described satisfactorily when including significant quantum corrections stemming from magnon-magnon interactions. Comparative results on La$_2$CuO$_4$ indicate that quantum fluctuations are much stronger in SrCuO$_2$ suggesting closer proximity to a magnetic quantum critical point. Monte Carlo calculations reveal that other magnetic orders may compete with the antiferromagnetic N\'eel order as the ground state. Our results indicate that SrCuO$_2$ - due to strong quantum fluctuations - is a unique starting point for the exploration of novel magnetic ground states.


title: Large in-plane negative piezoelectricity and giant nonlinear optical susceptibility in elementary ferroelectric monolayers

abstract: Negative piezoelectrics contract in the direction of applied electric field, which are opposite to normal piezoelectrics and rare in dielectric materials. The raising of low dimensional ferroelectrics, with unconventional mechanisms of polarity, opens a fertile branch for candidates with prominent negative piezoelectricity. Here, the distorted $\alpha$-Bi monolayer, a newly-identified elementary ferroelectric with puckered black phosphorous-like structure [J. Guo, {\it et al}. Nature \textbf{617}, 67 (2023)], is computationally studied, which manifests a large negative in-plane piezoelectricity (with $d_{33}\sim-26$ pC/N). Its negative piezoelectricity originates from its unique buckling ferroelectric mechanism, namely the inter-column sliding. Consequently, a moderate tensile strain can significantly reduce its ferroelectric switching energy barrier, while the compressive strain can significantly enhance its prominent nonlinear optical response. The physical mechanism of in-plane negative piezoelectricity also applies to other elementary ferroeletric monolayers.


title: Enhancing Scene Text Detectors with Realistic Text Image Synthesis Using Diffusion Models

abstract: Scene text detection techniques have garnered significant attention due to their wide-ranging applications. However, existing methods have a high demand for training data, and obtaining accurate human annotations is labor-intensive and time-consuming. As a solution, researchers have widely adopted synthetic text images as a complementary resource to real text images during pre-training. Yet there is still room for synthetic datasets to enhance the performance of scene text detectors. We contend that one main limitation of existing generation methods is the insufficient integration of foreground text with the background. To alleviate this problem, we present the Diffusion Model based Text Generator (DiffText), a pipeline that utilizes the diffusion model to seamlessly blend foreground text regions with the background's intrinsic features. Additionally, we propose two strategies to generate visually coherent text with fewer spelling errors. With fewer text instances, our produced text images consistently surpass other synthetic data in aiding text detectors. Extensive experiments on detecting horizontal, rotated, curved, and line-level texts demonstrate the effectiveness of DiffText in producing realistic text images.


title: Scalable Label Distribution Learning for Multi-Label Classification

abstract: Multi-label classification (MLC) refers to the problem of tagging a given instance with a set of relevant labels. Most existing MLC methods are based on the assumption that the correlation of two labels in each label pair is symmetric, which is violated in many real-world scenarios. Moreover, most existing methods design learning processes associated with the number of labels, which makes their computational complexity a bottleneck when scaling up to large-scale output space. To tackle these issues, we propose a novel MLC learning method named Scalable Label Distribution Learning (SLDL) for multi-label classification which can describe different labels as distributions in a latent space, where the label correlation is asymmetric and the dimension is independent of the number of labels. Specifically, SLDL first converts labels into continuous distributions within a low-dimensional latent space and leverages the asymmetric metric to establish the correlation between different labels. Then, it learns the mapping from the feature space to the latent space, resulting in the computational complexity is no longer related to the number of labels. Finally, SLDL leverages a nearest-neighbor-based strategy to decode the latent representations and obtain the final predictions. Our extensive experiments illustrate that SLDL can achieve very competitive classification performances with little computational consumption.


title: A Continuous Dual-Axis Atomic Interferometric Inertial Sensor

abstract: We present an interferometric inertial sensor that utilizes two counter-propagating atomic beams with transverse two-dimensional cooling. By employing three parallel and spatially aligned Raman laser beams for Doppler-sensitive Raman transitions, we successfully generate inertia-sensitive Mach-Zehnder interference fringes with an interrogation length of $2L=54\,\rm{cm}$. The measured rotation and acceleration sensitivities are $0.25\,(\mu\rm{rad/s})/\sqrt{Hz}$ and $0.12\,\rm{m}\textit{g}/\rm{\sqrt{Hz}}$, respectively. The sensor's capability to measure rotation and acceleration simultaneously in dynamic environments is validated through comparative analysis with classical sensors under force oscillation in different directions. Additionally, we conduct experiments on a turntable to calibrate the gyroscope's scaling factor and address nonlinearity.


title: Remarks on SHD spaces and more divergence properties

abstract: The class of SHD spaces was recently introduced in [12]. The first part of this paper focuses on answering most of the questions presented in that article. For instance, we exhibit an example of a non-SHD Tychonoff space $X$ such that $\mathscr{F}[X]$, the Pixley-Roy hyperspace of $X$, $\beta X$, the Stone-\v{C}ech compactification of $X$, and $C_p(X)$, the ring of continuous functions over $X$ equipped with the topology of pointwise convergence, are SHD. In the second part of this work we will present some variations of the SHD notion, namely, the WSHD property and the OHD property. Furthermore, we will pay special attention to the relationships between $X$ and $\mathscr{F}[X]$ regarding these new concepts.


title: Graph Partitioning with Fujitsu Digital Annealer

abstract: Graph partitioning, or community detection, is the cornerstone of many fields, such as logistics, transportation and smart power grids. Efficient computation and efficacious evaluation of communities are both essential, especially in commercial and industrial settings. However, the solution space of graph partitioning increases drastically with the number of vertices and subgroups. With an eye to solving large scale graph partitioning and other optimization problems within a short period of time, the Digital Annealer (DA), a specialized CMOS hardware also featuring improved algorithms, has been devised by Fujitsu Ltd. This study gauges Fujitsu DA's performance and running times. The modularity was implemented as both the objective function and metric for the solutions. The graph partitioning problems were formatted into Quadratic Unconstrained Binary Optimization (QUBO) structures so that they could be adequately imported into the DA. The DA yielded the highest modularity among other studies when partitioning Karate Club, Les Miserables, American Football, and Dolphin. Moreover, the DA was able to partition the Case 1354pegase power grid network into 45 subgroups, calling for 60,930 binary variables, whilst delivering optimal modularity results within a solving time of roughly 80 seconds. Our results suggest that the Fujitsu DA can be applied for rapid and efficient optimization for graph partitioning.


title: On the bias in iterative quantum amplitude estimation

abstract: Quantum amplitude estimation (QAE) is a pivotal quantum algorithm to estimate the squared amplitude $a$ of the target basis state in a quantum state $|\Phi\rangle$. Various improvements on the original quantum phase estimation-based QAE have been proposed for resource reduction. One of such improved versions is iterative quantum amplitude estimation (IQAE), which outputs an estimate $\hat{a}$ of $a$ through the iterated rounds of the measurements on the quantum states like $G^k|\Phi\rangle$, with the number $k$ of operations of the Grover operator $G$ (the Grover number) and the shot number determined adaptively. This paper investigates the bias in IQAE. Through the numerical experiments to simulate IQAE, we reveal that the estimate by IQAE is biased and the bias is enhanced for some specific values of $a$. We see that the termination criterion in IQAE that the estimated accuracy of $\hat{a}$ falls below the threshold is a source of the bias. Besides, we observe that $k_\mathrm{fin}$, the Grover number in the final round, and $f_\mathrm{fin}$, a quantity affecting the probability distribution of measurement outcomes in the final round, are the key factors to determine the bias, and the bias enhancement for specific values of $a$ is due to the skewed distribution of $(k_\mathrm{fin},f_\mathrm{fin})$. We also present a bias mitigation method: just re-executing the final round with the Grover number and the shot number fixed.


title: Cost of inferred nuclear parameters towards the f-mode dynamical tide in binary neutron stars

abstract: Gravitational Wave (GW) observations from Neutron Stars (NS) in a binary system provide an excellent scenario to constrain the nuclear parameters. The investigation of Pratten et al. (2022) has shown that the ignorance of f-mode dynamical tidal correction in the GW waveform model of the binary neutron star (BNS) system can lead to substantial bias in the measurement of NS properties and NS equations of state (EOS). In this work, we investigate the bias in the nuclear parameters resulting from the ignorance of dynamical tidal correction. In addition, this work demonstrates the sensitivity of the nuclear parameters and the estimated constraints on them from future GW observations. We infer the nuclear parameters from GW observations by describing the NS matter within the relativistic mean field model. For a population of GW events, we notice that the ignorance of dynamical tide predicts a lower median for nucleon effective mass ($m^*$) by $\sim6\%$ compared to the scenario when dynamical tidal correction is considered. Whereas at a 90\% credible interval(CI), $m^*$ gets constrained up to $\sim 5\%$ and $\sim 3\%$ in A+ (the LIGO-Virgo detectors with a sensitivity of 5th observing run) and Cosmic Explorer (CE) respectively. We also discuss the resulting constraints on all other nuclear parameters, including compressibility, symmetry energy, and slope of symmetry energy, considering an ensemble of GW events. We do not notice any significant impact in analyzing nuclear parameters other than $m^*$ due to the ignorance of f-mode dynamical tides.


title: Parameterized Complexity of Factorization Problems

abstract: We study the parameterized complexity of the following factorization problem: given elements $a,a_1, \ldots, a_m$ of a monoid and a parameter $k$, can $a$ be written as the product of at most (or exactly) $k$ elements from $a_1, \ldots, a_m$. Several new upper bounds and fpt-equivalences with more restricted problems (subset sum and knapsack) are shown. Finally, some new upper bounds for variants of the parameterized change-making problems are shown.


title: Effective properties of composites with open boundary conditions

abstract: A primitive problem of predicting the effective properties of composites is open boundary conditions. In this paper, Eshelby's transformation field method is developed to solve the open boundary problem of two-phase composites having arbitrary inclusion geometry. The transformation fields are introduced in the composite system to cope with the complicated interface boundary-value problem of the composite. Furthermore, the open boundary problem is solved by Hermite polynomial, which is used to express the transformation fields and the perturbation fields. As an example, the formulas of Eshelby's method are derived for calculating the effective dielectric property of two-dimensional isotropic dielectric composites having open boundary conditions. The validity of the method is verified by comparing the effective responses estimated by the method with the exact solutions of dilute limit. The results show that the method is valid to solve the open boundary problem of composites having complex geometric inclusions.


title: Multi-agent statistical discriminative sub-trajectory mining and an application to NBA basketball

abstract: Improvements in tracking technology through optical and computer vision systems have enabled a greater understanding of the movement-based behaviour of multiple agents, including in team sports. In this study, a Multi-Agent Statistically Discriminative Sub-Trajectory Mining (MA-Stat-DSM) method is proposed that takes a set of binary-labelled agent trajectory matrices as input and incorporates Hausdorff distance to identify sub-matrices that statistically significantly discriminate between the two groups of labelled trajectory matrices. Utilizing 2015/16 SportVU NBA tracking data, agent trajectory matrices representing attacks consisting of the trajectories of five agents (the ball, shooter, last passer, shooter defender, and last passer defender), were truncated to correspond to the time interval following the receipt of the ball by the last passer, and labelled as effective or ineffective based on a definition of attack effectiveness that we devise in the current study. After identifying appropriate parameters for MA-Stat-DSM by iteratively applying it to all matches involving the two top- and two bottom-placed teams from the 2015/16 NBA season, the method was then applied to selected matches and could identify and visualize the portions of plays, e.g., involving passing, on-, and/or off-the-ball movements, which were most relevant in rendering attacks effective or ineffective.


title: DiffusionTalker: Personalization and Acceleration for Speech-Driven 3D Face Diffuser

abstract: Speech-driven 3D facial animation has been an attractive task in both academia and industry. Traditional methods mostly focus on learning a deterministic mapping from speech to animation. Recent approaches start to consider the non-deterministic fact of speech-driven 3D face animation and employ the diffusion model for the task. However, personalizing facial animation and accelerating animation generation are still two major limitations of existing diffusion-based methods. To address the above limitations, we propose DiffusionTalker, a diffusion-based method that utilizes contrastive learning to personalize 3D facial animation and knowledge distillation to accelerate 3D animation generation. Specifically, to enable personalization, we introduce a learnable talking identity to aggregate knowledge in audio sequences. The proposed identity embeddings extract customized facial cues across different people in a contrastive learning manner. During inference, users can obtain personalized facial animation based on input audio, reflecting a specific talking style. With a trained diffusion model with hundreds of steps, we distill it into a lightweight model with 8 steps for acceleration. Extensive experiments are conducted to demonstrate that our method outperforms state-of-the-art methods. The code will be released.


title: Property Testing with Online Adversaries

abstract: The online manipulation-resilient testing model, proposed by Kalemaj, Raskhodnikova and Varma (ITCS 2022 and Theory of Computing 2023), studies property testing in situations where access to the input degrades continuously and adversarially. Specifically, after each query made by the tester is answered, the adversary can intervene and either erase or corrupt $t$ data points. In this work, we investigate a more nuanced version of the online model in order to overcome old and new impossibility results for the original model. We start by presenting an optimal tester for linearity and a lower bound for low-degree testing of Boolean functions in the original model. We overcome the lower bound by allowing batch queries, where the tester gets a group of queries answered between manipulations of the data. Our batch size is small enough so that function values for a single batch on their own give no information about whether the function is of low degree. Finally, to overcome the impossibility results of Kalemaj et al. for sortedness and the Lipschitz property of sequences, we extend the model to include $t<1$, i.e., adversaries that make less than one erasure per query. For sortedness, we characterize the rate of erasures for which online testing can be performed, exhibiting a sharp transition from optimal query complexity to impossibility of testability (with any number of queries). Our online tester works for a general class of local properties of sequences. One feature of our results is that we get new (and in some cases, simpler) optimal algorithms for several properties in the standard property testing model.


title: MobileDiffusion: Instant Text-to-Image Generation on Mobile Devices

abstract: The deployment of large-scale text-to-image diffusion models on mobile devices is impeded by their substantial model size and slow inference speed. In this paper, we propose \textbf{MobileDiffusion}, a highly efficient text-to-image diffusion model obtained through extensive optimizations in both architecture and sampling techniques. We conduct a comprehensive examination of model architecture design to reduce redundancy, enhance computational efficiency, and minimize model's parameter count, while preserving image generation quality. Additionally, we employ distillation and diffusion-GAN finetuning techniques on MobileDiffusion to achieve 8-step and 1-step inference respectively. Empirical studies, conducted both quantitatively and qualitatively, demonstrate the effectiveness of our proposed techniques. MobileDiffusion achieves a remarkable \textbf{sub-second} inference speed for generating a $512\times512$ image on mobile devices, establishing a new state of the art.


title: Active Reconfigurable Intelligent Surface Enhanced Spectrum Sensing for Cognitive Radio Networks

abstract: In opportunistic cognitive radio networks, when the primary signal is very weak compared to the background noise, the secondary user requires long sensing time to achieve a reliable spectrum sensing performance, leading to little remaining time for the secondary transmission. To tackle this issue, we propose an active reconfigurable intelligent surface (RIS) assisted spectrum sensing system, where the received signal strength from the interested primary user can be enhanced and underlying interference within the background noise can be mitigated as well. In comparison with the passive RIS, the active RIS can not only adapt the phase shift of each reflecting element but also amplify the incident signals. Notably, we study the reflecting coefficient matrix (RCM) optimization problem to improve the detection probability given a maximum tolerable false alarm probability and limited sensing time. Then, we show that the formulated problem can be equivalently transformed to a weighted mean square error minimization problem using the principle of the well-known weighted minimum mean square error (WMMSE) algorithm, and an iterative optimization approach is proposed to obtain the optimal RCM. In addition, to fairly compare passive RIS and active RIS, we study the required power budget of the RIS to achieve a target detection probability under a special case where the direct links are neglected and the RIS-related channels are line-of-sight. Via extensive simulations, the effectiveness of the WMMSE-based RCM optimization approach is demonstrated. Furthermore, the results reveal that the active RIS can outperform the passive RIS when the underlying interference within the background noise is relatively weak, whereas the passive RIS performs better in strong interference scenarios because the same power budget can support a vast number of passive reflecting elements for interference mitigation.


title: Geometric thermodynamics of reaction-diffusion systems: Thermodynamic trade-off relations and optimal transport for pattern formation

abstract: The geometric approach to nonequilibrium thermodynamics is promising for understanding the role of dissipation and thermodynamic trade-off relations. This paper proposes a geometric framework for studying the nonequilibrium thermodynamics of reaction-diffusion systems. Based on this framework, we obtain several decompositions of the entropy production rate with respect to conservativeness, spatial structure, and wavenumber. We also generalize optimal transport theory to reaction-diffusion systems and derive several trade-off relations, including thermodynamic speed limits and thermodynamic uncertainty relations. The thermodynamic trade-off relations obtained in this paper shed light on thermodynamic dissipation in pattern formation. We numerically demonstrate our results using the Fisher$\unicode{x2013}$Kolmogorov$\unicode{x2013}$Petrovsky$\unicode{x2013}$Piskunov equation and the Brusselator model and discuss how the spatial pattern affects unavoidable dissipation.


title: Epistemic Limits of Empirical Finance: Causal Reductionism and Self-Reference

abstract: The clarion call for causal reduction in the study of capital markets is intensifying. However, in self-referencing and open systems such as capital markets, the idea of unidirectional causation (if applicable) may be limiting at best, and unstable or fallacious at worst. In this research, we critically assess the use of scientific deduction and causal inference within the study of empirical finance and econometrics. We then demonstrate the idea of competing causal chains using a toy model adapted from ecological predator/prey relationships. From this, we develop the alternative view that the study of empirical finance, and the risks contained therein, may be better appreciated once we admit that our current arsenal of quantitative finance tools may be limited to ex post causal inference under popular assumptions. Where these assumptions are challenged, for example in a recognizable reflexive context, the prescription of unidirectional causation proves deeply problematic.


title: Hybrid Intervals and Symbolic Block Matrices

abstract: Structured matrices with symbolic sizes appear frequently in the literature, especially in the description of algorithms for linear algebra. Recent work has treated these symbolic structured matrices themselves as computational objects, showing how to add matrices with blocks of different symbolic sizes in a general way while avoiding a combinatorial explosion of cases. The present article introduces the concept of hybrid intervals, in which points may have negative multiplicity. Various operations on hybrid intervals have compact and elegant formulations that do not require cases to handle different orders of the end points. This makes them useful to represent symbolic block matrix structures and to express arithmetic on symbolic block matrices compactly. We use these ideas to formulate symbolic block matrix addition and multiplication in a compact and uniform way.


title: Adapting to climate change: Long-term impact of wind resource changes on China's power system resilience

abstract: Modern society's reliance on power systems is at risk from the escalating effects of wind-related climate change. Yet, failure to identify the intricate relationship between wind-related climate risks and power systems could lead to serious short- and long-term issues, including partial or complete blackouts. Here, we develop a comprehensive framework to assess China's power system resilience across various climate change scenarios, enabling a holistic evaluation of the repercussions induced by wind-related climate change. Our findings indicate that China's current wind projects and planning strategies could be jeopardized by wind-related climate change, with up to a 12\% decline in regional wind power availability. Moreover, our results underscore a pronounced vulnerability of power system resilience amidst the rigors of hastened climate change, unveiling a potential amplification of resilience deterioration, even approaching fourfold by 2060 under the most severe scenario, relative to the 2020 benchmark. This work advocates for strategic financial deployment within the power sector aimed at climate adaptation, enhancing power system resilience to avert profound losses from long-term, wind-influenced climatic fluctuations.

categories: eess.SY cs.SY physics.ao-ph physics.soc-ph


title: Small mass uniqueness in the anisotropic liquid drop model and the critical mass problem

abstract: Small mass uniqueness in the anisotropic atomic liquid drop model for all values of the parameters is obtained and the critical mass conjecture is investigated.


title: Homogenization of nonlocal convolution type operators: Approximation for the resolvent with corrector

abstract: In $L_2(\mathbb{R}^d)$, we consider a selfadjoint bounded operator ${\mathbb A}_\varepsilon$, $\varepsilon >0$, of the form $$ ({\mathbb A}_\varepsilon u) (\mathbf{x}) = \varepsilon^{-d-2} \int_{\mathbb{R}^d} a((\mathbf{x} - \mathbf{y} )/ \varepsilon ) \mu(\mathbf{x} /\varepsilon, \mathbf{y} /\varepsilon) \left( u(\mathbf{x}) - u(\mathbf{y}) \right)\, d\mathbf{y}. $$ It is assumed that $a(\mathbf{x})$ is a nonnegative function of class $L_1(\mathbb{R}^d)$ such that \hbox{$a(-\mathbf{x}) = a(\mathbf{x})$} and $\mu(\mathbf{x},\mathbf{y})$ is $\mathbb{Z}^d$-periodic in each variable and such that $\mu(\mathbf{x},\mathbf{y}) = \mu(\mathbf{y},\mathbf{x})$ and $0< \mu_- \leqslant \mu(\mathbf{x},\mathbf{y}) \leqslant \mu_+< \infty$. Moreover, it is assumed that the moments $M_k (a)= \int_{\mathbb{R}^d} | \mathbf{x} |^k a(\mathbf{x})\,d\mathbf{x}$, $k=1,2,3,4,$ are finite. We obtain approximation of the resolvent $({\mathbb A}_\varepsilon + I)^{-1}$ for small $\varepsilon$ in the operator norm on $L_2(\mathbb{R}^d)$ with error of order $O(\varepsilon^2)$.


title: Secure Traversable Event logging for Responsible Identification of Vertically Partitioned Health Data

abstract: We aim to provide a solution for the secure identification of sensitive medical information. We consider a repository of de-identified medical data that is stored in the custody of a Healthcare Institution. The identifying information that is stored separately can be associated with the medical information only by a subset of users referred to as custodians. This paper intends to secure the process of associating identifying information with sensitive medical information. We also enforce the responsibility of the custodians by maintaining an immutable ledger documenting the events of such information identification. The paper proposes a scheme for constructing ledger entries that allow the custodians and patients to browse through the entries which they are associated with. However, in order to respect their privacy, such traversal requires appropriate credentials to ensure that a user cannot gain any information regarding the other users involved in the system unless they are both involved in the same operation.


title: Wireless Powered Metaverse: Joint Task Scheduling and Trajectory Design for Multi-Devices and Multi-UAVs

abstract: To support the running of human-centric metaverse applications on mobile devices, Unmanned Aerial Vehicle (UAV)-assisted Wireless Powered Mobile Edge Computing (WPMEC) is promising to compensate for limited computational capabilities and energy supplies of mobile devices. The high-speed computational processing demands and significant energy consumption of metaverse applications require joint resource scheduling of multiple devices and UAVs, but existing WPMEC solutions address either device or UAV scheduling due to the complexity of combinatorial optimization. To solve the above challenge, we propose a two-stage alternating optimization algorithm based on multi-task Deep Reinforcement Learning (DRL) to jointly allocate charging time, schedule computation tasks, and optimize trajectory of UAVs and mobile devices in a wireless powered metaverse scenario. First, considering energy constraints of both UAVs and mobile devices, we formulate an optimization problem to maximize the computation efficiency of the system. Second, we propose a heuristic algorithm to efficiently perform time allocation and charging scheduling for mobile devices. Following this, we design a multi-task DRL scheme to make charging scheduling and trajectory design decisions for UAVs. Finally, theoretical analysis and performance results demonstrate that our algorithm exhibits significant advantages over representative methods in terms of convergence speed and average computation efficiency.


title: Efficient Key-Based Adversarial Defense for ImageNet by Using Pre-trained Model

abstract: In this paper, we propose key-based defense model proliferation by leveraging pre-trained models and utilizing recent efficient fine-tuning techniques on ImageNet-1k classification. First, we stress that deploying key-based models on edge devices is feasible with the latest model deployment advancements, such as Apple CoreML, although the mainstream enterprise edge artificial intelligence (Edge AI) has been focused on the Cloud. Then, we point out that the previous key-based defense on on-device image classification is impractical for two reasons: (1) training many classifiers from scratch is not feasible, and (2) key-based defenses still need to be thoroughly tested on large datasets like ImageNet. To this end, we propose to leverage pre-trained models and utilize efficient fine-tuning techniques to proliferate key-based models even on limited computing resources. Experiments were carried out on the ImageNet-1k dataset using adaptive and non-adaptive attacks. The results show that our proposed fine-tuned key-based models achieve a superior classification accuracy (more than 10% increase) compared to the previous key-based models on classifying clean and adversarial examples.


title: Counting 7-Arcs in Projective Planes over Finite Fields

abstract: Given a collection of points in the plane, classifying which subsets are collinear is a natural problem and is related to classical geometric constructions. We consider collections of points in a projective plane over a finite field such that no three are collinear. This is a finite set and its size is both combinatorially interesting and has deeper topological consequences. We count the number of such collections classified by the algebraic symmetries of the finite field. Variations of this problem have been considered by Glynn, Bergvall, Das, O'Connor et al. We obtain the counts for 7 points over fields of characteristic 2. These new counts are governed by the existence and classification of a configuration of points called the Fano plane.


title: Recognizing Conditional Causal Relationships about Emotions and Their Corresponding Conditions

abstract: The study of causal relationships between emotions and causes in texts has recently received much attention. Most works focus on extracting causally related clauses from documents. However, none of these works has considered that the causal relationships among the extracted emotion and cause clauses can only be valid under some specific context clauses. To highlight the context in such special causal relationships, we propose a new task to determine whether or not an input pair of emotion and cause has a valid causal relationship under different contexts and extract the specific context clauses that participate in the causal relationship. Since the task is new for which no existing dataset is available, we conduct manual annotation on a benchmark dataset to obtain the labels for our tasks and the annotations of each context clause's type that can also be used in some other applications. We adopt negative sampling to construct the final dataset to balance the number of documents with and without causal relationships. Based on the constructed dataset, we propose an end-to-end multi-task framework, where we design two novel and general modules to handle the two goals of our task. Specifically, we propose a context masking module to extract the context clauses participating in the causal relationships. We propose a prediction aggregation module to fine-tune the prediction results according to whether the input emotion and causes depend on specific context clauses. Results of extensive comparative experiments and ablation studies demonstrate the effectiveness and generality of our proposed framework.


title: Clean Label Disentangling for Medical Image Segmentation with Noisy Labels

abstract: Current methods focusing on medical image segmentation suffer from incorrect annotations, which is known as the noisy label issue. Most medical image segmentation with noisy labels methods utilize either noise transition matrix, noise-robust loss functions or pseudo-labeling methods, while none of the current research focuses on clean label disentanglement. We argue that the main reason is that the severe class-imbalanced issue will lead to the inaccuracy of the selected ``clean'' labels, thus influencing the robustness of the model against the noises. In this work, we come up with a simple but efficient class-balanced sampling strategy to tackle the class-imbalanced problem, which enables our newly proposed clean label disentangling framework to successfully select clean labels from the given label sets and encourages the model to learn from the correct annotations. However, such a method will filter out too many annotations which may also contain useful information. Therefore, we further extend our clean label disentangling framework to a new noisy feature-aided clean label disentangling framework, which takes the full annotations into utilization to learn more semantics. Extensive experiments have validated the effectiveness of our methods, where our methods achieve new state-of-the-art performance. Our code is available at https://github.com/xiaoyao3302/2BDenoise.


title: GeoScaler: Geometry and Rendering-Aware Downsampling of 3D Mesh Textures

abstract: High-resolution texture maps are necessary for representing real-world objects accurately with 3D meshes. The large sizes of textures can bottleneck the real-time rendering of high-quality virtual 3D scenes on devices having low computational budgets and limited memory. Downsampling the texture maps directly addresses the issue, albeit at the cost of visual fidelity. Traditionally, downsampling of texture maps is performed using methods like bicubic interpolation and the Lanczos algorithm. These methods ignore the geometric layout of the mesh and its UV parametrization and also do not account for the rendering process used to obtain the final visualization that the users will experience. Towards filling these gaps, we introduce GeoScaler, which is a method of downsampling texture maps of 3D meshes while incorporating geometric cues, and by maximizing the visual fidelity of the rendered views of the textured meshes. We show that the textures generated by GeoScaler deliver significantly better quality rendered images compared to those generated by traditional downsampling methods


title: Discretization of Camassa-Holm peakon equation using orthogonal polynomials and matrix $LR$ transformations

abstract: Discrete integrable systems are closely related to orthogonal polynomials and isospectral matrix transformations. In this paper, we use these relationships to propose a nonautonomous time-discretization of the Camassa-Holm (CH) peakon equation, which describes the motion of peakon waves, which are soliton waves with sharp peaks. We then validate our time-discretization, and clarify its asymptotic behavior as the discrete-time goes to infinity. We present numerical examples to demonstrate that the proposed discrete equation captures peakon wave motions.


title: The Inverse of the Complex Gamma Function

abstract: We consider the functional inverse of the Gamma function in the complex plane, where it is multi-valued, and define a set of suitable branches by proposing a natural extension from the real case.


title: FedAL: Black-Box Federated Knowledge Distillation Enabled by Adversarial Learning

abstract: Knowledge distillation (KD) can enable collaborative learning among distributed clients that have different model architectures and do not share their local data and model parameters with others. Each client updates its local model using the average model output/feature of all client models as the target, known as federated KD. However, existing federated KD methods often do not perform well when clients' local models are trained with heterogeneous local datasets. In this paper, we propose Federated knowledge distillation enabled by Adversarial Learning (FedAL) to address the data heterogeneity among clients. First, to alleviate the local model output divergence across clients caused by data heterogeneity, the server acts as a discriminator to guide clients' local model training to achieve consensus model outputs among clients through a min-max game between clients and the discriminator. Moreover, catastrophic forgetting may happen during the clients' local training and global knowledge transfer due to clients' heterogeneous local data. Towards this challenge, we design the less-forgetting regularization for both local training and global knowledge transfer to guarantee clients' ability to transfer/learn knowledge to/from others. Experimental results show that FedAL and its variants achieve higher accuracy than other federated KD baselines.


title: Sorting Out New York City's Trash Problem

abstract: To reduce waste and improve public health and sanitation in New York City, innovative policies tailored to the city's unique urban landscape are necessary. The first program we propose is the Dumpster and Compost Accessibility Program. This program is affordable and utilizes dumpsters placed near fire hydrants to keep waste off the street without eliminating parking spaces. It also includes legal changes and the provision of compost bins to single/two-family households, which together will increase composting rates. The second program is the Pay-As-You-Throw Program. This requires New Yorkers living in single/two-family households to purchase stickers for each refuse bag they have collected by the city, incentivizing them to sort out compostable waste and recyclables. We conduct a weighted multi-objective optimization to determine the optimal sticker price based on the City's priorities. Roughly in proportion to the price, this program will increase diversion rates and decrease the net costs to New York City's Department of Sanitation. In conjunction, these two programs will improve NYC's diversion rates, eliminate garbage bags from the streets, and potentially save New York City money.


title: SARDINE: A Simulator for Automated Recommendation in Dynamic and Interactive Environments

abstract: Simulators can provide valuable insights for researchers and practitioners who wish to improve recommender systems, because they allow one to easily tweak the experimental setup in which recommender systems operate, and as a result lower the cost of identifying general trends and uncovering novel findings about the candidate methods. A key requirement to enable this accelerated improvement cycle is that the simulator is able to span the various sources of complexity that can be found in the real recommendation environment that it simulates. With the emergence of interactive and data-driven methods - e.g., reinforcement learning or online and counterfactual learning-to-rank - that aim to achieve user-related goals beyond the traditional accuracy-centric objectives, adequate simulators are needed. In particular, such simulators must model the various mechanisms that render the recommendation environment dynamic and interactive, e.g., the effect of recommendations on the user or the effect of biased data on subsequent iterations of the recommender system. We therefore propose SARDINE, a flexible and interpretable recommendation simulator that can help accelerate research in interactive and data-driven recommender systems. We demonstrate its usefulness by studying existing methods within nine diverse environments derived from SARDINE, and even uncover novel insights about them.


title: Parameterized Inapproximability Hypothesis under ETH

abstract: The Parameterized Inapproximability Hypothesis (PIH) asserts that no fixed parameter tractable (FPT) algorithm can distinguish a satisfiable CSP instance, parameterized by the number of variables, from one where every assignment fails to satisfy an $\varepsilon$ fraction of constraints for some absolute constant $\varepsilon > 0$. PIH plays the role of the PCP theorem in parameterized complexity. However, PIH has only been established under Gap-ETH, a very strong assumption with an inherent gap. In this work, we prove PIH under the Exponential Time Hypothesis (ETH). This is the first proof of PIH from a gap-free assumption. Our proof is self-contained and elementary. We identify an ETH-hard CSP whose variables take vector values, and constraints are either linear or of a special parallel structure. Both kinds of constraints can be checked with constant soundness via a "parallel PCP of proximity" based on the Walsh-Hadamard code.


title: Ascle: A Python Natural Language Processing Toolkit for Medical Text Generation

abstract: This study introduces Ascle, a pioneering natural language processing (NLP) toolkit designed for medical text generation. Ascle is tailored for biomedical researchers and healthcare professionals with an easy-to-use, all-in-one solution that requires minimal programming expertise. For the first time, Ascle evaluates and provides interfaces for the latest pre-trained language models, encompassing four advanced and challenging generative functions: question-answering, text summarization, text simplification, and machine translation. In addition, Ascle integrates 12 essential NLP functions, along with query and search capabilities for clinical databases. The toolkit, its models, and associated data are publicly available via https://github.com/Yale-LILY/MedGen.


title: HD Maps are Lane Detection Generalizers: A Novel Generative Framework for Single-Source Domain Generalization

abstract: Lane detection is a vital task for vehicles to navigate and localize their position on the road. To ensure reliable driving, lane detection models must have robust generalization performance in various road environments. However, despite the advanced performance in the trained domain, their generalization performance still falls short of expectations due to the domain discrepancy. To bridge this gap, we propose a novel generative framework using HD Maps for Single-Source Domain Generalization (SSDG) in lane detection. We first generate numerous front-view images from lane markings of HD Maps. Next, we strategically select a core subset among the generated images using (i) lane structure and (ii) road surrounding criteria to maximize their diversity. In the end, utilizing this core set, we train lane detection models to boost their generalization performance. We validate that our generative framework from HD Maps outperforms the Domain Adaptation model MLDA with +3.01%p accuracy improvement, even though we do not access the target domain images.


title: Atomic diffusion-induced polarization and superconductivity in topological insulator-based heterostructures

abstract: The proximity effect at a highly transparent interface of an s-wave superconductor (S) and a topological insulator (TI) provides a promising platform to create Majorana zero modes in artificially designed heterostructures. However, structural and chemical issues pertinent to such interfaces are poorly explored so far. Here, we report the discovery of Pd diffusion induced polarization at interfaces between superconductive Pd$_{1+x}$(Bi$_{0.4}$Te$_{0.6}$)$_2$ (xPBT, $0\le x \le 1$) and Pd-intercalated Bi$_2$Te$_3$ by using atomic-resolution scanning transmission electron microscopy. Our quantitative image analysis reveals that nanoscale lattice strain and QL polarity synergistically suppress and promote the Pd diffusion at the normal and parallel interfaces, formed between Te-Pd-Bi triple layers (TLs) and Te-Bi-Te-Bi-Te quintuple layers (QLs), respectively. Further, our first-principles calculations unveil that the superconductivity of xPBT phase and topological nature of Pd-intercalated Bi$_2$Te$_3$ phase are robust against the broken inversion symmetry. These findings point out the necessity of considering coexistence of electric polarization with superconductivity and topology in such S-TI systems.


title: Degenerate drift-diffusion systems for memristors

abstract: A system of degenerate drift-diffusion equations for the electron, hole, and oxygen vacancy densities, coupled to the Poisson equation for the electric potential, is analyzed in a three-dimensional bounded domain with mixed Dirichlet-Neumann boundary conditions. The equations model the dynamics of the charge carriers in a memristor device in the high-density regime. Memristors can be seen as nonlinear resistors with memory, mimicking the conductance response of biological synapses. The global existence of weak solutions and the weak-strong uniqueness property is proved. Thanks to the degenerate diffusion, better regularity results compared to linear diffusion can be shown, in particular the boundedness of the solutions.


title: RGBGrasp: Image-based Object Grasping by Capturing Multiple Views during Robot Arm Movement with Neural Radiance Fields

abstract: Robotic research encounters a significant hurdle when it comes to the intricate task of grasping objects that come in various shapes, materials, and textures. Unlike many prior investigations that heavily leaned on specialized point-cloud cameras or abundant RGB visual data to gather 3D insights for object-grasping missions, this paper introduces a pioneering approach called RGBGrasp. This method depends on a limited set of RGB views to perceive the 3D surroundings containing transparent and specular objects and achieve accurate grasping. Our method utilizes pre-trained depth prediction models to establish geometry constraints, enabling precise 3D structure estimation, even under limited view conditions. Finally, we integrate hash encoding and a proposal sampler strategy to significantly accelerate the 3D reconstruction process. These innovations significantly enhance the adaptability and effectiveness of our algorithm in real-world scenarios. Through comprehensive experimental validations, we demonstrate that RGBGrasp achieves remarkable success across a wide spectrum of object-grasping scenarios, establishing it as a promising solution for real-world robotic manipulation tasks. The demonstrations of our method can be found on: https://sites.google.com/view/rgbgrasp


title: Empowering COVID-19 Detection: Optimizing Performance Through Fine-Tuned EfficientNet Deep Learning Architecture

abstract: The worldwide COVID-19 pandemic has profoundly influenced the health and everyday experiences of individuals across the planet. It is a highly contagious respiratory disease requiring early and accurate detection to curb its rapid transmission. Initial testing methods primarily revolved around identifying the genetic composition of the coronavirus, exhibiting a relatively low detection rate and requiring a time-intensive procedure. To address this challenge, experts have suggested using radiological imagery, particularly chest X-rays, as a valuable approach within the diagnostic protocol. This study investigates the potential of leveraging radiographic imaging (X-rays) with deep learning algorithms to swiftly and precisely identify COVID-19 patients. The proposed approach elevates the detection accuracy by fine-tuning with appropriate layers on various established transfer learning models. The experimentation was conducted on a COVID-19 X-ray dataset containing 2000 images. The accuracy rates achieved were impressive of 100% for EfficientNetB4 model. The fine-tuned EfficientNetB4 achieved an excellent accuracy score, showcasing its potential as a robust COVID-19 detection model. Furthermore, EfficientNetB4 excelled in identifying Lung disease using Chest X-ray dataset containing 4,350 Images, achieving remarkable performance with an accuracy of 99.17%, precision of 99.13%, recall of 99.16%, and f1-score of 99.14%. These results highlight the promise of fine-tuned transfer learning for efficient lung detection through medical imaging, especially with X-ray images. This research offers radiologists an effective means of aiding rapid and precise COVID-19 diagnosis and contributes valuable assistance for healthcare professionals in accurately identifying affected patients.


title: Monitor Placement for Fault Localization in Deep Neural Network Accelerators

abstract: Systolic arrays are a prominent choice for deep neural network (DNN) accelerators because they offer parallelism and efficient data reuse. Improving the reliability of DNN accelerators is crucial as hardware faults can degrade the accuracy of DNN inferencing. Systolic arrays make use of a large number of processing elements (PEs) for parallel processing, but when one PE is faulty, the error propagates and affects the outcomes of downstream PEs. Due to the large number of PEs, the cost associated with implementing hardware-based runtime monitoring of every single PE is infeasible. We present a solution to optimize the placement of hardware monitors within systolic arrays. We first prove that $2N-1$ monitors are needed to localize a single faulty PE and we also derive the monitor placement. We show that a second placement optimization problem, which minimizes the set of candidate faulty PEs for a given number of monitors, is NP-hard. Therefore, we propose a heuristic approach to balance the reliability and hardware resource utilization in DNN accelerators when number of monitors is limited. Experimental evaluation shows that to localize a single faulty PE, an area overhead of only 0.33% is incurred for a $256\times 256$ systolic array.


title: D4AM: A General Denoising Framework for Downstream Acoustic Models

abstract: The performance of acoustic models degrades notably in noisy environments. Speech enhancement (SE) can be used as a front-end strategy to aid automatic speech recognition (ASR) systems. However, existing training objectives of SE methods are not fully effective at integrating speech-text and noisy-clean paired data for training toward unseen ASR systems. In this study, we propose a general denoising framework, D4AM, for various downstream acoustic models. Our framework fine-tunes the SE model with the backward gradient according to a specific acoustic model and the corresponding classification objective. In addition, our method aims to consider the regression objective as an auxiliary loss to make the SE model generalize to other unseen acoustic models. To jointly train an SE unit with regression and classification objectives, D4AM uses an adjustment scheme to directly estimate suitable weighting coefficients rather than undergoing a grid search process with additional training costs. The adjustment scheme consists of two parts: gradient calibration and regression objective weighting. The experimental results show that D4AM can consistently and effectively provide improvements to various unseen acoustic models and outperforms other combination setups. Specifically, when evaluated on the Google ASR API with real noisy data completely unseen during SE training, D4AM achieves a relative WER reduction of 24.65% compared with the direct feeding of noisy input. To our knowledge, this is the first work that deploys an effective combination scheme of regression (denoising) and classification (ASR) objectives to derive a general pre-processor applicable to various unseen ASR systems. Our code is available at https://github.com/ChangLee0903/D4AM.


title: Continued fractions of cubic irrationalities

abstract: We highlight some facts about continued fractions of real cubic irrationalities. This may be thought as a small section in a textbook on continued fractions.


title: Relative Calabi-Yau structures and perverse schobers on surfaces

abstract: We give a treatment of relative Calabi--Yau structures on functors between $R$-linear stable $\infty$-categories, with $R$ any $\mathbb{E}_\infty$-ring spectrum, generalizing previous treatments in the setting of dg-categories. Using their gluing properties, we further construct relative Calabi--Yau structures on the global sections of perverse schobers, i.e. categorified perverse sheaves, on surfaces with boundary. We treat examples related to Fukaya categories and representation theory. In a related direction, we define the monodromy of a perverse schober parametrized by a ribbon graph on a framed surface and show that it forms a local system of stable $\infty$-categories.


title: Rectangular Hull Confidence Regions for Multivariate Parameters

abstract: We introduce three notions of multivariate median bias, namely, rectilinear, Tukey, and orthant median bias. Each of these median biases is zero under a suitable notion of multivariate symmetry. We study the coverage probabilities of rectangular hull of $B$ independent multivariate estimators, with special attention to the number of estimators $B$ needed to ensure a miscoverage of at most $\alpha$. It is proved that for estimators with zero orthant median bias, we need $B\geq c\log_2(d/\alpha)$ for some constant $c > 0$. Finally, we show that there exists an asymptotically valid (non-trivial) confidence region for a multivariate parameter $\theta_0$ if and only if there exists a (non-trivial) estimator with an asymptotic orthant median bias of zero.


title: Statistics of tens-of-photon states scattered by optical cavity, two-level atom and Jaynes-Cummings emitter

abstract: Manipulating photon states serves as a primary requirement for various optical devices and is of high relevance for quantum information technology. Nevertheless, the fundamental theoretical framework for tens-of-photon states has not been established. This study successfully establishes the matrix-product-state theory to explore the statistics of the tens-of-photon states scattered by optical cavities (OCs), two-level atoms (TLAs), and Jaynes-Cummings emitters (JCEs) in waveguide-QED systems. Taking 10-photon states as an example, we reveal some novel physical results that differ from those for few-photon cases. We verify that OCs do not change the statistics of the incident photon states, being independent of the photon number. However, for the TLAs and JCEs, the photon number strongly impacts the photon bunching and anti-bunching behaviors. As the photon number increases, there exists a maximum strength for the photon-photon correlation induced by the JCE. Especially, the scattered waves by the TLA (or JCE) exhibit extremely different statistics behaviors for the 10-photon cases from those for the bi-photon. These distinguishable conclusions for the tens-of-photon states and the matrix-product-state theory pave the way for the multi-photon manipulation.


title: Morphisms of Cuntz-Pimsner algebras from completely positive maps

abstract: We introduce positive correspondences as right C*-modules with left actions given by completely positive maps. Positive correspondences form a semi-category that contains the C*-correspondence (Enchilada) category as a "retract". Kasparov's KSGNS construction provides a semi-functor from this semi-category onto the C*-correspondence category. The need for left actions by completely positive maps appears naturally when we consider morphisms between Cuntz-Pimsner algebras, and we describe classes of examples arising from projections on C*-correspondences and Fock spaces, as well as examples from conjugation by bi-Hilbertian bimodules of finite index.


title: Harnessing customized built-in elements -- Empowering Component-Based Software Engineering and Design Systems with HTML5 Web Components

abstract: Customized built-in elements in HTML5 significantly transform web development. These elements enable developers to create unique HTML components tailored with specific design and purpose. Customized built-in elements enable developers to address the unique needs of web applications more quickly, supporting consistent user interfaces and experiences across diverse digital platforms. This study investigates the role of these features in Component-Based Software Engineering (CBSE) and Design Systems, emphasizing the benefits of code modularity, reusability, and scalability in web development. Customized built-in elements enable developers to address the unique needs of web applications more quickly, supporting consistent user interfaces and experiences across diverse digital platforms. The paper also discusses the difficulties and concerns that must be addressed when creating customized built-in elements, such as browser compatibility, performance optimization, accessibility, security, styling, and interoperability. It emphasizes the importance of standardization, developer tooling, and community interaction in order to fully realize the potential of these features. Looking ahead, customized built-in elements have potential in a variety of applications, including the Internet of Things (IoT), e-commerce, and educational technologies. Their incorporation into Progressive Web Apps (PWAs) is expected to further improve web experiences. While obstacles remain, the article concludes that HTML5 customized built-in elements are a driver for web development innovation, allowing the production of efficient, adaptive, and user-centric web applications in an ever-changing digital context.


title: GSP-KalmanNet: Tracking Graph Signals via Neural-Aided Kalman Filtering

abstract: Dynamic systems of graph signals are encountered in various applications, including social networks, power grids, and transportation. While such systems can often be described as state space (SS) models, tracking graph signals via conventional tools based on the Kalman filter (KF) and its variants is typically challenging. This is due to the nonlinearity, high dimensionality, irregularity of the domain, and complex modeling associated with real-world dynamic systems of graph signals. In this work, we study the tracking of graph signals using a hybrid model-based/data-driven approach. We develop the GSP-KalmanNet, which tracks the hidden graphical states from the graphical measurements by jointly leveraging graph signal processing (GSP) tools and deep learning (DL) techniques. The derivations of the GSP-KalmanNet are based on extending the KF to exploit the inherent graph structure via graph frequency domain filtering, which considerably simplifies the computational complexity entailed in processing high-dimensional signals and increases the robustness to small topology changes. Then, we use data to learn the Kalman gain following the recently proposed KalmanNet framework, which copes with partial and approximated modeling, without forcing a specific model over the noise statistics. Our empirical results demonstrate that the proposed GSP-KalmanNet achieves enhanced accuracy and run time performance as well as improved robustness to model misspecifications compared with both model-based and data-driven benchmarks.


title: l2Match: Optimization Techniques on Subgraph Matching Algorithm using Label Pair, Neighboring Label Index, and Jump-Redo method

abstract: Graph database is designed to store bidirectional relationships between objects and facilitate the traversal process to extract a subgraph. However, the subgraph matching process is an NP-Complete problem. Existing solutions to this problem usually employ a filter-and-verification framework and a divide-and-conquer method. The filter-and-verification framework minimizes the number of inputs to the verification stage by filtering and pruning invalid candidates as much as possible. Meanwhile, subgraph matching is performed on the substructure decomposed from the larger graph to yield partial embedding. Subsequently, the recursive traversal or set intersection technique combines the partial embedding into a complete subgraph. In this paper, we first present a comprehensive literature review of the state-of-the-art solutions. l2Match, a subgraph isomorphism algorithm for small queries utilizing a Label-Pair Index and filtering method, is then proposed and presented as a proof of concept. Empirical experimentation shows that l2Match outperforms related state-of-the-art solutions, and the proposed methods optimize the existing algorithms.


title: LC4SV: A Denoising Framework Learning to Compensate for Unseen Speaker Verification Models

abstract: The performance of speaker verification (SV) models may drop dramatically in noisy environments. A speech enhancement (SE) module can be used as a front-end strategy. However, existing SE methods may fail to bring performance improvements to downstream SV systems due to artifacts in the predicted signals of SE models. To compensate for artifacts, we propose a generic denoising framework named LC4SV, which can serve as a pre-processor for various unknown downstream SV models. In LC4SV, we employ a learning-based interpolation agent to automatically generate the appropriate coefficients between the enhanced signal and its noisy input to improve SV performance in noisy environments. Our experimental results demonstrate that LC4SV consistently improves the performance of various unseen SV systems. To the best of our knowledge, this work is the first attempt to develop a learning-based interpolation scheme aiming at improving SV performance in noisy environments.


title: LasTGL: An Industrial Framework for Large-Scale Temporal Graph Learning

abstract: Over the past few years, graph neural networks (GNNs) have become powerful and practical tools for learning on (static) graph-structure data. However, many real-world applications, such as social networks and e-commerce, involve temporal graphs where nodes and edges are dynamically evolving. Temporal graph neural networks (TGNNs) have progressively emerged as an extension of GNNs to address time-evolving graphs and have gradually become a trending research topic in both academics and industry. Advancing research and application in such an emerging field necessitates the development of new tools to compose TGNN models and unify their different schemes for dealing with temporal graphs. In this work, we introduce LasTGL, an industrial framework that integrates unified and extensible implementations of common temporal graph learning algorithms for various advanced tasks. The purpose of LasTGL is to provide the essential building blocks for solving temporal graph learning tasks, focusing on the guiding principles of user-friendliness and quick prototyping on which PyTorch is based. In particular, LasTGL provides comprehensive temporal graph datasets, TGNN models and utilities along with well-documented tutorials, making it suitable for both absolute beginners and expert deep learning practitioners alike.


title: A note on extreme points of the unit of Hardy-Lorentz spaces

abstract: We show that inner functions are extreme points of the unit ball of the Hardy-Lorentz space $H(\Lambda(\varphi))$, for $\Lambda(\varphi)$ a Lorentz space with $\varphi$ strictly increasing and strictly concave.


title: Extending the WMSO+U Logic With Quantification Over Tuples

abstract: We study a new extension of the weak MSO logic, talking about boundedness. Instead of a previously considered quantifier U, expressing the fact that there exist arbitrarily large finite sets satisfying a given property, we consider a generalized quantifier U, expressing the fact that there exist tuples of arbitrarily large finite sets satisfying a given property. First, we prove that the new logic WMSO+U_tup is strictly more expressive than WMSO+U. In particular, WMSO+U_tup is able to express the so-called simultaneous unboundedness property, for which we prove that it is not expressible in WMSO+U. Second, we prove that it is decidable whether the tree generated by a given higher-order recursion scheme satisfies a given sentence of WMSO+K_tup.


title: Fourier Features for Identifying Differential Equations (FourierIdent)

abstract: We investigate the benefits and challenges of utilizing the frequency information in differential equation identification. Solving differential equations and Fourier analysis are closely related, yet there is limited work in exploring this connection in the identification of differential equations. Given a single realization of the differential equation perturbed by noise, we aim to identify the underlying differential equation governed by a linear combination of linear and nonlinear differential and polynomial terms in the frequency domain. This is challenging due to large magnitudes and sensitivity to noise. We introduce a Fourier feature denoising, and define the meaningful data region and the core regions of features to reduce the effect of noise in the frequency domain. We use Subspace Pursuit on the core region of the time derivative feature, and introduce a group trimming step to refine the support. We further introduce a new energy based on the core regions of features for coefficient identification. Utilizing the core regions of features serves two critical purposes: eliminating the low-response regions dominated by noise, and enhancing the accuracy in coefficient identification. The proposed method is tested on various differential equations with linear, nonlinear, and high-order derivative feature terms. Our results demonstrate the advantages of the proposed method, particularly on complex and highly corrupted datasets.


title: Eigenmatrix for unstructured sparse recovery

abstract: This note considers the unstructured sparse recovery problems in a general form. Examples include rational approximation, spectral function estimation, Fourier inversion, Laplace inversion, and sparse deconvolution. The main challenges are the noise in the sample values and the unstructured nature of the sample locations. This note proposes the eigenmatrix, a data-driven construction with desired approximate eigenvalues and eigenvectors. The eigenmatrix offers a new way for these sparse recovery problems. Numerical results are provided to demonstrate the efficiency of the proposed method.

categories: math.NA cs.IT cs.LG cs.NA eess.SP math.IT


title: The Empathic Metaverse: An Assistive Bioresponsive Platform For Emotional Experience Sharing

abstract: The Metaverse is poised to be a future platform that redefines what it means to communicate, socialize, and interact with each other. Yet, it is important for us to consider avoiding the pitfalls of social media platforms we use today; cyberbullying, lack of transparency and an overall false mental model of society. In this paper, we propose the Empathic Metaverse, a virtual platform that prioritizes emotional sharing for assistance. It aims to cultivate prosocial behaviour, either egoistically or altruistically, so that our future society can better feel for each other and assist one another. To achieve this, we propose the platform to be bioresponsive; it reacts and adapts to an individual's physiological and cognitive state and reflects this via carefully designed avatars, environments, and interactions. We explore this concept in terms of three research directions: bioresponsive avatars, mediated communications and assistive tools.


title: Numerical Method for a Controlled Sweeping Process with Nonsmooth Sweeping Set

abstract: The numerical method developed in [30] for optimal control problems involving sweeping processes with smooth sweeping set C is generalized to the case where C is nonsmooth, namely, C is the intersection of a finite number of sublevel sets of smooth functions. The novelty of this extension resides in producing for the general setting a different approach, since the one used for the smooth sweeping sets is not applicable here.


title: Spectral condensation in quasi-geostrophic turbulence above small-scale topography

abstract: Sea-floor topography is essential for oceanic fluid dynamics in many perspectives, and it is believed to enhance energy dissipation to oceanic flows. This study numerically examines the impact of small-scale topography on the dynamic of quasi-geostrophic barotropic flows and finds that small-amplitude topography enhances upscale energy flux and leads to condensation, which contradicts the common understanding. Topography-induced dissipation only happens when its amplitude is stronger than the first critical value. And there exists a second critical topography magnitude, corresponding to a second-order phase transition. When the topography magnitude lies between the two critical values, energy simultaneously transfers to both large and small scales. When the topography magnitude exceeds the second critical value, energy only transfers downscale. The discovery of counterintuitive topography-enhanced energy flux and the critical phenomenon brings new challenges to topography parameterization in ocean models.


title: Filter-Pruning of Lightweight Face Detectors Using a Geometric Median Criterion

abstract: Face detectors are becoming a crucial component of many applications, including surveillance, that often have to run on edge devices with limited processing power and memory. Therefore, there's a pressing demand for compact face detection models that can function efficiently across resource-constrained devices. Over recent years, network pruning techniques have attracted a lot of attention from researchers. These methods haven't been well examined in the context of face detectors, despite their expanding popularity. In this paper, we implement filter pruning on two already small and compact face detectors, named EXTD (Extremely Tiny Face Detector) and EResFD (Efficient ResNet Face Detector). The main pruning algorithm that we utilize is Filter Pruning via Geometric Median (FPGM), combined with the Soft Filter Pruning (SFP) iterative procedure. We also apply L1 Norm pruning, as a baseline to compare with the proposed approach. The experimental evaluation on the WIDER FACE dataset indicates that the proposed approach has the potential to further reduce the model size of already lightweight face detectors, with limited accuracy loss, or even with small accuracy gain for low pruning rates.


title: A Multivariate Unimodality Test Harnessing the Dip Statistic of Mahalanobis Distances Over Random Projections

abstract: Unimodality, pivotal in statistical analysis, offers insights into dataset structures and drives sophisticated analytical procedures. While unimodality's confirmation is straightforward for one-dimensional data using methods like Silverman's approach and Hartigans' dip statistic, its generalization to higher dimensions remains challenging. By extrapolating one-dimensional unimodality principles to multi-dimensional spaces through linear random projections and leveraging point-to-point distancing, our method, rooted in $\alpha$-unimodality assumptions, presents a novel multivariate unimodality test named mud-pod. Both theoretical and empirical studies confirm the efficacy of our method in unimodality assessment of multidimensional datasets as well as in estimating the number of clusters.


title: Space-based optical imaging of blue corona discharges on cumulonimbus cloud tops

abstract: The ILAN-ES (Imaging of Lightning And Nocturnal Emissions from Space) experiment was conducted in April 2022 as part of the Axiom company AX-1 private mission to the International Space Station, in the framework of Rakia, an Israeli set of experiments selected for flight by the Ramon Foundation and the Israeli Space Agency. The mission objective was to record transient luminous events from the Cupola window in the ISS, based on preliminary thunderstorm forecasts uploaded to the crew 24-36 hours in advance. A Nikon D6 camera with a 50 mm lens was used, in a video mode of 60 fps. During the 12-day mission, 82 different targets were identified for the ISS, of which 20 were imaged by the astronauts, yielding a total harvest > 80 TLEs: sprites, Elves and BLUEs (blue corona discharges). We report here on opportune nadir observation of a thunderstorm that produced multiple blue events near the Myanmar-Thailand border on April 21st, 2022, at 21:30 UT. The storm produced many visible blue discharges of varying sizes and durations, in sizes ranging from hundreds of meters to a few km2. The emissions were mostly in blue, however the brightest events had also a conspicuous red component. We used meteorological and ENTLN lightning data to establish the relationship between lightning type and the observable properties of the blue corona discharges.


abstract: The development of causal prediction models is challenged by the fact that the outcome is only observable for the applied (factual) intervention and not for its alternatives (the so-called counterfactuals); in medicine we only know patients' survival for the administered drug and not for other therapeutic options. Machine learning approaches for counterfactual reasoning have to deal with both unobserved outcomes and distributional differences due to non-random treatment administration. Unsupervised domain adaptation (UDA) addresses similar issues; one has to deal with unobserved outcomes -- the labels of the target domain -- and distributional differences between source and target domain. We propose Adversarial Distribution Balancing for Counterfactual Reasoning (ADBCR), which directly uses potential outcome estimates of the counterfactuals to remove spurious causal relations. We show that ADBCR outcompetes state-of-the-art methods on three benchmark datasets, and demonstrate that ADBCR's performance can be further improved if unlabeled validation data are included in the training procedure to better adapt the model to the validation domain.


title: Local model theory for non-generic tame potentially Barsotti--Tate deformation rings

abstract: We develop a local model theory for moduli stacks of $2$-dimensional non-scalar tame potentially Barsotti--Tate Galois representations of the Galois group of an unramified extension of $\mathbb{Q}_p$. We derive from this explicit presentations of potentially Barsotti--Tate deformation rings, allowing us to prove structural results about them, and prove various conjectures formulated by Caruso--David--M\'ezard.


title: Cross-level Attention with Overlapped Windows for Camouflaged Object Detection

abstract: Camouflaged objects adaptively fit their color and texture with the environment, which makes them indistinguishable from the surroundings. Current methods revealed that high-level semantic features can highlight the differences between camouflaged objects and the backgrounds. Consequently, they integrate high-level semantic features with low-level detailed features for accurate camouflaged object detection (COD). Unlike previous designs for multi-level feature fusion, we state that enhancing low-level features is more impending for COD. In this paper, we propose an overlapped window cross-level attention (OWinCA) to achieve the low-level feature enhancement guided by the highest-level features. By sliding an aligned window pair on both the highest- and low-level feature maps, the high-level semantics are explicitly integrated into the low-level details via cross-level attention. Additionally, it employs an overlapped window partition strategy to alleviate the incoherence among windows, which prevents the loss of global information. These adoptions enable the proposed OWinCA to enhance low-level features by promoting the separability of camouflaged objects. The associated proposed OWinCANet fuses these enhanced multi-level features by simple convolution operation to achieve the final COD. Experiments conducted on three large-scale COD datasets demonstrate that our OWinCANet significantly surpasses the current state-of-the-art COD methods.


title: Ore Localisation for differential graded rings; Towards Goldie's theorem for differential graded algebras

abstract: We study Ore localisation of differential graded algebras. Further we define dg-prime rings, dg-semiprime rings, and study the dg-nil radical of dg-rings. Then, we define dg-essential submodules, dg-uniform dimension, and apply all this to a dg-version of Goldie's theorem on prime dg-rings.


title: On the Long Range Abilities of Transformers

abstract: Despite their dominance in modern DL and, especially, NLP domains, transformer architectures exhibit sub-optimal performance on long-range tasks compared to recent layers that are specifically designed for this purpose. In this work, drawing inspiration from key attributes of long-range layers, such as state-space layers, linear RNN layers, and global convolution layers, we demonstrate that minimal modifications to the transformer architecture can significantly enhance performance on the Long Range Arena (LRA) benchmark, thus narrowing the gap with these specialized layers. We identify that two key principles for long-range tasks are (i) incorporating an inductive bias towards smoothness, and (ii) locality. As we show, integrating these ideas into the attention mechanism improves results with a negligible amount of additional computation and without any additional trainable parameters. Our theory and experiments also shed light on the reasons for the inferior performance of transformers on long-range tasks and identify critical properties that are essential for successfully capturing long-range dependencies.


title: Beyond Labels: Advancing Cluster Analysis with the Entropy of Distance Distribution (EDD)

abstract: In the evolving landscape of data science, the accurate quantification of clustering in high-dimensional data sets remains a significant challenge, especially in the absence of predefined labels. This paper introduces a novel approach, the Entropy of Distance Distribution (EDD), which represents a paradigm shift in label-free clustering analysis. Traditional methods, reliant on discrete labels, often struggle to discern intricate cluster patterns in unlabeled data. EDD, however, leverages the characteristic differences in pairwise point-to-point distances to discern clustering tendencies, independent of data labeling. Our method employs the Shannon information entropy to quantify the 'peakedness' or 'flatness' of distance distributions in a data set. This entropy measure, normalized against its maximum value, effectively distinguishes between strongly clustered data (indicated by pronounced peaks in distance distribution) and more homogeneous, non-clustered data sets. This label-free quantification is resilient against global translations and permutations of data points, and with an additional dimension-wise z-scoring, it becomes invariant to data set scaling. We demonstrate the efficacy of EDD through a series of experiments involving two-dimensional data spaces with Gaussian cluster centers. Our findings reveal a monotonic increase in the EDD value with the widening of cluster widths, moving from well-separated to overlapping clusters. This behavior underscores the method's sensitivity and accuracy in detecting varying degrees of clustering. EDD's potential extends beyond conventional clustering analysis, offering a robust, scalable tool for unraveling complex data structures without reliance on pre-assigned labels.


title: Precision Enhancement in Spatial Measurement by Introducing Squeezed Light into Weak Value Amplification

abstract: The precision enhancement is demonstrated in an optical spatial measurement based on weak value amplification (WVA) system and split-like detection, by injecting a TEM10 squeezed vacuum beam. It is the first time combining the WVA technique and squeezed beam injection to experimentally realize high-precision optical spatial measurement beyond the standard quantum limit. As a result, the precision enhancement of 1.3 times can be achieved at 500kHz by adding a squeezed beam in the vacuum input port of the Mach-Zehnder interferometer. The minimum measurable displacement is reduced from 1.08pm to 0.85pm and the corresponding minimum measurable tilt is reduced from 0.86prad to 0.67prad. Moreover, the spatial measurement at low-frequency band is also implemented and the SNR is improved 2dB at 4kHz. Our work provides an effective method to accomplish higher precision in optical spatial measurement, which has potential applications in gravitational wave interferometer calibration, super-resolution quantum imaging, etc.


title: Visual Semantic Navigation with Real Robots

abstract: Visual Semantic Navigation (VSN) is the ability of a robot to learn visual semantic information for navigating in unseen environments. These VSN models are typically tested in those virtual environments where they are trained, mainly using reinforcement learning based approaches. Therefore, we do not yet have an in-depth analysis of how these models would behave in the real world. In this work, we propose a new solution to integrate VSN models into real robots, so that we have true embodied agents. We also release a novel ROS-based framework for VSN, ROS4VSN, so that any VSN-model can be easily deployed in any ROS-compatible robot and tested in a real setting. Our experiments with two different robots, where we have embedded two state-of-the-art VSN agents, confirm that there is a noticeable performance difference of these VSN solutions when tested in real-world and simulation environments. We hope that this research will endeavor to provide a foundation for addressing this consequential issue, with the ultimate aim of advancing the performance and efficiency of embodied agents within authentic real-world scenarios. Code to reproduce all our experiments can be found at https://github.com/gramuah/ros4vsn.