title: AccFlow: Backward Accumulation for Long-Range Optical Flow

abstract: Recent deep learning-based optical flow estimators have exhibited impressive performance in generating local flows between consecutive frames. However, the estimation of long-range flows between distant frames, particularly under complex object deformation and large motion occlusion, remains a challenging task. One promising solution is to accumulate local flows explicitly or implicitly to obtain the desired long-range flow. Nevertheless, the accumulation errors and flow misalignment can hinder the effectiveness of this approach. This paper proposes a novel recurrent framework called AccFlow, which recursively backward accumulates local flows using a deformable module called as AccPlus. In addition, an adaptive blending module is designed along with AccPlus to alleviate the occlusion effect by backward accumulation and rectify the accumulation error. Notably, we demonstrate the superiority of backward accumulation over conventional forward accumulation, which to the best of our knowledge has not been explicitly established before. To train and evaluate the proposed AccFlow, we have constructed a large-scale high-quality dataset named CVO, which provides ground-truth optical flow labels between adjacent and distant frames. Extensive experiments validate the effectiveness of AccFlow in handling long-range optical flow estimation. Codes are available at https://github.com/mulns/AccFlow .


title: Enhancement of gravitational waves at Q-ball decay including non-linear density perturbations

abstract: The existence of a stochastic gravitational wave background is indicated by the recent pulsar timing array (PTA) experiments. We study the enhanced production of second-order gravitational waves from the scalar perturbations when the universe experiences a transition from the early matter-dominated era to the radiation-dominated era due to Q-ball decay. We extend the analysis in previous work by including the frequency range where density perturbations go non-linear and find that the resultant gravitational wave spectrum can be consistent with that favored by the recent PTA experiment results.


title: Nonparametric Additive Value Functions: Interpretable Reinforcement Learning with an Application to Surgical Recovery

abstract: We propose a nonparametric additive model for estimating interpretable value functions in reinforcement learning. Learning effective adaptive clinical interventions that rely on digital phenotyping features is a major for concern medical practitioners. With respect to spine surgery, different post-operative recovery recommendations concerning patient mobilization can lead to significant variation in patient recovery. While reinforcement learning has achieved widespread success in domains such as games, recent methods heavily rely on black-box methods, such neural networks. Unfortunately, these methods hinder the ability of examining the contribution each feature makes in producing the final suggested decision. While such interpretations are easily provided in classical algorithms such as Least Squares Policy Iteration, basic linearity assumptions prevent learning higher-order flexible interactions between features. In this paper, we present a novel method that offers a flexible technique for estimating action-value functions without making explicit parametric assumptions regarding their additive functional form. This nonparametric estimation strategy relies on incorporating local kernel regression and basis expansion to obtain a sparse, additive representation of the action-value function. Under this approach, we are able to locally approximate the action-value function and retrieve the nonlinear, independent contribution of select features as well as joint feature pairs. We validate the proposed approach with a simulation study, and, in an application to spine disease, uncover recovery recommendations that are inline with related clinical knowledge.


title: Deciphering The Slow-rise Precursor of a Major Coronal Mass Ejection

abstract: Coronal mass ejections (CMEs) are explosive plasma phenomena prevalently occurring on the Sun and probably on other magnetically active stars. However, how their pre-eruptive configuration evolves toward the main explosion remains elusive. Here, based on comprehensive observations of a long-duration precursor in an event on 2012 March 13, we determine that the heating and slow rise of the pre-eruptive hot magnetic flux rope (MFR) are achieved through a precursor reconnection located above cusp-shaped high-temperature precursor loops. It is observed that the hot MFR threads are built up continually with their middle initially showing an "M" shape and then being separated from the cusp of precursor loops, causing the slow rise of the entire MFR. The slow rise in combination with thermal-dominated hard X-ray source concentrated at the top of the precursor loops shows that the precursor reconnection is much weaker than the flare reconnection of the main eruption. We also perform a three-dimensional magnetohydrodynamics simulation that reproduces the early evolution of the MFR transiting from the slow to fast rise. It is also disclosed that it is the magnetic tension force pertinent to "M"-shaped threads that drives the slow rise, which, however, evolves into a magnetic pressure gradient dominated regime responsible for the rapid-acceleration eruption.


title: OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models

abstract: Large language models (LLMs) have revolutionized natural language processing tasks. However, their practical deployment is hindered by their immense memory and computation requirements. Although recent post-training quantization (PTQ) methods are effective in reducing memory footprint and improving the computational efficiency of LLM, they hand-craft quantization parameters, leading to low performance, especially in extremely low-bit quantization. To tackle this issue, we introduce an Omnidirectionally calibrated Quantization (\textbf{OmniQuant}) technique for LLMs, which achieves good performance in diverse quantization settings while maintaining the computational efficiency of PTQ by efficiently optimizing various quantization parameters. OmniQuant comprises two innovative components including Learnable Weight Clipping (LWC) and Learnable Equivalent Transformation (LET). LWC modulates the extreme values of weights by optimizing the clipping threshold. Meanwhile, LET tackles activation outliers by shifting the challenge of quantization from activations to weights. Operating within a differentiable framework using block-wise error minimization, OmniQuant can optimize the quantization process efficiently for both weight-only and weight-activation quantization. For instance, the LLaMA-2 model family size 7-70B can be processed with OmniQuant on a single A100-40G GPU within 1-16 hours using 128 samples. Extensive experiments validate OmniQuant's superior performance across diverse quantization configurations such as W4A4 (4-bit weight, 4-bit activation), W6A6, W4A16, W3A16, and W2A16. Additionally, OmniQuant demonstrates effectiveness in instruction-tuned models and delivers notable improvements in inference speed and memory reduction on real devices. Codes are available at \url{https://github.com/OpenGVLab/OmniQuant}.


title: Homeomorphism groups of 2-manifolds with the virtual Rokhlin property

abstract: We introduce and motivate the definition of the virtual Rokhlin property for topological groups. We then classify the 2-manifolds whose homeomorphism groups have the virtual Rokhlin property. We also establish the analogous result for mapping class groups of 2-manifolds.


title: MatchXML: An Efficient Text-label Matching Framework for Extreme Multi-label Text Classification

abstract: The eXtreme Multi-label text Classification(XMC) refers to training a classifier that assigns a text sample with relevant labels from an extremely large-scale label set (e.g., millions of labels). We propose MatchXML, an efficient text-label matching framework for XMC. We observe that the label embeddings generated from the sparse Term Frequency-Inverse Document Frequency(TF-IDF) features have several limitations. We thus propose label2vec to effectively train the semantic dense label embeddings by the Skip-gram model. The dense label embeddings are then used to build a Hierarchical Label Tree by clustering. In fine-tuning the pre-trained encoder Transformer, we formulate the multi-label text classification as a text-label matching problem in a bipartite graph. We then extract the dense text representations from the fine-tuned Transformer. Besides the fine-tuned dense text embeddings, we also extract the static dense sentence embeddings from a pre-trained Sentence Transformer. Finally, a linear ranker is trained by utilizing the sparse TF-IDF features, the fine-tuned dense text representations and static dense sentence features. Experimental results demonstrate that MatchXML achieves state-of-the-art accuracy on five out of six datasets. As for the speed, MatchXML outperforms the competing methods on all the six datasets. Our source code is publicly available at https://github.com/huiyegit/MatchXML.


title: Learn With Imagination: Safe Set Guided State-wise Constrained Policy Optimization

abstract: Deep reinforcement learning (RL) excels in various control tasks, yet the absence of safety guarantees hampers its real-world applicability. In particular, explorations during learning usually results in safety violations, while the RL agent learns from those mistakes. On the other hand, safe control techniques ensure persistent safety satisfaction but demand strong priors on system dynamics, which is usually hard to obtain in practice. To address these problems, we present Safe Set Guided State-wise Constrained Policy Optimization (S-3PO), a pioneering algorithm generating state-wise safe optimal policies with zero training violations, i.e., learning without mistakes. S-3PO first employs a safety-oriented monitor with black-box dynamics to ensure safe exploration. It then enforces a unique cost for the RL agent to converge to optimal behaviors within safety constraints. S-3PO outperforms existing methods in high-dimensional robotics tasks, managing state-wise constraints with zero training violation. This innovation marks a significant stride towards real-world safe RL deployment.


title: A Large-Scale Study of IoT Security Weaknesses and Vulnerabilities in the Wild

abstract: Internet of Things (IoT) is defined as the connection between places and physical objects (i.e., things) over the internet/network via smart computing devices. We observed that IoT software developers share solutions to programming questions as code examples on three Stack Exchange Q&A sites: Stack Overflow (SO), Arduino, and Raspberry Pi. Previous research studies found vulnerabilities/weaknesses in C/C++ code examples shared in Stack Overflow. However, the studies did not investigate C/C++ code examples related to IoT. The studies investigated SO code examples only. In this paper, we conduct a large-scale empirical study of all IoT C/C++ code examples shared in the three Stack Exchange sites, i.e., SO, Arduino, and Raspberry Pi. From the 11,329 obtained code snippets from the three sites, we identify 29 distinct CWE (Common Weakness Enumeration) types in 609 snippets. These CWE types can be categorized into 8 general weakness categories, and we observe that evaluation, memory, and initialization related weaknesses are the most common to be introduced by users when posting programming solutions. Furthermore, we find that 39.58% of the vulnerable code snippets contain instances of CWE types that can be mapped to real-world occurrences of those CWE types (i.e. CVE instances). The most number vulnerable IoT code examples was found in Arduino, followed by SO, and Raspberry Pi. Memory type vulnerabilities are on the rise in the sites. For example, from the 3595 mapped CVE instances, we find that 28.99% result in Denial of Service (DoS) errors, which is particularly harmful for network reliant IoT devices such as smart cars. Our study results can guide various IoT stakeholders to be aware of such vulnerable IoT code examples and to inform IoT researchers during their development of tools that can help prevent developers the sharing of such vulnerable code examples in the sites. [Abridged].


title: A Survey of Diffusion Based Image Generation Models: Issues and Their Solutions

abstract: Recently, there has been significant progress in the development of large models. Following the success of ChatGPT, numerous language models have been introduced, demonstrating remarkable performance. Similar advancements have also been observed in image generation models, such as Google's Imagen model, OpenAI's DALL-E 2, and stable diffusion models, which have exhibited impressive capabilities in generating images. However, similar to large language models, these models still encounter unresolved challenges. Fortunately, the availability of open-source stable diffusion models and their underlying mathematical principles has enabled the academic community to extensively analyze the performance of current image generation models and make improvements based on this stable diffusion framework. This survey aims to examine the existing issues and the current solutions pertaining to image generation models.


title: The Acoustophotoelectric Effect: Efficient Phonon-Photon-Electron Coupling in Zero-Voltage-Biased 2D SnS$_2$ for Broadband Photodetection

abstract: Two-dimensional (2D) layered metal dichalcogenides constitute a promising class of materials for photodetector applications due to their excellent optoelectronic properties. The most common photodetectors, which work on the principle of photoconductive or photovoltaic effects, however, require either the application of external voltage biases or built-in electric fields, which makes it challenging to simultaneously achieve high responsivities across broadband wavelength excitation - especially beyond the material's nominal band gap - while producing low dark currents. In this work, we report the discovery of an intricate phonon-photon-electron coupling - which we term the acoustophotoelectric effect - in SnS$_2$ that facilitates efficient photodetection through the application of 100-MHz-order propagating surface acoustic waves (SAWs). This effect not only reduces the band gap of SnS$_2$, but also provides the requisite momentum for indirect band gap transition of the photoexcited charge carriers, to enable broadband photodetection beyond the visible light range, whilst maintaining pA-order dark currents - remarkably without the need for any external voltage bias. More specifically, we show in the infrared excitation range that it is possible to achieve up to eight orders of magnitude improvement in the material's photoresponsivity compared to that previously reported for SnS$_2$-based photodetectors, in addition to exhibiting superior performance compared to most other 2D materials reported to date for photodetection.


title: Giant orbit-to-charge conversion induced via the inverse orbital Hall effect

abstract: We investigate the orbit-to-charge conversion in YIG/Pt/nonmagnetic material (NM) trilayer heterostructures. With the additional Ru layer on the top of YIG/Pt stacks, the charge current signal increases nearly an order of magnitude in both longitudinal spin Seebeck effect (SSE) and spin pumping (SP) measurements. Through thickness dependence studies of the Ru metal layer and theoretical model, we quantitatively clarify different contributions of the increased SSE signal that mainly comes from the inverse orbital Hall effect (IOHE) of Ru, and partially comes from the orbital sink effect in the Ru layer. A similar enhancement of SSE(SP) signals is also observed when Ru is replaced by other materials (Ta, W, and Cu), implying the universality of the IOHE in transition metals. Our findings not only suggest a more efficient generation of the charge current via the orbital angular moment channel but also provides crucial insights into the interplay among charge, spin, and orbit.


title: Results for convergence rates associated with renewal processes

abstract: Via a coupling argument, it is proved that the solution to a renewal equation has a power law decay rate in the case of a spread out interarrival distribution. By the regenerative property, the convergence in distribution for the recurrence times of the renewal process is established as well as that of the compensator of the renewal counting process. All results are proved under mild assumptions of existence of moments.


title: Angular Momentum Loss During Stable Mass Transfer onto a Compact object: the Effect of Mass Loss via Accretion Disk Winds

abstract: We use an analytic framework to calculate the evolution of binary orbits under a physically-motivated model that accounts for angular momentum loss associated with winds from an accretion disk around the compact objected accretor. Our prescription considers wind mass ejection from the surface of an accretion disk, accounting for a radial mass-loss dependence across the disk surface. We compare this to the standard prescription of angular momentum loss associated with isotropic mass loss from the vicinity of the accretor. The angular momentum loss from a disk-wind is always larger. For mass ratios, $q$, between $2$--$10$, angular momentum loss via a disk wind is $\simeq3$--$40$ times greater than the standard prescription. For the majority of mass ratios and disk properties, accounting for the disk wind can result in considerably smaller orbital separations compared to the standard formalism; the differences being $\simeq 60\%$ depending on how long the effect is integrated for. We conclude that it is important to consider the effects of angular momentum loss from a disk wind when evolving binary orbits.


title: Diverse, Top-k, and Top-Quality Planning Over Simulators

abstract: Diverse, top-k, and top-quality planning are concerned with the generation of sets of solutions to sequential decision problems. Previously this area has been the domain of classical planners that require a symbolic model of the problem instance. This paper proposes a novel alternative approach that uses Monte Carlo Tree Search (MCTS), enabling application to problems for which only a black-box simulation model is available. We present a procedure for extracting bounded sets of plans from pre-generated search trees in best-first order, and a metric for evaluating the relative quality of paths through a search tree. We demonstrate this approach on a path-planning problem with hidden information, and suggest adaptations to the MCTS algorithm to increase the diversity of generated plans. Our results show that our method can generate diverse and high-quality plan sets in domains where classical planners are not applicable.


title: Understanding Turbo Codes: A Signal Processing Study

abstract: In this paper, we study turbo codes from the digital signal processing point of view by defining turbo codes over the complex field. It is known that iterative decoding and interleaving between concatenated parallel codes are two key elements that make turbo codes perform significantly better than the conventional error control codes. This is analytically illustrated in this paper by showing that the decoded noise mean power in the iterative decoding decreases when the number of iterations increases, as long as the interleaving decorrelates the noise after each iterative decoding step. An analytic decreasing rate and the limit of the decoded noise mean power are given. The limit of the decoded noise mean power of the iterative decoding of a turbo code with two parallel codes with their rates less than 1/2 is one third of the noise power before the decoding, which can not be achieved by any non-turbo codes with the same rate. From this study, the role of designing a good interleaver can also be clearly seen.


title: SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research

abstract: Recently, there has been growing interest in using Large Language Models (LLMs) for scientific research. Numerous benchmarks have been proposed to evaluate the ability of LLMs for scientific research. However, current benchmarks are mostly based on pre-collected objective questions. This design suffers from data leakage problem and lacks the evaluation of subjective Q/A ability. In this paper, we propose SciEval, a comprehensive and multi-disciplinary evaluation benchmark to address these issues. Based on Bloom's taxonomy, SciEval covers four dimensions to systematically evaluate scientific research ability. In particular, we design a "dynamic" subset based on scientific principles to prevent evaluation from potential data leakage. Both objective and subjective questions are included in SciEval. These characteristics make SciEval a more effective benchmark for scientific research ability evaluation of LLMs. Comprehensive experiments on most advanced LLMs show that, although GPT-4 achieves SOTA performance compared to other LLMs, there is still substantial room for improvement, especially for dynamic questions. The data and codes are now publicly available.


title: DALAResNet50 for Automatic Histopathology Breast Cancer Image Classification with DT Grad-CAM Explainability

abstract: Automatic breast cancer classification in histopathology images is crucial for precise diagnosis and treatment planning. Recently, classification approaches based on the ResNet architecture have gained popularity for significantly improving accuracy by using skip connections to mitigate vanishing gradient problems, thereby integrating low-level and high-level feature information. Nevertheless, the conventional ResNet architecture faces challenges such as data imbalance and limited interpretability, necessitating cross-domain knowledge and collaboration among medical experts. This study effectively addresses these challenges by introducing a novel method for breast cancer classification, the Dual-Activated Lightweight Attention ResNet50 (DALAResNet50) model. It integrates a pre-trained ResNet50 model with a lightweight attention mechanism, embedding an attention module in the fourth layer of ResNet50 and incorporating two fully connected layers with LeakyReLU and ReLU activation functions to enhance feature learning capabilities. The DALAResNet50 method was tested on breast cancer histopathology images from the BreakHis Database across magnification factors of 40X, 100X, 200X, and 400X, achieving accuracies of 98.5%, 98.7%, 97.9%, and 94.3%, respectively. It was also compared with established deep learning models such as SEResNet50, DenseNet121, VGG16, VGG16Inception, ViT, Swin-Transformer, Dinov2_Vitb14, and ResNet50. The reported results of DALAResNet50 have been shown to outperform the compared approaches regarding accuracy, F1 score, IBA, and GMean, demonstrating significant robustness and broad applicability when dealing with different magnifications and imbalanced breast cancer datasets


title: Circle packings, renormalizations and subdivision rules

abstract: In this paper, we use iterations of skinning maps on Teichm\"uller spaces to study circle packings. This allows us to develop a renormalization theory for circle packings whose nerves satisfy certain subdivision rules. We characterize when the skinning map has bounded image. Under the corresponding condition, we prove that the renormalization operator is uniformly contracting. This allows us to give complete answers for the existence and moduli problems for such circle packings. The exponential contraction has many consequences. In particular, we prove that homeomorphisms between any two such circle packings are asymptotically conformal.


title: The time dimensional reduction method to determine the initial conditions without the knowledge of damping coefficients

abstract: This paper aims to reconstruct the initial condition of a hyperbolic equation with an unknown damping coefficient. Our approach involves approximating the hyperbolic equation's solution by its truncated Fourier expansion in the time domain and using a polynomial-exponential basis. This truncation process facilitates the elimination of the time variable, consequently, yielding a system of quasi-linear elliptic equations. To globally solve the system without needing an accurate initial guess, we employ the Carleman contraction principle. We provide several numerical examples to illustrate the efficacy of our method. The method not only delivers precise solutions but also showcases remarkable computational efficiency.


title: Occupational Retirement and Pension Reform: The Roles of Physical and Cognitive Health

abstract: Despite increasing cognitive demands of jobs, knowledge about the role of health in retirement has centered on its physical dimensions. This paper estimates a dynamic programming model of retirement that incorporates multiple health dimensions, allowing differential effects on labor supply across occupations. Results show that the effect of cognitive health surges exponentially after age 65, and it explains a notable share of employment declines in cognitively demanding occupations. Under pension reforms, physical constraint mainly impedes manual workers from delaying retirement, whereas cognitive constraint dampens the response of clerical and professional workers. Multidimensional health thus unevenly exacerbate welfare losses across occupations.


title: Qubit-based distributed frame synchronization for quantum key distribution

abstract: Quantum key distribution (QKD) is a method that enables two remote parties to share a secure key string. Clock synchronization between two parties is a crucial step in the normal operation of QKD. Qubit-based synchronization can achieve clock synchronization by transmitting quantum states between two remote parties, eliminating the necessity for hardware synchronization and thereby greatly reducing the hardware requirements of a QKD system. Nonetheless, classical qubit-based synchronization exhibits poor performance in continuous and high-loss systems, hindering its wide applicability in various scenarios. We propose a qubit-based distributed frame synchronization method that can achieve time recovery in a continuously running system and resist higher losses. Experimental results show that the proposed method outperforms the advanced qubit-based synchronization method Qubit4Sync in a continuously running system. We believe our method is applicable to a broad range of QKD scenarios, including drone-based QKD and quantum network construction.


title: Hybrid coupling rules for leaderless heterogeneous oscillators: uniform global asymptotic and finite-time synchronization

abstract: We investigate the engineering scenario where the objective is to synchronize heterogeneous oscillators in a distributed fashion. The internal dynamics of each oscillator are general enough to capture their time-varying natural frequency as well as physical couplings and unknown bounded terms. A communication layer is set in place to allow the oscillators to exchange synchronizing coupling actions through a tree-like leaderless network. In particular, we present a class of hybrid coupling rules depending only on local information to ensure uniform global practical or asymptotic synchronization, which is impossible to obtain by using the Kuramoto model customarily used in the literature. We further show that the synchronization set can be made uniformly globally prescribed finite-time stable by selecting the coupling function to be discontinuous at the origin. Novel mathematical tools on non-pathological functions and set-valued Lie derivatives are developed to carry out the stability analysis. The effectiveness of the approach is illustrated in simulations where we apply our synchronizing hybrid coupling rules to models of power grids previously used in the literature.


title: Parental Health Penalty on Adult Children's Employment: Gender Difference and Long-Term Consequence

abstract: This paper examines the long-term gender-specific impacts of parental health shocks on adult children's employment in China. We build up an inter-temporal cooperative framework to analyze household work decisions in response to parental health deterioration. Then employing an event-study approach, we establish a causal link between parental health shocks and a notable decline in female employment rates. Male employment, however, remains largely unaffected. This negative impact shows no abatement up to eight years that are observable by the sample. These findings indicate the consequence of "growing old before getting rich" for developing countries.


title: Federated Learning in IoT: a Survey from a Resource-Constrained Perspective

abstract: The IoT ecosystem is able to leverage vast amounts of data for intelligent decision-making. Federated Learning (FL), a decentralized machine learning technique, is widely used to collect and train machine learning models from a variety of distributed data sources. Both IoT and FL systems can be complementary and used together. However, the resource-constrained nature of IoT devices prevents the widescale deployment FL in the real world. This research paper presents a comprehensive survey of the challenges and solutions associated with implementing Federated Learning (FL) in resource-constrained Internet of Things (IoT) environments, viewed from 2 levels, client and server. We focus on solutions regarding limited client resources, presence of heterogeneous client data, server capacity, and high communication costs, and assess their effectiveness in various scenarios. Furthermore, we categorize the solutions based on the location of their application, i.e., the IoT client, and the FL server. In addition to a comprehensive review of existing research and potential future directions, this paper also presents new evaluation metrics that would allow researchers to evaluate their solutions on resource-constrained IoT devices.


title: DAG-ACFL: Asynchronous Clustered Federated Learning based on DAG-DLT

abstract: Federated learning (FL) aims to collaboratively train a global model while ensuring client data privacy. However, FL faces challenges from the non-IID data distribution among clients. Clustered FL (CFL) has emerged as a promising solution, but most existing CFL frameworks adopt synchronous frameworks lacking asynchrony. An asynchronous CFL framework called SDAGFL based on directed acyclic graph distributed ledger techniques (DAG-DLT) was proposed, but its complete decentralization leads to high communication and storage costs. We propose DAG-ACFL, an asynchronous clustered FL framework based on directed acyclic graph distributed ledger techniques (DAG-DLT). We first detail the components of DAG-ACFL. A tip selection algorithm based on the cosine similarity of model parameters is then designed to aggregate models from clients with similar distributions. An adaptive tip selection algorithm leveraging change-point detection dynamically determines the number of selected tips. We evaluate the clustering and training performance of DAG-ACFL on multiple datasets and analyze its communication and storage costs. Experiments show the superiority of DAG-ACFL in asynchronous clustered FL. By combining DAG-DLT with clustered FL, DAG-ACFL realizes robust, decentralized and private model training with efficient performance.


title: Almost sure scattering for defocusing energy critical Hartree equation on $\R^5$

abstract: We consider the defocusing energy-critical Hartree equation $i\pa_tu+\Delta u=(|\cdot|^{-4}\ast|u|^2)u$ in spatial dimension $d=5$ and prove almost sure scattering with initial data $u_0\in H^s_x(\R^5)$ for any $s\in\R$. The proof relies on the modified interaction Morawetz estimate, the stability theories, the ``Narrowed'' Wiener randomization. We are inspired to consider this problem by the work of Shen-Soffer-Wu \cite{Shen-Soffer-Wu 1}, which treated the analogous problem for the energy-critical Schr\"{o}dinger equation. The new ingredient in this paper are that we take an alternative proof to give the interaction Morawetz estimate. And the nonlocal nonlinearity term will bring some difficulties.


title: Perverse filtrations and Fourier transforms

abstract: We study the interaction between Fourier-Mukai transforms and perverse filtrations for a certain class of dualizable abelian fibrations. Multiplicativity of the perverse filtration and the "Perverse $\supset$ Chern" phenomenon for these abelian fibrations are immediate consequences of our theory. We also show that our class of fibrations include families of compactified Jacobians of integral locally planar curves. Applications include the following: (a) we prove the motivic decomposition conjecture for this class (including compactified Jacobian fibrations), which generalizes Deninger-Murre's theorem for abelian schemes; (b) we provide a new proof of the P=W conjecture for $\mathrm{GL}_r$; (c) we prove half of the P=C conjecture concerning refined BPS invariants for the local $\mathbb{P}^2$; (d) we show that the perverse filtration for the compactified Jacobian associated with an integral locally planar curve is multiplicative, which generalizes a result of Oblomkov-Yun for homogeneous singularities. Our techniques combine Arinkin's autoduality for coherent categories, Ng\^o's support theorem for the decomposition theorem, Adams operations in operational K-theory, and Corti-Hanamura's theory of relative Chow motives.


title: Stochastic Adaptive Regularization Method with Cubics: A High Probability Complexity Bound

abstract: We present a high probability complexity bound for a stochastic adaptive regularization method with cubics, also known as regularized Newton method. The method makes use of stochastic zeroth-, first- and second-order oracles that satisfy certain accuracy and reliability assumptions. Such oracles have been used in the literature by other stochastic adaptive methods, such as trust region and line search. These oracles capture many settings, such as expected risk minimization, simulation optimization, and others. In this paper, we give the first high probability iteration bound for stochastic cubic regularization, and show that just as in the deterministic case, it is superior to other stochastic adaptive methods.


title: Toward the confirmation of atmospheric neutrino oscillations

abstract: The atmospheric muon neutrino deficit, which was possible evidence of $\nu_\mu \leftrightarrow \nu_\tau$ oscillation, was reported by the Kamiokande experiment from 1988. Many experimental efforts were made to examine the Kamiokande results. Experiments which contributed to the confirmation of $\nu_\mu \leftrightarrow \nu_\tau$ oscillation are reviewed. Especially, long-baseline neutrino-oscillation experiments are described in detail.


title: Snapp: An Agile Robotic Fish with 3-D Maneuverability for Open Water Swim

abstract: Fish exhibit impressive locomotive performance and agility in complex underwater environments, using their undulating tails and pectoral fins for propulsion and maneuverability. Replicating these abilities in robotic fish is challenging; existing designs focus on either fast swimming or directional control at limited speeds, mainly within a confined environment. To address these limitations, we designed Snapp, an integrated robotic fish capable of swimming in open water with high speeds and full 3-dimensional maneuverability. A novel cyclic-differential method is layered on the mechanism. It integrates propulsion and yaw-steering for fast course corrections. Two independent pectoral fins provide pitch and roll control. We evaluated Snapp in open water environments. We demonstrated significant improvements in speed and maneuverability, achieving swimming speeds of 1.5 m/s (1.7 Body Lengths per second) and performing complex maneuvers, such as a figure-8 and S-shape trajectory. Instantaneous yaw changes of 15$^{\circ}$ in 0.4 s, a minimum turn radius of 0.85 m, and maximum pitch and roll rates of 3.5 rad/s and 1 rad/s, respectively, were recorded. Our results suggest that Snapp's swimming capabilities have excellent practical prospects for open seas and contribute significantly to developing agile robotic fishes.


title: Diff-Retinex: Rethinking Low-light Image Enhancement with A Generative Diffusion Model

abstract: In this paper, we rethink the low-light image enhancement task and propose a physically explainable and generative diffusion model for low-light image enhancement, termed as Diff-Retinex. We aim to integrate the advantages of the physical model and the generative network. Furthermore, we hope to supplement and even deduce the information missing in the low-light image through the generative network. Therefore, Diff-Retinex formulates the low-light image enhancement problem into Retinex decomposition and conditional image generation. In the Retinex decomposition, we integrate the superiority of attention in Transformer and meticulously design a Retinex Transformer decomposition network (TDN) to decompose the image into illumination and reflectance maps. Then, we design multi-path generative diffusion networks to reconstruct the normal-light Retinex probability distribution and solve the various degradations in these components respectively, including dark illumination, noise, color deviation, loss of scene contents, etc. Owing to generative diffusion model, Diff-Retinex puts the restoration of low-light subtle detail into practice. Extensive experiments conducted on real-world low-light datasets qualitatively and quantitatively demonstrate the effectiveness, superiority, and generalization of the proposed method.


title: Dual Compensation Residual Networks for Class Imbalanced Learning

abstract: Learning generalizable representation and classifier for class-imbalanced data is challenging for data-driven deep models. Most studies attempt to re-balance the data distribution, which is prone to overfitting on tail classes and underfitting on head classes. In this work, we propose Dual Compensation Residual Networks to better fit both tail and head classes. Firstly, we propose dual Feature Compensation Module (FCM) and Logit Compensation Module (LCM) to alleviate the overfitting issue. The design of these two modules is based on the observation: an important factor causing overfitting is that there is severe feature drift between training and test data on tail classes. In details, the test features of a tail category tend to drift towards feature cloud of multiple similar head categories. So FCM estimates a multi-mode feature drift direction for each tail category and compensate for it. Furthermore, LCM translates the deterministic feature drift vector estimated by FCM along intra-class variations, so as to cover a larger effective compensation space, thereby better fitting the test features. Secondly, we propose a Residual Balanced Multi-Proxies Classifier (RBMC) to alleviate the under-fitting issue. Motivated by the observation that re-balancing strategy hinders the classifier from learning sufficient head knowledge and eventually causes underfitting, RBMC utilizes uniform learning with a residual path to facilitate classifier learning. Comprehensive experiments on Long-tailed and Class-Incremental benchmarks validate the efficacy of our method.


title: Certainty Equivalence Control-Based Heuristics in Multi-Stage Convex Stochastic Optimization Problems

abstract: We examine a multi-stage stochastic optimization problem characterized by stagewise-independent, decision-dependent noises with strict constraints. The problem assumes convexity in that, following a specific relaxation, it transforms into a deterministic convex program. The relaxation process is inspired by the principle of Certainty Equivalence Control, which substitutes uncertainties with their nominal values and requires the hard constraints to be satisfied only in an expected sense. Utilizing the solutions obtained from these convex programs, we propose two universal methodologies -- re-solving-based and projection-based -- to formulate feasible policies relevant to the original problem. These methodologies are subsequently amalgamated to develop a hybrid policy, equipped with a tuning parameter that manages the frequency of re-solving. We derive upper bounds on the gap between the performance of these heuristic policies and the optimal one. Under the Lipschitz-type regularity of the model, these bounds are proportional to the square root of the stochastic noise variance. Assuming additional $C^2$-smoothness regularity, an alternative bound, proportional to the variance of the stochastic noise, can be established -- providing a refinement when variances are small. We also delve into the issues concerning the exponential growth of a multiplicative constant in these bounds with respect to the stage number. Our model strives to lay a comprehensive framework for dynamic sequential decision-making in the presence of uncertainties, incorporating classic problems from inventory management and Markovian bandits, while also accommodating a wider spectrum of stochastic optimization challenges. Specifically, we illustrate our methods on a network utility maximization problem through numerical experiments.


title: Almost No Finite Subset of Integers Contains a $q^{th}$ Power Modulo Almost Every Prime

abstract: Let $q$ be a prime. We give an elementary proof of the fact that for any $k\in\mathbb{N}$, the proportion of $k$-element subsets of $\mathbb{Z}$ that contain a $q^{th}$ power modulo almost every prime, is zero. This result holds regardless of whether the proportion is measured additively or multiplicatively. More specifically, the number of $k$-element subsets of $[-N, N]\cap\mathbb{Z}$ that contain a $q^{th}$ power modulo almost every prime is no larger than $a_{q,k} N^{k-(1-\frac{1}{q})}$, for some positive constant $a_{q,k}$. Furthermore, the number of $k$-element subsets of $\{\pm p_{1}^{e_{1}} p_{2}^{e_{2}} \cdots p_{N}^{e_{N}} : 0 \leq e_{1}, e_{2}, \ldots, e_{N}\leq N\}$ that contain a $q^{th}$ power modulo almost every prime is no larger than $m_{q,k} \frac{N^{Nk}}{q^{N}}$ for some positive constant $m_{q,k}$.


title: IOMatch: Simplifying Open-Set Semi-Supervised Learning with Joint Inliers and Outliers Utilization

abstract: Semi-supervised learning (SSL) aims to leverage massive unlabeled data when labels are expensive to obtain. Unfortunately, in many real-world applications, the collected unlabeled data will inevitably contain unseen-class outliers not belonging to any of the labeled classes. To deal with the challenging open-set SSL task, the mainstream methods tend to first detect outliers and then filter them out. However, we observe a surprising fact that such approach could result in more severe performance degradation when labels are extremely scarce, as the unreliable outlier detector may wrongly exclude a considerable portion of valuable inliers. To tackle with this issue, we introduce a novel open-set SSL framework, IOMatch, which can jointly utilize inliers and outliers, even when it is difficult to distinguish exactly between them. Specifically, we propose to employ a multi-binary classifier in combination with the standard closed-set classifier for producing unified open-set classification targets, which regard all outliers as a single new class. By adopting these targets as open-set pseudo-labels, we optimize an open-set classifier with all unlabeled samples including both inliers and outliers. Extensive experiments have shown that IOMatch significantly outperforms the baseline methods across different benchmark datasets and different settings despite its remarkable simplicity. Our code and models are available at https://github.com/nukezil/IOMatch.


title: Morphological entropy encodes cellular migration strategies on multiple length scales

abstract: Cell migration is crucial to many physiological and pathological processes. During migration, a cell adapts its morphology, including the overall morphology and nucleus morphology, in response to various cues in complex microenvironments, e.g. topotaxis and chemotaxis. Thus, cellular morphology dynamics can encode migration strategies based on which various migration mechanisms can be inferred. However, how to decipher cell migration mechanisms encoded in the morphology dynamics remains a challenging problem. Here we introduce a novel universal metric, namely cell morphological entropy (CME), by combining parametric morphological analysis with Shannon entropy. The utility of CME, which accurately quantifies the complex cellular morphology on multiple length scales through the deviation from the perfect circular shape, is demonstrated using a variety of normal and tumorous cell lines in distinct in vitro microenvironments. Our results reveal that 1) the effects of geometric constraints on cell nucleus, 2) the emerging interplays of MCF-10A cells migrating on collagen gel, and 3) the critical transition of tumor spheroid from proliferation to invasion. The analysis indicates that the CME offers a physically interpretable and efficient tool to quantify morphology on multiple length scales in real-time, which provides more insights into cell migration, and further contributing to the understanding of the diverse behavioral modes as well as collective cell motility in more complex microenvironment.


title: Measuring Spurious Correlation in Classification: 'Clever Hans' in Translationese

abstract: Recent work has shown evidence of 'Clever Hans' behavior in high-performance neural translationese classifiers, where BERT-based classifiers capitalize on spurious correlations, in particular topic information, between data and target classification labels, rather than genuine translationese signals. Translationese signals are subtle (especially for professional translation) and compete with many other signals in the data such as genre, style, author, and, in particular, topic. This raises the general question of how much of the performance of a classifier is really due to spurious correlations in the data versus the signals actually targeted for by the classifier, especially for subtle target signals and in challenging (low resource) data settings. We focus on topic-based spurious correlation and approach the question from two directions: (i) where we have no knowledge about spurious topic information and its distribution in the data, (ii) where we have some indication about the nature of spurious topic correlations. For (i) we develop a measure from first principles capturing alignment of unsupervised topics with target classification labels as an indication of spurious topic information in the data. We show that our measure is the same as purity in clustering and propose a 'topic floor' (as in a 'noise floor') for classification. For (ii) we investigate masking of known spurious topic carriers in classification. Both (i) and (ii) contribute to quantifying and (ii) to mitigating spurious correlations.


title: Q-Drug: a Framework to bring Drug Design into Quantum Space using Deep Learning

abstract: Optimizing the properties of molecules (materials or drugs) for stronger toughness, lower toxicity, or better bioavailability has been a long-standing challenge. In this context, we propose a molecular optimization framework called Q-Drug (Quantum-inspired optimization algorithm for Drugs) that leverages quantum-inspired algorithms to optimize molecules on discrete binary domain variables. The framework begins by encoding the molecules into binary embeddings using a discrete VAE. The binary embeddings are then used to construct an Ising energy-like objective function, over which the state-of-the-art quantum-inspired optimization algorithm is adopted to find the optima. The binary embeddings corresponding to the optima are decoded to obtain the optimized molecules. We have tested the framework for optimizing drug molecule properties and have found that it outperforms other molecular optimization methods, finding molecules with better properties in 1/20th to 1/10th of the time previously required. The framework can also be deployed directly on various quantum computing equipment, such as laser pulses CIMs, FPGA Ising Machines, and quantum computers based on quantum annealing, among others. Our work demonstrates a new paradigm that leverages the advantages of quantum computing and AI to solve practically useful problems.


title: Discovering Dichotomies for Problems in Database Theory

abstract: Dichotomy theorems, which characterize the conditions under which a problem can be solved efficiently, have helped identify important tractability borders for as probabilistic query evaluation, view maintenance, query containment (among many more problems). However, dichotomy theorems for many such problems remain elusive under key settings such as bag semantics or for queries with self-joins. This work aims to unearth dichotomies for fundamental problems in reverse data management and knowledge representation. We use a novel approach to discovering dichotomies: instead of creating dedicated algorithms for easy (PTIME) and hard cases (NP-complete), we devise unified algorithms that are guaranteed to terminate in PTIME for easy cases. Using this approach, we discovered new tractable cases for the problem of minimal factorization of provenance formulas as well as dichotomies under bag semantics for the problems of resilience and causal responsibility


title: DISGO: Automatic End-to-End Evaluation for Scene Text OCR

abstract: This paper discusses the challenges of optical character recognition (OCR) on natural scenes, which is harder than OCR on documents due to the wild content and various image backgrounds. We propose to uniformly use word error rates (WER) as a new measurement for evaluating scene-text OCR, both end-to-end (e2e) performance and individual system component performances. Particularly for the e2e metric, we name it DISGO WER as it considers Deletion, Insertion, Substitution, and Grouping/Ordering errors. Finally we propose to utilize the concept of super blocks to automatically compute BLEU scores for e2e OCR machine translation. The small SCUT public test set is used to demonstrate WER performance by a modularized OCR system.


title: Interactive segmentation in aerial images: a new benchmark and an open access web-based tool

abstract: Deep learning has gradually become powerful in segmenting and classifying aerial images. However, in remote sensing applications, the lack of training datasets and the difficulty of accuracy assessment have always been challenges for the deep learning based classification. In recent years, interactive semantic segmentation proposed in computer vision has achieved an ideal state of human-computer interaction segmentation. It can provide expert experience and utilize deep learning for efficient segmentation. However, few papers discussed its application in remote sensing imagery. This study aims to bridge the gap between interactive segmentation and remote sensing analysis by conducting a benchmark study on various interactive segmentation models. We assessed the performance of five state-of-the-art interactive segmentation methods (Reviving Iterative Training with Mask Guidance for Interactive Segmentation (RITM), FocalClick, SimpleClick, Iterative Click Loss (ICL), and Segment Anything (SAM)) on two high-resolution aerial imagery datasets. The Cascade-Forward Refinement approach, an innovative inference strategy for interactive segmentation, was also introduced to enhance the segmentation results. We evaluated these methods on various land cover types, object sizes, and band combinations in the datasets. SimpleClick model consistently outperformed the other methods in our experiments. Conversely, the SAM performed less effectively than other models. Building upon these findings, we developed an online tool called RSISeg for interactive segmentation of remote sensing data. RSISeg incorporates a well-performing interactive model that is finetuned with remote sensing data. Compared to existing interactive segmentation tools, RSISeg offers robust interactivity, modifiability, and adaptability to remote sensing data.


title: GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Clouds

abstract: Learning implicit representations has been a widely used solution for surface reconstruction from 3D point clouds. The latest methods infer a distance or occupancy field by overfitting a neural network on a single point cloud. However, these methods suffer from a slow inference due to the slow convergence of neural networks and the extensive calculation of distances to surface points, which limits them to small scale points. To resolve the scalability issue in surface reconstruction, we propose GridPull to improve the efficiency of learning implicit representations from large scale point clouds. Our novelty lies in the fast inference of a discrete distance field defined on grids without using any neural components. To remedy the lack of continuousness brought by neural networks, we introduce a loss function to encourage continuous distances and consistent gradients in the field during pulling queries onto the surface in grids near to the surface. We use uniform grids for a fast grid search to localize sampled queries, and organize surface points in a tree structure to speed up the calculation of distances to the surface. We do not rely on learning priors or normal supervision during optimization, and achieve superiority over the latest methods in terms of complexity and accuracy. We evaluate our method on shape and scene benchmarks, and report numerical and visual comparisons with the latest methods to justify our effectiveness and superiority. The code is available at https://github.com/chenchao15/GridPull.


title: Using Adamic-Adar Index Algorithm to Predict Volunteer Collaboration: Less is More

abstract: Social networks exhibit a complex graph-like structure due to the uncertainty surrounding potential collaborations among participants. Machine learning algorithms possess generic outstanding performance in multiple real-world prediction tasks. However, whether machine learning algorithms outperform specific algorithms designed for graph link prediction remains unknown to us. To address this issue, the Adamic-Adar Index (AAI), Jaccard Coefficient (JC) and common neighbour centrality (CNC) as representatives of graph-specific algorithms were applied to predict potential collaborations, utilizing data from volunteer activities during the Covid-19 pandemic in Shenzhen city, along with the classical machine learning algorithms such as random forest, support vector machine, and gradient boosting as single predictors and components of ensemble learning. This paper introduces that the AAI algorithm outperformed the traditional JC and CNC, and other machine learning algorithms in analyzing graph node attributes for this task.


title: How to Evaluate the Generalization of Detection? A Benchmark for Comprehensive Open-Vocabulary Detection

abstract: Object detection (OD) in computer vision has made significant progress in recent years, transitioning from closed-set labels to open-vocabulary detection (OVD) based on large-scale vision-language pre-training (VLP). However, current evaluation methods and datasets are limited to testing generalization over object types and referral expressions, which do not provide a systematic, fine-grained, and accurate benchmark of OVD models' abilities. In this paper, we propose a new benchmark named OVDEval, which includes 9 sub-tasks and introduces evaluations on commonsense knowledge, attribute understanding, position understanding, object relation comprehension, and more. The dataset is meticulously created to provide hard negatives that challenge models' true understanding of visual and linguistic input. Additionally, we identify a problem with the popular Average Precision (AP) metric when benchmarking models on these fine-grained label datasets and propose a new metric called Non-Maximum Suppression Average Precision (NMS-AP) to address this issue. Extensive experimental results show that existing top OVD models all fail on the new tasks except for simple object types, demonstrating the value of the proposed dataset in pinpointing the weakness of current OVD models and guiding future research. Furthermore, the proposed NMS-AP metric is verified by experiments to provide a much more truthful evaluation of OVD models, whereas traditional AP metrics yield deceptive results. Data is available at \url{https://github.com/om-ai-lab/OVDEval}


title: Self-supervised Scene Text Segmentation with Object-centric Layered Representations Augmented by Text Regions

abstract: Text segmentation tasks have a very wide range of application values, such as image editing, style transfer, watermark removal, etc.However, existing public datasets are of poor quality of pixel-level labels that have been shown to be notoriously costly to acquire, both in terms of money and time. At the same time, when pretraining is performed on synthetic datasets, the data distribution of the synthetic datasets is far from the data distribution in the real scene. These all pose a huge challenge to the current pixel-level text segmentation algorithms.To alleviate the above problems, we propose a self-supervised scene text segmentation algorithm with layered decoupling of representations derived from the object-centric manner to segment images into texts and background. In our method, we propose two novel designs which include Region Query Module and Representation Consistency Constraints adapting to the unique properties of text as complements to Auto Encoder, which improves the network's sensitivity to texts.For this unique design, we treat the polygon-level masks predicted by the text localization model as extra input information, and neither utilize any pixel-level mask annotations for training stage nor pretrain on synthetic datasets.Extensive experiments show the effectiveness of the method proposed. On several public scene text datasets, our method outperforms the state-of-the-art unsupervised segmentation algorithms.


title: Composite octet baryons in a relativistic mean field description of nuclear and neutron star matter

abstract: We examine the properties of composite octet baryons in the nuclear medium and neutron star matter. The internal quark-diquark structure of the octet baryons and the equations of state of nuclear matter and neutron star matter in the mean field approximation are described by using the three-flavor Nambu--Jona-Lasinio (NJL) model as an effective quark theory of QCD. After introducing our model, we first discuss the properties of single baryons and their effective meson exchange interactions in symmetric nuclear matter by using concepts of Fermi liquid theory. Several model independent implications of this description are derived, and illustrated by numerical results obtained in our model. Second, we extend the model description to high baryon densities, and investigate the equation of state of neutron star matter and the resulting star masses. We find that the so called hyperon puzzle persists also for the case of composite hadrons. To get more information on this point, we also investigate the role of 6-fermi and 8-fermi interactions, in addition to the standard 4-fermi interactions. The strengths of those higher order fermi interactions is determined so as not to spoil the saturation properties of nuclear matter. Among them, an interaction characterized by a product of four quark current operators plays a special role to stabilize the stars over a large region of central baryon densities, although it has little effect on the maximum star masses.


title: Electronic-grade epitaxial (111) KTaO3 heterostructures

abstract: KTaO3 has recently attracted attention as a model system to study the interplay of quantum paraelectricity, spin-orbit coupling, and superconductivity. However, the high and low vapor pressures of potassium and tantalum present processing challenges to creating interfaces clean enough to reveal the intrinsic quantum properties. Here, we report superconducting heterostructures based on electronic-grade epitaxial (111) KTaO3 thin films. Electrical and structural characterizations reveal that two-dimensional electron gas at the heterointerface between amorphous LaAlO3 and KTaO3 thin film exhibits significantly higher electron mobility, superconducting transition temperature and critical current density than those in bulk single crystal KTaO3-based heterostructures owing to cleaner interface in KTaO3 thin films. Our hybrid approach may enable epitaxial growth of other alkali metal-based oxides that lie beyond the capabilities of conventional methods.


title: Emergent $\mathbb{Z}_2$ symmetry near a CDW multicritical point

abstract: We consider the critical behavior associated with incommensurate unidirectional charge-density-wave ordering in a weakly orthorhombic system subject to uniaxial strain as an experimentally significant example of $U(1)\times U(1)$ multicriticality. We show that, depending on microscopic details, the phase diagram can have qualitatively different structures which can involve a vestigial meta-nematic critical point, a pair of tricritical points, a decoupled tetracritical point, or (at least at mean-field level) a bicritical point. We analyze the emergent symmetries in the critical regime and find that these can -- at least in some cases -- involve an emergent $\mathbb{Z}_2$ order parameter symmetry.


title: Structural Cycle GAN for Virtual Immunohistochemistry Staining of Gland Markers in the Colon

abstract: With the advent of digital scanners and deep learning, diagnostic operations may move from a microscope to a desktop. Hematoxylin and Eosin (H&E) staining is one of the most frequently used stains for disease analysis, diagnosis, and grading, but pathologists do need different immunohistochemical (IHC) stains to analyze specific structures or cells. Obtaining all of these stains (H&E and different IHCs) on a single specimen is a tedious and time-consuming task. Consequently, virtual staining has emerged as an essential research direction. Here, we propose a novel generative model, Structural Cycle-GAN (SC-GAN), for synthesizing IHC stains from H&E images, and vice versa. Our method expressly incorporates structural information in the form of edges (in addition to color data) and employs attention modules exclusively in the decoder of the proposed generator model. This integration enhances feature localization and preserves contextual information during the generation process. In addition, a structural loss is incorporated to ensure accurate structure alignment between the generated and input markers. To demonstrate the efficacy of the proposed model, experiments are conducted with two IHC markers emphasizing distinct structures of glands in the colon: the nucleus of epithelial cells (CDX2) and the cytoplasm (CK818). Quantitative metrics such as FID and SSIM are frequently used for the analysis of generative models, but they do not correlate explicitly with higher-quality virtual staining results. Therefore, we propose two new quantitative metrics that correlate directly with the virtual staining specificity of IHC markers.


title: STRIDE: Street View-based Environmental Feature Detection and Pedestrian Collision Prediction

abstract: This paper introduces a novel benchmark to study the impact and relationship of built environment elements on pedestrian collision prediction, intending to enhance environmental awareness in autonomous driving systems to prevent pedestrian injuries actively. We introduce a built environment detection task in large-scale panoramic images and a detection-based pedestrian collision frequency prediction task. We propose a baseline method that incorporates a collision prediction module into a state-of-the-art detection model to tackle both tasks simultaneously. Our experiments demonstrate a significant correlation between object detection of built environment elements and pedestrian collision frequency prediction. Our results are a stepping stone towards understanding the interdependencies between built environment conditions and pedestrian safety.


title: Performance Analysis of Finite Blocklength Transmissions Over Wiretap Fading Channels: An Average Information Leakage Perspective

abstract: Physical-layer security (PLS) is a promising technique to complement more traditional means of communication security in beyond-5G wireless networks. However, studies of PLS are often based on ideal assumptions such as infinite coding blocklengths or perfect knowledge of the wiretap link's channel state information (CSI). In this work, we study the performance of finite blocklength (FBL) transmissions using a new secrecy metric $\unicode{x2013}$ the average information leakage (AIL). We evaluate the exact and approximate AIL with Gaussian signaling and arbitrary fading channels, assuming that the eavesdropper's instantaneous CSI is unknown. We then conduct case studies that use artificial noise (AN) beamforming to analyze the AIL in both Rayleigh and Rician fading channels. The accuracy of the analytical expressions is verified through extensive simulations, and various insights regarding the impact of key system parameters on the AIL are obtained. Particularly, our results reveal that allowing a small level of AIL can potentially lead to significant reliability enhancements. To improve the system performance, we formulate and solve an average secrecy throughput (AST) optimization problem via both non-adaptive and adaptive design strategies. Our findings highlight the significance of blocklength design and AN power allocation, as well as the impact of their trade-off on the AST.


title: The mid-infrared variability of the SDSS optical quasars

abstract: Based on the Seventh Data Release (DR7) quasar catalog from the Sloan Digital Sky Survey, we investigate the variability of optical quasars in W1, W2, W3 and W4 bands of the Wide-field Infrared Survey Explorer (WISE) and the Near-Earth Object Wide-field Infrared Survey Explorer (NEOWISE). Adopting the structure function method, we calculate the structure function ($\rm\delta t$=1 yr) which shows no obvious correlations with the bolometric luminosity, the black hole mass and the Eddington ratio. The ensemble structure functions in W1 and W2 bands show that the SF slopes are steeper than those in previous studies which may be caused by different cadence and observational epoch number. We further investigate the relation of variability amplitude $\sigma_m$ between mid-infrared band and optical band, but no obvious correlation is found. No correlation is found between W1-W2 and g-r color. We think the mid-infrared emission of quasars may be smoothed out by the extended dust distribution, thus leading to no obvious correlation. For the radio-loud quasar sub-sample, we further analyze the relation between the variability amplitude in the mid-infrared band and the radio luminosity at 6 cm, but no obvious correlations are found, which indicate the mid-infrared emission contributed from the synchrotron radiation of the relativistic jet is very weak.


title: Gabriel Quotient Rings

abstract: In this paper the following theorem is proved.Let R be a prime Noetherian ring with krull dimension R equal to n where n is a positive integer.Let Q be the Goldie quotient ring of R.For a fixed positive integer m less than n let xm be the set of all prime ideals of R such that krull dimension R/p equals m . call xm the set of m-full prime ideals of R . Let Cm be the set of elements c of R With krull dimension R/cR less than m. Call g as the m-gabriel filter if g is the family of right ideals I of R with krull dimension R/I less than m.Then we construct an extension ring R(m) of R having the following properties (i) R(m) is a subring of Q with identity element 1 of R.(ii)If u(R(m)) is the set of units of R(m) then u(R(m) intersection R equals the set cm.(iii)For a full set of m-prime ideals of R the set cm is a right ore set of R . We call R(m) as the m-Gabriel quotient ring of R.


title: MMBAttn: Max-Mean and Bit-wise Attention for CTR Prediction

abstract: With the increasing complexity and scale of click-through rate (CTR) prediction tasks in online advertising and recommendation systems, accurately estimating the importance of features has become a critical aspect of developing effective models. In this paper, we propose an attention-based approach that leverages max and mean pooling operations, along with a bit-wise attention mechanism, to enhance feature importance estimation in CTR prediction. Traditionally, pooling operations such as max and mean pooling have been widely used to extract relevant information from features. However, these operations can lead to information loss and hinder the accurate determination of feature importance. To address this challenge, we propose a novel attention architecture that utilizes a bit-based attention structure that emphasizes the relationships between all bits in features, together with maximum and mean pooling. By considering the fine-grained interactions at the bit level, our method aims to capture intricate patterns and dependencies that might be overlooked by traditional pooling operations. To examine the effectiveness of the proposed method, experiments have been conducted on three public datasets. The experiments demonstrated that the proposed method significantly improves the performance of the base models to achieve state-of-the-art results.


title: Generalized Bohr inequalities for certain classes of functions and their applications

abstract: Let $ \mathcal{B}:=\{f(z)=\sum_{n=0}^{\infty}a_nz^n\; \mbox{with}\; |f(z)|<1\;\mbox{for all}\; z\in\mathbb{D}\} $. The improved version of the classical Bohr's inequality \cite{Bohr-1914} states that if $ f\in\mathcal{B} $, then the associated majorant series $ M_f(r):=\sum_{n=0}^{\infty}|a_n|r^n\leq 1 $ holds for $ |z|=r\leq 1/3 $ and the constant $ 1/3 $ cannot be improved. Bohr's original theorem and its subsequent generalizations remain active fields of study, driving investigations in a wide range of function spaces. In this paper, first we establish a generalized Bohr inequality for the class $\mathcal{B}$ by allowing a sequence $\{\varphi_n(r)\}_{n=0}^{\infty}$ of non-negative continuous functions on $[0, 1)$ in the place of $\{r^n\}_{n=0}^{\infty}$ of the majorant series $M_f(r)$ introducing a weighted sequence of non-negative continuous functions $\{\Phi_n(r)\}_{n=0}^{\infty}$ on $[0, 1)$. Secondly, as a generalization, we obtain a refined version of the Bohr inequality for a certain class $\tilde{G}^0_{\mathcal{H}}(\beta)$ of harmonic mappings. All the results are proved to be sharp.


title: Falcon: Accelerating Homomorphically Encrypted Convolutions for Efficient Private Mobile Network Inference

abstract: Efficient networks, e.g., MobileNetV2, EfficientNet, etc, achieves state-of-the-art (SOTA) accuracy with lightweight computation. However, existing homomorphic encryption (HE)-based two-party computation (2PC) frameworks are not optimized for these networks and suffer from a high inference overhead. We observe the inefficiency mainly comes from the packing algorithm, which ignores the computation characteristics and the communication bottleneck of homomorphically encrypted depthwise convolutions. Therefore, in this paper, we propose Falcon, an effective dense packing algorithm for HE-based 2PC frameworks. Falcon features a zero-aware greedy packing algorithm and a communication-aware operator tiling strategy to improve the packing density for depthwise convolutions. Compared to SOTA HE-based 2PC frameworks, e.g., CrypTFlow2, Iron and Cheetah, Falcon achieves more than 15.6x, 5.1x and 1.8x latency reduction, respectively, at operator level. Meanwhile, at network level, Falcon allows for 1.4% and 4.2% accuracy improvement over Cheetah on CIFAR-100 and TinyImagenet datasets with iso-communication, respecitvely.


title: Numerical models of planetary nebulae with different episodes of mass ejection: the particular case of HuBi 1

abstract: We have studied the evolution of HuBi 1-like planetary nebulae, considering several stages of mass injection. We have carried out numerical ionization+1D hydrodynamics+atomic/ionic rate models with our code Coral 1D to reproduce planetary nebulae that present multiple shells produced by different ejection events around the ionizing source. Furthermore, we are interested in comparing numerical simulations with H$\alpha$ and [NII]$\lambda$6584 emission structures and the position-velocity diagrams observed in HuBi 1. This object also has a phase where it has drastically decreased the injection of ionized photons ejected from the source. The result of these different stages of ejection is a nebula with intense [NII] line emission in the inner part of the planetary nebula and an extended HII recombination line emission around the central zone. The model for HuBi 1 shows the capability of our code to explain the hydrodynamical and photoionization evolution in ionization nebulae. This is our first step with a 1D code to study these two physical phenomena at the same time.


title: Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers

abstract: Although dominant in natural language processing, transformer-based models remain challenged by the task of long-sequence processing, because the computational cost of self-attention operations in transformers swells quadratically with the input sequence length. To alleviate the complexity of long-sequence processing, we propose a simple framework to enable the offthe-shelf pre-trained transformers to process much longer sequences, while the computation and memory costs remain growing linearly with the input sequence lengths. More specifically, our method divides each long-sequence input into a batch of chunks, then aligns the interchunk information during the encoding steps, and finally selects the most representative hidden states from the encoder for the decoding process. To extract inter-chunk semantic information, we align the start and end token embeddings among chunks in each encoding transformer block. To learn an effective hidden selection policy, we design a dual updating scheme inspired by reinforcement learning, which regards the decoders of transformers as environments, and the downstream performance metrics as the rewards to evaluate the hidden selection actions. Our empirical results on real-world long-text summarization and reading comprehension tasks demonstrate effective improvements compared to prior longsequence processing baselines.


title: Formalising Natural Language Quantifiers for Human-Robot Interactions

abstract: We present a method for formalising quantifiers in natural language in the context of human-robot interactions. The solution is based on first-order logic extended with capabilities to represent the cardinality of variables, operating similarly to generalised quantifiers. To demonstrate the method, we designed an end-to-end system able to receive input as natural language, convert it into a formal logical representation, evaluate it, and return a result or send a command to a simulated robot.


title: On the radial growth of ballistic aggregation and other aggregation models

abstract: For a class of aggregation models on the integer lattice $\mathbb{Z}^d$, $d\geq 2$, in which clusters are formed by particles arriving one after the other and sticking irreversibly where they first hit the cluster, including the classical model of diffusion-limited aggregation (DLA), we study the growth of the clusters. We observe that a method of Kesten used to obtain an almost sure upper bound on the radial growth in the DLA model generalizes to a large class of such models. We use it in particular to prove such a bound for the so-called ballistic model, in which the arriving particles travel along straight lines. Our bound implies that the fractal dimension of ballistic aggregation clusters in $\mathbb{Z}^2$ is 2, which proves a long standing conjecture in the physics literature.


title: Fast and Accurate Simulations of Partially Delocalised Charge Separation in Organic Semiconductors

abstract: Accurate computational screening of candidate materials promises to accelerate the discovery of higher-efficiency organic photovoltaics (OPVs). However, modelling charge separation in OPVs is challenging because accurate models must include disorder, polaron formation, and charge delocalisation. Delocalised kinetic Monte Carlo (dKMC) includes these three essential ingredients, but it suffers from high computational cost. Recently, we developed jumping kinetic Monte Carlo (jKMC), a computationally cheap and accurate model of delocalised charge transport that models transport over a lattice of identical, spherical polarons. Here, we extend jKMC to describe the separation of a charge-transfer state, showing that this simplified approach can reproduce the considerable improvements in charge-separation efficiencies caused by delocalisation and first seen in dKMC. The low computational cost and simplicity of jKMC allows it to be applied to parameter regimes intractable by dKMC, and ensures jKMC can be easily incorporated into any existing KMC model.


title: The $\omega$-Condition Number for Optimal Preconditioning and Low Rank Generalized Jacobian Updating

abstract: Preconditioning is essential in iterative methods for solving linear systems. It is also the implicit objective in updating approximations of Jacobians in optimization methods, e.g., in quasi-Newton methods. Motivated by the latter, we study a nonclassic matrix condition number, the $\omega$-condition number. We do this in the context of optimal conditioning for: (i) our application to low rank updating of generalized Jacobians; (ii) iterative methods for linear systems: (iia) clustering of eigenvalues and (iib) convergence rates. For a positive definite matrix, the $\omega$-condition measure is the ratio of the arithmetic and geometric means of the eigenvalues. In particular, our applications concentrate on linear systems with low rank updates of ill-conditioned positive definite matrices. These systems arise in the context of nonsmooth Newton methods using generalized Jacobians. We are able to use optimality conditions and derive explicit formulae for $\omega$-optimal preconditioners and preconditioned updates. Connections to partial Cholesky sparse preconditioners are made. Evaluating or estimating the classical condition number $\kappa$ can be expensive. We show that the $\omega$-condition number can be evaluated explicitly following a Cholesky or LU factorization. Moreover, the simplicity of $\omega$ allows for the derivation of formulae for optimal preconditioning in various scenarios, i.e., this avoids the need for expensive algorithmic calculations. Our empirics show that $\omega$ estimates the actual condition of a linear system significantly better. Moreover, our empirical results show a significant decrease in the number of iterations required for a requested accuracy in the residual during an iterative method, i.e., these results confirm the efficacy of using the $\omega$-condition number compared to the classical condition number.


title: Chaotic Waveform-based Signal Design for Noncoherent SWIPT Receivers

abstract: This paper proposes a chaotic waveform-based multi-antenna receiver design for simultaneous wireless information and power transfer (SWIPT). Particularly, we present a differential chaos shift keying (DCSK)-based SWIPT multiantenna receiver architecture, where each antenna switches between information transfer (IT) and energy harvesting (EH) modes depending on the receiver's requirements. We take into account a generalized frequency-selective Nakagami-m fading model as well as the nonlinearities of the EH process to derive closed-form analytical expressions for the associated bit error rate (BER) and the harvested direct current (DC), respectively. We show that, both depend on the parameters of the transmitted waveform and the number of receiver antennas being utilized in the IT and EH mode. We investigate a trade-off in terms of the BER and energy transfer by introducing a novel achievable `success rate - harvested energy' region. Moreover, we demonstrate that energy and information transfer are two conflicting tasks and hence, a single waveform cannot be simultaneously optimal for both IT and EH. Accordingly, we propose appropriate transmit waveform designs based on the application specific requirements of acceptable BER or harvested DC or both. Numerical results demonstrate the importance of chaotic waveform-based signal design and its impact on the proposed receiver architecture.


title: Generalized weighted composition-differentiation operators on weighted Bergman spaces

abstract: Let $ \mathcal{H}(\mathbb{D}) $ be the class of all holomorphic functions in the unit disk $ \mathbb{D} $. We aim to explore the complex symmetry exhibited by generalized weighted composition-differentiation operators, denoted as $L_{n, \psi, \phi}$ and is defined by \begin{align*} L_{n, \psi, \phi}:=\sum_{k=1}^{n}c_kD_{k, \psi_k, \phi},\; \mbox{where }\; c_k\in\mathbb{C}\; \mbox{for}\; k=1, 2, \ldots, n, \end{align*} where $ D_{k, \psi, \phi}f(z):=\psi(z)f^{(k)}(\phi(z)),\; f\in \mathcal{A}^2_{\alpha}(\mathbb{D}), $ in the reproducing kernel Hilbert space, labeled as $\mathcal{A}^2_{\alpha}(\mathbb{D})$, which encompasses analytic functions defined on the unit disk $\mathbb{D}$. By deriving a condition that is both necessary and sufficient, we provide insights into the $ C_{\mu, \eta} $-symmetry exhibited by $L_{n, \psi, \phi}$. The explicit conditions for which the operator T is Hermitian and normal are obtained through our investigation. Additionally, we conduct an in-depth analysis of the spectral properties of $ L_{n, \psi, \phi} $ under the assumption of $ C_{\mu, \eta} $-symmetry and thoroughly examine the kernel of the adjoint operator of $L_{n, \psi, \phi}$.


title: Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Neurons

abstract: Pre-trained language models (PLMs) contain vast amounts of factual knowledge, but how the knowledge is stored in the parameters remains unclear. This paper delves into the complex task of understanding how factual knowledge is stored in multilingual PLMs, and introduces the Architecture-adapted Multilingual Integrated Gradients method, which successfully localizes knowledge neurons more precisely compared to current methods, and is more universal across various architectures and languages. Moreover, we conduct an in-depth exploration of knowledge neurons, leading to the following two important discoveries: (1) The discovery of Language-Independent Knowledge Neurons, which store factual knowledge in a form that transcends language. We design cross-lingual knowledge editing experiments, demonstrating that the PLMs can accomplish this task based on language-independent neurons; (2) The discovery of Degenerate Knowledge Neurons, a novel type of neuron showing that different knowledge neurons can store the same fact. Its property of functional overlap endows the PLMs with a robust mastery of factual knowledge. We design fact-checking experiments, proving that the degenerate knowledge neurons can help the PLMs to detect wrong facts. Experiments corroborate these findings, shedding light on the mechanisms of factual knowledge storage in multilingual PLMs, and contribute valuable insights to the field. The code is available at https://github.com/heng840/AMIG.


title: Robust Luttinger liquid state of 1D Dirac fermions in a van der Waals system Nb$_9$Si$_4$Te$_{18}$

abstract: We report on the Tomonaga-Luttinger liquid (TLL) behavior in fully degenerate 1D Dirac fermions. A ternary van der Waals material Nb$_9$Si$_4$Te$_{18}$ incorporates in-plane NbTe$_2$ chains, which produce a 1D Dirac band crossing Fermi energy. Tunneling conductance of electrons confined within NbTe2 chains is found to be substantially suppressed at Fermi energy, which follows a power law with a universal temperature scaling, hallmarking a TLL state. The obtained Luttinger parameter of ~0.15 indicates strong electron-electron interaction. The TLL behavior is found to be robust against atomic-scale defects, which might be related to the Dirac electron nature. These findings, as combined with the tunability of the compound and the merit of a van der Waals material, offer a robust, tunable, and integrable platform to exploit non-Fermi liquid physics.


title: Parameter space investigation for spin-dependent electron diffraction in the Kapitza-Dirac effect

abstract: We demonstrate that spin-dependent electron diffraction is possible for a smooth range of transverse electron momenta in a two-photon Bragg scattering scenario of the Kapitza-Dirac effect. Our analysis is rendered possible by introducing a generalized specification for quantifying spin-dependent diffraction, yielding an optimization problem which is solved by making use of a Newton gradient iteration scheme. With this procedure, we investigate the spin-dependent effect for different transverse electron momenta and different laser polarizations of the standing light wave Kapitza-Dirac scattering. The possibility for using arbitrarily low transverse electron momenta, when setting up a spin-dependent Kapitza-Dirac experiment allows longer interaction times of the electron with the laser and therefore enables less constraining parameters for an implementation of the effect.


title: Deep Active Audio Feature Learning in Resource-Constrained Environments

abstract: The scarcity of labelled data makes training Deep Neural Network (DNN) models in bioacoustic applications challenging. In typical bioacoustics applications, manually labelling the required amount of data can be prohibitively expensive. To effectively identify both new and current classes, DNN models must continue to learn new features from a modest amount of fresh data. Active Learning (AL) is an approach that can help with this learning while requiring little labelling effort. Nevertheless, the use of fixed feature extraction approaches limits feature quality, resulting in underutilization of the benefits of AL. We describe an AL framework that addresses this issue by incorporating feature extraction into the AL loop and refining the feature extractor after each round of manual annotation. In addition, we use raw audio processing rather than spectrograms, which is a novel approach. Experiments reveal that the proposed AL framework requires 14.3%, 66.7%, and 47.4% less labelling effort on benchmark audio datasets ESC-50, UrbanSound8k, and InsectWingBeat, respectively, for a large DNN model and similar savings on a microcontroller-based counterpart. Furthermore, we showcase the practical relevance of our study by incorporating data from conservation biology projects.


title: Joint Band Assignment and Beam Management using Hierarchical Reinforcement Learning for Multi-Band Communication

abstract: Multi-band operation in wireless networks can improve data rates by leveraging the benefits of propagation in different frequency ranges. Distinctive beam management procedures in different bands complicate band assignment because they require considering not only the channel quality but also the associated beam management overhead. Reinforcement learning (RL) is a promising approach for multi-band operation as it enables the system to learn and adjust its behavior through environmental feedback. In this paper, we formulate a sequential decision problem to jointly perform band assignment and beam management. We propose a method based on hierarchical RL (HRL) to handle the complexity of the problem by separating the policies for band selection and beam management. We evaluate the proposed HRL-based algorithm on a realistic channel generated based on ray-tracing simulators. Our results show that the proposed approach outperforms traditional RL approaches in terms of reduced beam training overhead and increased data rates under a realistic vehicular channel.


title: Halo-independent bounds on Inelastic Dark Matter

abstract: We discuss halo-independent constraints on the Inelastic Dark Matter (IDM) scenario, in which a Weakly Interaction Massive Particle (WIMP) state $\chi$ with mass $m_\chi$ interacts with nuclear targets by upscattering to a heavier state $\chi^{\prime}$ with mass $m_\chi+\delta$. In order to do so we adopt the single-stream method, that exploits the complementarity of Direct Detection (DD) and Capture in the Sun to extend the experimental sensitivity to the full range of incoming WIMP speeds. We show that a non-vanishing mass splitting $\delta$ modifies such range, and that for particular combinations of $m_\chi$ and $\delta$ the complementarity between the two detection techniques required by the method is lost. Specifically, assuming for the escape velocity in our Galaxy $u_{esc}$ the reference value $u_{esc}^{ref}$ = 560 km/s a halo-independent bound is possible when $\delta\lesssim$ 510 keV for a Spin-Independent interaction and when $\delta\lesssim$ 245 keV for a Spin-Dependent interaction (with the Spin-Independent value slightly reduced to $\delta\lesssim$ 490 keV when $u_{esc}>u_{esc}^{ref}$). In the low-mass regime the bound from capture in the Sun is always more constraining than that for DD and is sufficient alone to provide a halo-independent constraint, while for large WIMP masses the halo-independent bound is given by a combination of capture in the Sun and DD. We also find that, for $u_{esc}$ = $u_{esc}^{ref}$, unless the mass of the target used in DD is larger than about four times that of the target driving capture in the Sun, DD does not play any role in the determination of the maximal value of $\delta$ for which a halo-independent bound is possible. We also discuss the issue of thermalization of IDM within the Sun and show that its impact on our results is mild.


title: Self-supervised learning for hotspot detection and isolation from thermal images

abstract: Hotspot detection using thermal imaging has recently become essential in several industrial applications, such as security applications, health applications, and equipment monitoring applications. Hotspot detection is of utmost importance in industrial safety where equipment can develop anomalies. Hotspots are early indicators of such anomalies. We address the problem of hotspot detection in thermal images by proposing a self-supervised learning approach. Self-supervised learning has shown potential as a competitive alternative to their supervised learning counterparts but their application to thermography has been limited. This has been due to lack of diverse data availability, domain specific pre-trained models, standardized benchmarks, etc. We propose a self-supervised representation learning approach followed by fine-tuning that improves detection of hotspots by classification. The SimSiam network based ensemble classifier decides whether an image contains hotspots or not. Detection of hotspots is followed by precise hotspot isolation. By doing so, we are able to provide a highly accurate and precise hotspot identification, applicable to a wide range of applications. We created a novel large thermal image dataset to address the issue of paucity of easily accessible thermal images. Our experiments with the dataset created by us and a publicly available segmentation dataset show the potential of our approach for hotspot detection and its ability to isolate hotspots with high accuracy. We achieve a Dice Coefficient of 0.736, the highest when compared with existing hotspot identification techniques. Our experiments also show self-supervised learning as a strong contender of supervised learning, providing competitive metrics for hotspot detection, with the highest accuracy of our approach being 97%.


title: Design and Control of a Bio-inspired Wheeled Bipedal Robot

abstract: Wheeled bipedal robots have the capability to execute agile and versatile locomotion tasks in unknown terrains, with balancing being a key criterion in evaluating their dynamic performance. This paper focuses on enhancing the balancing performance of wheeled bipedal robots through innovations in both hardware and software aspects. A bio-inspired mechanical design, inspired by the human barbell squat, is proposed and implemented to achieve an efficient distribution of load onto the limb joints. This design improves knee torque joint efficiency and facilitates control over the distribution of the center of mass (CoM). Meanwhile, a customized balance model, namely the wheeled linear inverted pendulum (wLIP), is developed. The wLIP surpasses other alternatives by providing a more accurate estimation of wheeled robot dynamics while ensuring balancing stability. Experimental results demonstrate that the robot is capable of maintaining balance while manipulating pelvis states and CoM velocity; furthermore, it exhibits robustness against external disturbances and unknown terrains.


title: Electromagnetic Multipoles for Morris-Thorne Wormhole

abstract: Wormholes are interesting space-time structures connecting two asymptotic regions found in a universe or multiverse and are solutions to Einstein's field equations. These objects have many interesting features as far as physics is concerned. Morris and Thorne introduced traversable wormholes, which increases the possibility of space-time travel. In this work, the wave equation of the Morris-Thorne wormhole has been derived by the technique of differential forms. The solution of the wave equation for a particular choice of red-shift function and shape function is obtained. The potential has also been computed in order to analyze electromagnetic fields. The behavior of electromagnetic multipoles is expressed and investigated in their behavior at the wormhole's throat.


title: LLM2KB: Constructing Knowledge Bases using instruction tuned context aware Large Language Models

abstract: The advent of Large Language Models (LLM) has revolutionized the field of natural language processing, enabling significant progress in various applications. One key area of interest is the construction of Knowledge Bases (KB) using these powerful models. Knowledge bases serve as repositories of structured information, facilitating information retrieval and inference tasks. Our paper proposes LLM2KB, a system for constructing knowledge bases using large language models, with a focus on the Llama 2 architecture and the Wikipedia dataset. We perform parameter efficient instruction tuning for Llama-2-13b-chat and StableBeluga-13B by training small injection models that have only 0.05 % of the parameters of the base models using the Low Rank Adaptation (LoRA) technique. These injection models have been trained with prompts that are engineered to utilize Wikipedia page contexts of subject entities fetched using a Dense Passage Retrieval (DPR) algorithm, to answer relevant object entities for a given subject entity and relation. Our best performing model achieved an average F1 score of 0.6185 across 21 relations in the LM-KBC challenge held at the ISWC 2023 conference.


title: Physics-inspired Equivariant Descriptors of Non-bonded Interactions

abstract: One essential ingredient in many machine learning (ML) based methods for atomistic modeling of materials and molecules is the use of locality. While allowing better system-size scaling, this systematically neglects long-range (LR) effects, such as electrostatics or dispersion interaction. We present an extension of the long distance equivariant (LODE) framework that can handle diverse LR interactions in a consistent way, and seamlessly integrates with preexisting methods by building new sets of atom centered features. We provide a direct physical interpretation of these using the multipole expansion, which allows for simpler and more efficient implementations. The framework is applied to simple toy systems as proof of concept, and a heterogeneous set of molecular dimers to push the method to its limits. By generalizing LODE to arbitrary asymptotic behaviors, we provide a coherent approach to treat arbitrary two- and many-body non-bonded interactions in the data-driven modeling of matter.


title: Generic properties in free boundary problems

abstract: In this work, we show the generic uniqueness of minimizers for a large class of energies, including the Alt-Caffarelli and Alt-Phillips functionals. We then prove the generic regularity of free boundaries for minimizers of the one-phase Alt-Caffarelli and Alt-Phillips functionals, for a monotone family of boundary data $\{\varphi_t\}_{t\in(-1,1)}$. More precisely, we show that for a co-countable subset of $\{\varphi_t\}_{t\in(-1,1)}$, minimizers have smooth free boundaries in $\mathbb{R}^5$ for the Alt-Caffarelli and in $\mathbb{R}^3$ for the Alt-Phillips functional. In general dimensions, we show that the singular set is one dimension smaller than expected for almost every boundary datum in $\{\varphi_t\}_{t\in(-1,1)}$.


title: Robust features of QCD phase diagram through a Contact Interaction model for quarks: A view from the effective potential

abstract: Our research delves into the QCD phase diagram in the temperature $T$ and quark chemical potential $\mu$ plane. We use a unique confining contact interaction effective model of quark dynamics that maintains the QCD symmetry intact. By embedding the model into a Schwinger-Dyson equations framework, within a Landau gauge rainbow-ladder-like truncation, we derive the gap equation. In order to accurately regulate the said equation, we utilize the Schwinger optimal time regularization scheme. We further derive the effective potential of the model by integrating the gap equation over the dynamical mass, which along with the confining length scale serve as parameters for the chiral and confinement deconfinement phase transitions, respectively. A cross-over transition is observed at low $\mu$ and above a critical value of the temperature $T_c$, whilst a first order phase transition is found for low $T$ at high density. The critical end point is estimated to be located at $(\mu_{E}/T_{c,0}=1.6, T_{E}/T_{c,0}=0.42)$, which falls within the range of other QCD effective models predictions. $T_{c,0} =208$ MeV is the critical temperature at vanishing $\mu$. Screening effects of the medium which dilute the strength of the effective coupling are considered by including the vacuum polarization contribution due to quarks at high temperatures into the framework. It locates the critical end point at $( \mu^{E}_{c}/T_c \approx2.6, T^{E}_{c}/T_c \approx 0.57)$, which hints for a deeper analysis of screening effects on models of this kind.