title: Equilibrium stochastic control with implicitly defined objective functions

abstract: This paper considers a class of stochastic control problems with implicitly defined objective functions, which are the sources of time-inconsistency. We study the closed-loop equilibrium solutions in a general controlled diffusion framework. First, we provide a sufficient and necessary condition for a strategy to be an equilibrium. Then, we apply the result to discuss two problems of dynamic portfolio selection for a class of betweenness preferences, allowing for closed convex constraints on portfolio weights and borrowing cost, respectively. The equilibrium portfolio strategies are explicitly characterized in terms of the solutions of some first-order ordinary differential equations for the case of deterministic market coefficients.


title: The Bridge Toward 6G: 5G-Advanced Evolution in 3GPP Release 19

abstract: The 3rd generation partnership project (3GPP) initiated 5G-Advanced in Release 18, laying a solid foundation for the further evolution of 5G-Advanced. Release 19-the next wave of 5G-Advanced-will primarily focus on commercial deployment needs while serving as a bridge toward 6G. In this article, we provide an in-depth overview of the 5G-Advanced evolution in 3GPP Release 19. We not only delve into the key technology components and their corresponding use cases in 5G-Advanced evolution but also shed light on initial 3GPP studies toward 6G.


title: Physics-informed neural network for modeling dynamic linear elasticity

abstract: In this work, we present the physics-informed neural network (PINN) model applied particularly to dynamic problems in solid mechanics. We focus on forward and inverse problems. Particularly, we show how a PINN model can be used efficiently for material identification in a dynamic setting. In this work, we assume linear continuum elasticity. We show results for two-dimensional (2D) plane strain problem and then we proceed to apply the same techniques for a three-dimensional (3D) problem. As for the training data we use the solution based on the finite element method. We rigorously show that PINN models are accurate, robust and computationally efficient, especially as a surrogate model for material identification problems. Also, we employ state-of-the-art techniques from the PINN literature which are an improvement to the vanilla implementation of PINN. Based on our results, we believe that the framework we have developed can be readily adapted to computational platforms for solving multiple dynamic problems in solid mechanics.


title: A search for auroral radio emission from \beta Pictoris b

abstract: Magnetized exoplanets can serve as the source of auroral radio emissions, allowing us to characterize the magnetospheric properties of these planets. Successful detections of auroral radio emissions from brown dwarfs, as well as from Jupiter, suggest that Jupiter-like planets in distant orbits may also generate radio emissions through a similar mechanism. In this study, we present our search for 250-500 MHz emissions from $\beta$ Pictoris b, one of the most extensively studied young Jupiter-like planets. We conducted the search using the upgraded Giant Metrewave Radio Telescope (uGMRT). Despite the favourable orbital inclination, no signal was detected, putting 3$\sigma$ upper limits on the radiation at 0.18 mJy. We translate this limit into constraints on the ionospheric and magnetospheric parameters, assuming that the emission is powered by the Hill current system. While the upper limit is larger by a factor of a few than the nominal estimate of radio intensity, we put constraints on the magnetospheric and ionospheric parameters.


title: Stochastic Data-Driven Predictive Control with Equivalence to Stochastic MPC

abstract: We propose a data-driven receding-horizon control method dealing with the chance-constrained output-tracking problem of unknown stochastic linear time-invariant (LTI) systems with partial state observation. The proposed method takes into account the statistics of the process noise, the measurement noise and the uncertain initial condition, following an analogous framework to Stochastic Model Predictive Control (SMPC), but does not rely on the use of a parametric system model. As such, our receding-horizon algorithm produces a sequence of closed-loop control policies for predicted time steps, as opposed to a sequence of open-loop control actions. Under certain conditions, we establish that our proposed data-driven control method produces identical control inputs as that produced by the associated model-based SMPC. Simulation results on a grid-connected power converter are provided to illustrate the performance benefits of our methodology.


title: Quantum Theory of Wave Scattering from Electromagnetic Time Interfaces

abstract: Modulating macroscopic parameters of materials in time reveals alternative avenues for manipulating electromagnetic waves. Due to such a significant impact, the general research subject of time-varying systems is flourishing today in different branches of electromagnetism and optics. However, besides uncovering different phenomena and effects in the realm of classical electrodynamics, we need to simultaneously study also the quantum aspects of this emerging subject in order to comprehend thoroughly the behavior of quanta of electromagnetic fields. Here, through the lens of quantum optics, we scrutinize the interaction of electromagnetic waves with materials whose effective parameters suddenly change in time. In particular, considering the basic case of temporal discontinuity for the refractive index of a non-dispersive dielectric material, we explicitly show the transformation of bosonic annihilation and creation operators and describe corresponding output quantum states for two specific input states: A Fock state and a coherent state. Accordingly, we rigorously elucidate the probability distribution and illustrate the related photon statistics. In consequence, we explain phenomena such as photon-pair generation and remark on several important conditions associated with photon statistics. Hopefully, this work paves the road for further vital explorations of a quantum theory of wave interaction with photonic time crystals or with dispersive time-varying materials.


title: Evaluating District-based Election Surveys with Synthetic Dirichlet Likelihood

abstract: In district-based multi-party elections, electors cast votes in their respective districts. In each district, the party with maximum votes wins the corresponding seat in the governing body. Election Surveys try to predict the election outcome (vote shares and seat shares of parties) by querying a random sample of electors. However, the survey results are often inconsistent with the actual results, which could be due to multiple reasons. The aim of this work is to estimate a posterior distribution over the possible outcomes of the election, given one or more survey results. This is achieved using a prior distribution over vote shares, election models to simulate the complete election from the vote share, and survey models to simulate survey results from a complete election. The desired posterior distribution over the space of possible outcomes is constructed using Synthetic Dirichlet Likelihoods, whose parameters are estimated from Monte Carlo sampling of elections using the election models. We further show the same approach can also use be used to evaluate the surveys - whether they were biased or not, based on the true outcome once it is known. Our work offers the first-ever probabilistic model to analyze district-based election surveys. We illustrate our approach with extensive experiments on real and simulated data of district-based political elections in India.


title: Role of Motility and Nutrient Availability in Drying Patterns of Algal Droplets

abstract: Sessile drying droplets in various bio-relevant systems, encompassing passive bio-colloids like DNA, proteins, and blood to active microbes, gain considerable attention due to intricate interplay among different convective flows, droplet pinning, mechanical stress, wettability, and the emergence of distinctive patterns. Chlamydomonas reinhardtii, or chlamys, is a versatile algal model employed in molecular biology research and spanning diverse biotechnological realms. While chlamys are harnessed at single-cell and population levels, their exploration in the context of drying sessile droplets remains limited. This paper illuminates the multifaceted potential of chlamys, delving into motility-nutrient interactions and their role in emergent morphological patterns. The interplay of two competing stressors -- localized nutrient scarcity and mechanical stress during drying -- is investigated. Irrespective of these stressors, the global mechanical stress fails to induce any cracks during the drying process. Interestingly, the reverse ``coffee-ring effect" is predominantly observed in the non-motile chlamys in the presence of local nutrients whereas the nutrient depletion prompts local stress in motile chlamys, culminating in cooperative aggregation and cluster formation. Furthermore, the quantitative image processing technique leverages textural statistics to classify the patterns into four classes, motile+with nutrients, motile+without nutrients, non-motile+with nutrients, and non-motile+without nutrients, with five distinct drying stages -- Droplet Deposition, Capillary Flow, Dynamic Droplet Phase, Aggregation Phase, and Dried Morphology.


title: Multilingual Bias Detection and Mitigation for Indian Languages

abstract: Lack of diverse perspectives causes neutrality bias in Wikipedia content leading to millions of worldwide readers getting exposed by potentially inaccurate information. Hence, neutrality bias detection and mitigation is a critical problem. Although previous studies have proposed effective solutions for English, no work exists for Indian languages. First, we contribute two large datasets, mWikiBias and mWNC, covering 8 languages, for the bias detection and mitigation tasks respectively. Next, we investigate the effectiveness of popular multilingual Transformer-based models for the two tasks by modeling detection as a binary classification problem and mitigation as a style transfer problem. We make the code and data publicly available.


title: Narrowing the semantic gaps in U-Net with learnable skip connections: The case of medical image segmentation

abstract: Most state-of-the-art methods for medical image segmentation adopt the encoder-decoder architecture. However, this U-shaped framework still has limitations in capturing the non-local multi-scale information with a simple skip connection. To solve the problem, we firstly explore the potential weakness of skip connections in U-Net on multiple segmentation tasks, and find that i) not all skip connections are useful, each skip connection has different contribution; ii) the optimal combinations of skip connections are different, relying on the specific datasets. Based on our findings, we propose a new segmentation framework, named UDTransNet, to solve three semantic gaps in U-Net. Specifically, we propose a Dual Attention Transformer (DAT) module for capturing the channel- and spatial-wise relationships to better fuse the encoder features, and a Decoder-guided Recalibration Attention (DRA) module for effectively connecting the DAT tokens and the decoder features to eliminate the inconsistency. Hence, both modules establish a learnable connection to solve the semantic gaps between the encoder and the decoder, which leads to a high-performance segmentation model for medical images. Comprehensive experimental results indicate that our UDTransNet produces higher evaluation scores and finer segmentation results with relatively fewer parameters over the state-of-the-art segmentation methods on different public datasets. Code: https://github.com/McGregorWwww/UDTransNet.


title: On covariant perturbations with scalar field in modified Gauss-Bonnet gravity

abstract: We investigate cosmological perturbations of f(G) gravity in the presence of a scalar field. Using the 1 + 3 covariant formalism, we present the energy overdensity perturbation equations responsible for large scale structure formation. After applying harmonic decomposition method together with the redshift transformation technique, we obtain the fully perturbed equations in redshift space. The equations are solved to study the growth of matter overdensities contrast with redshift. For both short- and long-wavelength modes, we obtain numerical results for particular functional form f(G) models and scalar field. We find that, for this choice the energy overdensity perturbations decay with increase in redshift. However, for both short- and long- wavelength modes, the perturbations which include amplitude effects due to the f(G) models with a scalar field do differ remarkably from those in Lambda CDM. The results reduce to GR results in the limit of f(G) tends to G and in the absence of scalar field.


title: ZO-AdaMU Optimizer: Adapting Perturbation by the Momentum and Uncertainty in Zeroth-order Optimization

abstract: Lowering the memory requirement in full-parameter training on large models has become a hot research area. MeZO fine-tunes the large language models (LLMs) by just forward passes in a zeroth-order SGD optimizer (ZO-SGD), demonstrating excellent performance with the same GPU memory usage as inference. However, the simulated perturbation stochastic approximation for gradient estimate in MeZO leads to severe oscillations and incurs a substantial time overhead. Moreover, without momentum regularization, MeZO shows severe over-fitting problems. Lastly, the perturbation-irrelevant momentum on ZO-SGD does not improve the convergence rate. This study proposes ZO-AdaMU to resolve the above problems by adapting the simulated perturbation with momentum in its stochastic approximation. Unlike existing adaptive momentum methods, we relocate momentum on simulated perturbation in stochastic gradient approximation. Our convergence analysis and experiments prove this is a better way to improve convergence stability and rate in ZO-SGD. Extensive experiments demonstrate that ZO-AdaMU yields better generalization for LLMs fine-tuning across various NLP tasks than MeZO and its momentum variants.


title: emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation

abstract: We propose emotion2vec, a universal speech emotion representation model. emotion2vec is pre-trained on open-source unlabeled emotion data through self-supervised online distillation, combining utterance-level loss and frame-level loss during pre-training. emotion2vec outperforms state-of-the-art pre-trained universal models and emotion specialist models by only training linear layers for the speech emotion recognition task on the mainstream IEMOCAP dataset. In addition, emotion2vec shows consistent improvements among 10 different languages of speech emotion recognition datasets. emotion2vec also shows excellent results on other emotion tasks, such as song emotion recognition, emotion prediction in conversation, and sentiment analysis. Comparison experiments, ablation experiments, and visualization comprehensively demonstrate the universal capability of the proposed emotion2vec. To the best of our knowledge, emotion2vec is the first universal representation model in various emotion-related tasks, filling a gap in the field.


title: Efficient Asynchronous Federated Learning with Sparsification and Quantization

abstract: While data is distributed in multiple edge devices, Federated Learning (FL) is attracting more and more attention to collaboratively train a machine learning model without transferring raw data. FL generally exploits a parameter server and a large number of edge devices during the whole process of the model training, while several devices are selected in each round. However, straggler devices may slow down the training process or even make the system crash during training. Meanwhile, other idle edge devices remain unused. As the bandwidth between the devices and the server is relatively low, the communication of intermediate data becomes a bottleneck. In this paper, we propose Time-Efficient Asynchronous federated learning with Sparsification and Quantization, i.e., TEASQ-Fed. TEASQ-Fed can fully exploit edge devices to asynchronously participate in the training process by actively applying for tasks. We utilize control parameters to choose an appropriate number of parallel edge devices, which simultaneously execute the training tasks. In addition, we introduce a caching mechanism and weighted averaging with respect to model staleness to further improve the accuracy. Furthermore, we propose a sparsification and quantitation approach to compress the intermediate data to accelerate the training. The experimental results reveal that TEASQ-Fed improves the accuracy (up to 16.67% higher) while accelerating the convergence of model training (up to twice faster).


title: IRG: Generating Synthetic Relational Databases using GANs

abstract: There is an overgrowing demand for data sharing in academia and industry. However, such sharing has issues with personal privacy and data confidentiality. One option is to share only synthetically-generated versions of the real data. Generative Adversarial Network (GAN) is a recently-popular technique that can be used for this purpose. Relational databases usually have multiple tables that are related to each other. So far, the use of GANs has essentially focused on generating single tables. This paper presents Incremental Relational Generator (IRG), which uses GANs to synthetically generate interrelated tables. Given an empirical relational database, IRG can generate a synthetic version that can be safely shared. IRG generates the tables in some sequential order. The key idea is to construct a context, based on the tables generated so far, when using a GAN to generate the next table. Experiments with public datasets and private student data show that IRG outperforms state-of-the-art in terms of statistical properties and query results.


title: CSI Measurements and Initial Results for Massive MIMO to UAV Communication

abstract: Non-Terrestrial Network (NTN) has been envisioned as a key component of the sixth-generation (6G) mobile communication system. Meanwhile, unmanned aerial vehicles (UAVs) play an important role in enabling and deploying NTNs. In this paper, we focus on massive multi-input multi-output (MaMIMO) supported UAV communications, where channel state information (CSI) was measured considering different heights and trajectories of a rotary-wing drone. To characterize the propagation channel for this air-to-ground link, some initial results were analyzed, such as stationary distance. To investigate the impact of channels on communication performance, we analyzed spectral efficiency (SE) by using Maximum Ratio Combining (MRC). This study shows that the presented space-time-frequency channel dataset facilitates channel correlation analysis and supports performance evaluation for MaMIMO-UAV communications.


title: Helmholtz decomposition based windowed Green function methods for elastic scattering problems on a half-space

abstract: This paper proposes a new Helmholtz decomposition based windowed Green function (HD-WGF) method for solving the time-harmonic elastic scattering problems on a half-space with Dirichlet boundary conditions in both 2D and 3D. The Helmholtz decomposition is applied to separate the pressure and shear waves, which satisfy the Helmholtz and Helmholtz/Maxwell equations, respectively, and the corresponding boundary integral equations of type $(\mathbb{I}+\mathbb{T})\bs\phi=\bs f$, that couple these two waves on the unbounded surface, are derived based on the free-space fundamental solution of Helmholtz equation. This approach avoids the treatment of the complex elastic displacement tensor and traction operator that involved in the classical integral equation method for elastic problems. Then a smooth ``slow-rise'' windowing function is introduced to truncate the boundary integral equations and a ``correction'' strategy is proposed to ensure the uniformly fast convergence for all incident angles of plane incidence. Numerical experiments for both two and three dimensional problems are presented to demonstrate the accuracy and efficiency of the proposed method.


title: SAIC: Integration of Speech Anonymization and Identity Classification

abstract: Speech anonymization and de-identification have garnered significant attention recently, especially in the healthcare area including telehealth consultations, patient voiceprint matching, and patient real-time monitoring. Speaker identity classification tasks, which involve recognizing specific speakers from audio to learn identity features, are crucial for de-identification. Since rare studies have effectively combined speech anonymization with identity classification, we propose SAIC - an innovative pipeline for integrating Speech Anonymization and Identity Classification. SAIC demonstrates remarkable performance and reaches state-of-the-art in the speaker identity classification task on the Voxceleb1 dataset, with a top-1 accuracy of 96.1%. Although SAIC is not trained or evaluated specifically on clinical data, the result strongly proves the model's effectiveness and the possibility to generalize into the healthcare area, providing insightful guidance for future work.


title: Personalized Federated Learning with Contextual Modulation and Meta-Learning

abstract: Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices, and non-i.i.d. data distribution pose significant obstacles to achieving optimal model performance. We propose a novel framework that combines federated learning with meta-learning techniques to enhance both efficiency and generalization capabilities. Our approach introduces a federated modulator that learns contextual information from data batches and uses this knowledge to generate modulation parameters. These parameters dynamically adjust the activations of a base model, which operates using a MAML-based approach for model personalization. Experimental results across diverse datasets highlight the improvements in convergence speed and model performance compared to existing federated learning approaches. These findings highlight the potential of incorporating contextual information and meta-learning techniques into federated learning, paving the way for advancements in distributed machine learning paradigms.


title: Box dimension of fractal interpolation surfaces with vertical scaling function

abstract: In this paper, we first present a simple lemma which allows us to estimate the box dimension of graphs of given functions by the associated oscillation sums and oscillation vectors. Then we define vertical scaling matrices of generalized affine fractal interpolation surfaces (FISs). By using these matrices, we establish relationships between oscillation vectors of different levels, which enables us to obtain the box dimension of generalized affine FISs under certain constraints.


title: A Probabilistic Extension of the Fubini Polynomials

abstract: In this paper, we present a probabilistic extension of the Fubini polynomials and numbers associated with a random variable satisfying some appropriate moment conditions. We obtain the exponential generating function and an integral representation for it. The higher order Fubini polynomials and recurrence relations are also derived. A probabilistic generalization of a series transformation formula and some interesting examples are discussed. A connection between the probabilistic Fubini polynomials and Bernoulli, Poisson, and geometric random variables are also established. Finally, a determinant expression formula is presented.


title: PokeMQA: Programmable knowledge editing for Multi-hop Question Answering

abstract: Multi-hop question answering (MQA) is one of the challenging tasks to evaluate machine's comprehension and reasoning abilities, where large language models (LLMs) have widely achieved the human-comparable performance. Due to the dynamics of knowledge facts in real world, knowledge editing has been explored to update model with the up-to-date facts while avoiding expensive re-training or fine-tuning. Starting from the edited fact, the updated model needs to provide cascading changes in the chain of MQA. The previous art simply adopts a mix-up prompt to instruct LLMs conducting multiple reasoning tasks sequentially, including question decomposition, answer generation, and conflict checking via comparing with edited facts. However, the coupling of these functionally-diverse reasoning tasks inhibits LLMs' advantages in comprehending and answering questions while disturbing them with the unskilled task of conflict checking. We thus propose a framework, Programmable knowledge editing for Multi-hop Question Answering (PokeMQA), to decouple the jobs. Specifically, we prompt LLMs to decompose knowledge-augmented multi-hop question, while interacting with a detached trainable scope detector to modulate LLMs behavior depending on external conflict signal. The experiments on three LLM backbones and two benchmark datasets validate our superiority in knowledge editing of MQA, outperforming all competitors by a large margin in almost all settings and consistently producing reliable reasoning process.


title: Mutual Information as Intrinsic Reward of Reinforcement Learning Agents for On-demand Ride Pooling

abstract: The emergence of on-demand ride pooling services allows each vehicle to serve multiple passengers at a time, thus increasing drivers' income and enabling passengers to travel at lower prices than taxi/car on-demand services (only one passenger can be assigned to a car at a time like UberX and Lyft). Although on-demand ride pooling services can bring so many benefits, ride pooling services need a well-defined matching strategy to maximize the benefits for all parties (passengers, drivers, aggregation companies and environment), in which the regional dispatching of vehicles has a significant impact on the matching and revenue. Existing algorithms often only consider revenue maximization, which makes it difficult for requests with unusual distribution to get a ride. How to increase revenue while ensuring a reasonable assignment of requests brings a challenge to ride pooling service companies (aggregation companies). In this paper, we propose a framework for vehicle dispatching for ride pooling tasks, which splits the city into discrete dispatching regions and uses the reinforcement learning (RL) algorithm to dispatch vehicles in these regions. We also consider the mutual information (MI) between vehicle and order distribution as the intrinsic reward of the RL algorithm to improve the correlation between their distributions, thus ensuring the possibility of getting a ride for unusually distributed requests. In experimental results on a real-world taxi dataset, we demonstrate that our framework can significantly increase revenue up to an average of 3\% over the existing best on-demand ride pooling method.


title: Fast Identification of Transients: Applying Expectation Maximization to Neutrino Data

abstract: We present a novel method for identifying transients suitable for both strong signal-dominated and background-dominated objects. By employing the unsupervised machine learning algorithm known as expectation maximization, we achieve computing time reductions of over $10^4$ on a single CPU compared to conventional brute-force methods. Furthermore, this approach can be readily extended to analyze multiple flares. We illustrate the algorithm's application by fitting the IceCube neutrino flare of TXS 0506+056.

categories: astro-ph.IM astro-ph.HE physics.comp-ph physics.data-an


title: TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation

abstract: Direct speech-to-speech translation achieves high-quality results through the introduction of discrete units obtained from self-supervised learning. This approach circumvents delays and cascading errors associated with model cascading. However, talking head translation, converting audio-visual speech (i.e., talking head video) from one language into another, still confronts several challenges compared to audio speech: (1) Existing methods invariably rely on cascading, synthesizing via both audio and text, resulting in delays and cascading errors. (2) Talking head translation has a limited set of reference frames. If the generated translation exceeds the length of the original speech, the video sequence needs to be supplemented by repeating frames, leading to jarring video transitions. In this work, we propose a model for talking head translation, \textbf{TransFace}, which can directly translate audio-visual speech into audio-visual speech in other languages. It consists of a speech-to-unit translation model to convert audio speech into discrete units and a unit-based audio-visual speech synthesizer, Unit2Lip, to re-synthesize synchronized audio-visual speech from discrete units in parallel. Furthermore, we introduce a Bounded Duration Predictor, ensuring isometric talking head translation and preventing duplicate reference frames. Experiments demonstrate that our proposed Unit2Lip model significantly improves synchronization (1.601 and 0.982 on LSE-C for the original and generated audio speech, respectively) and boosts inference speed by a factor of 4.35 on LRS2. Additionally, TransFace achieves impressive BLEU scores of 61.93 and 47.55 for Es-En and Fr-En on LRS3-T and 100% isochronous translations.


title: Do LLM Agents Exhibit Social Behavior?

abstract: The advances of Large Language Models (LLMs) are expanding their utility in both academic research and practical applications. Recent social science research has explored the use of these ``black-box'' LLM agents for simulating complex social systems and potentially substituting human subjects in experiments. Our study delves into this emerging domain, investigating the extent to which LLMs exhibit key social interaction principles, such as social learning, social preference, and cooperative behavior (indirect reciprocity), in their interactions with humans and other agents. We develop a framework for our study, wherein classical laboratory experiments involving human subjects are adapted to use LLM agents. This approach involves step-by-step reasoning that mirrors human cognitive processes and zero-shot learning to assess the innate preferences of LLMs. Our analysis of LLM agents' behavior includes both the primary effects and an in-depth examination of the underlying mechanisms. Focusing on GPT-4, our analyses suggest that LLM agents appear to exhibit a range of human-like social behaviors such as distributional and reciprocity preferences, responsiveness to group identity cues, engagement in indirect reciprocity, and social learning capabilities. However, our analysis also reveals notable differences: LLMs demonstrate a pronounced fairness preference, weaker positive reciprocity, and a more calculating approach in social learning compared to humans. These insights indicate that while LLMs hold great promise for applications in social science research, such as in laboratory experiments and agent-based modeling, the subtle behavioral differences between LLM agents and humans warrant further investigation. Careful examination and development of protocols in evaluating the social behaviors of LLMs are necessary before directly applying these models to emulate human behavior.


title: Revealing Shadows: Low-Light Image Enhancement Using Self-Calibrated Illumination

abstract: In digital imaging, enhancing visual content in poorly lit environments is a significant challenge, as images often suffer from inadequate brightness, hidden details, and an overall reduction in quality. This issue is especially critical in applications like nighttime surveillance, astrophotography, and low-light videography, where clear and detailed visual information is crucial. Our research addresses this problem by enhancing the illumination aspect of dark images. We have advanced past techniques by using varied color spaces to extract the illumination component, enhance it, and then recombine it with the other components of the image. By employing the Self-Calibrated Illumination (SCI) method, a strategy initially developed for RGB images, we effectively intensify and clarify details that are typically lost in low-light conditions. This method of selective illumination enhancement leaves the color information intact, thus preserving the color integrity of the image. Crucially, our method eliminates the need for paired images, making it suitable for situations where they are unavailable. Implementing the modified SCI technique represents a substantial shift from traditional methods, providing a refined and potent solution for low-light image enhancement. Our approach sets the stage for more complex image processing techniques and extends the range of possible real-world applications where accurate color representation and improved visibility are essential.


title: Pulse-driven depinning of magnetic gap modes in ferromagnetic films

abstract: Manipulation of magnons in artificial magnonic crystals (MCs) leads to fascinating nonlinear wave phenomena such as the generation of gap solitons, which has been mostly limited to one-dimensional systems. Here, we propose a model system for the magnetization in two-dimensional MCs subjected to a periodic external magnetic field, describing the dynamics of magnetic gap solitons (MGSs) formed by nonlinear self-trapping. We show the formation, stability, and dynamics for various two-dimensional gap modes, including gap solitons and vortical ones. Their existence regions depend on the anisotropic axis orientation of the ferromagnetic film. The Bloch oscillation and depinning propagation of MGSs under constant spin-current injections are discovered and characterized. We design a scheme of pulse current injection to achieve distortionless propagation of MGSs. These findings show that the 2D magnonic crystals can be viewed as a building block for MGSs-based storage and transmission, where the propagation and localization are variously controlled and reconfigurable.


title: Multiplicity dependence of $\sigma_{\psi(2S)}/\sigma_{J/\psi}$ in $pp$ collisions at $\sqrt{s}=13$ TeV

abstract: The ratio of production cross-sections of $\psi(2S)$ over $J/\psi$ mesons as a function of charged-particle multiplicity in proton-proton collisions at a centre-of-mass energy $\sqrt{s}=13$ TeV is measured with a data sample collected by the LHCb detector, corresponding to an integrated luminosity of 658 pb$^{-1}$. The ratio is measured for both prompt and non-prompt $\psi(2S)$ and $J/\psi$ mesons. When there is an overlap between the rapidity ranges over which multiplicity and charmonia production are measured, a multiplicity-dependent modification of the ratio is observed for prompt mesons. No significant multiplicity dependence is found when the ranges do not overlap. For non-prompt production, the $\psi(2S)-to-J/\psi$ production ratio is roughly independent of multiplicity irrespective of the rapidity range over which the multiplicity is measured. The results are compared to predictions of the co-mover model and agree well except in the low multiplicity region. The ratio of production cross-sections of $\psi(2S)$ over $J/\psi$ mesons are cross-checked with other measurements in di-lepton channels and found to be compatible.


title: Enhancing Code Intelligence Tasks with ChatGPT

abstract: Pre-trained code models have emerged as crucial tools in various code intelligence tasks. However, their effectiveness depends on the quality of the pre-training dataset, particularly the human reference comments, which serve as a bridge between the programming language and natural language. One significant challenge is that such comments can become inconsistent with the corresponding code as the software evolves. This discrepancy can lead to suboptimal training of the models, decreasing their performances. LLMs have demonstrated superior capabilities in generating high-quality code comments. In light of that, we try to tackle the quality issue of the dataset by harnessing the power of LLMs. Specifically, we raise the question: Can we rebuild the pre-training dataset by substituting the original comments with LLM-generated ones for more effective pre-trained code models? To answer the question, we first conduct a comprehensive evaluation to compare ChatGPT-generated comments with human reference comments. As existing reference-based metrics treat the reference comments as gold standards, we introduce two auxiliary tasks as novel reference-free metrics to assess the quality of comments, i.e., code-comment inconsistency detection and code search. Experimental results show that ChatGPT-generated comments demonstrate superior semantic consistency with the code compared to human references, indicating the potential of utilizing ChatGPT to enhance the quality of the pre-training dataset. We rebuilt the widely used dataset, CodeSearchNet, with ChatGPT-generated comments. Subsequent experiments involve re-pre-training the CodeT5 with our refined dataset.Evaluation results on four generation tasks and one understanding code intelligence tasks show that the model pre-trained by ChatGPT-enhanced data outperforms its counterpart on code summarization, code generation, and code translation tasks.


title: A novel class of functionals for perturbative algebraic quantum field theory

abstract: Perturbative Algebraic Quantum Field Theory (pAQFT) is based upon formal power series valued in spaces of functionals. This is usually done with microcausal functionals, which are defined using microlocal analysis and motivated by propagation of singularities. In this paper, we prove that the class of microcausal functionals is not closed under the Peierls (Poisson) bracket by showing that a Peierls bracket of regular functionals can fail to be smooth. Consequently, microcausal functionals are not a suitable basis for pAQFT. To remedy these issues, we introduce the class of equicausal functionals. We show that this class contains the local functionals and that it closes under the star-product and Peierls bracket. Furthermore, we prove the time-slice axiom for equicausal functionals, using a chain homotopy. The class of microcausal functionals is not closed under this chain homotopy, which strongly suggests that the class of microcausal functionals does not fulfill the time slice axiom.


title: DexDLO: Learning Goal-Conditioned Dexterous Policy for Dynamic Manipulation of Deformable Linear Objects

abstract: Deformable linear object (DLO) manipulation is needed in many fields. Previous research on deformable linear object (DLO) manipulation has primarily involved parallel jaw gripper manipulation with fixed grasping positions. However, the potential for dexterous manipulation of DLOs using an anthropomorphic hand is under-explored. We present DexDLO, a model-free framework that learns dexterous dynamic manipulation policies for deformable linear objects with a fixed-base dexterous hand in an end-to-end way. By abstracting several common DLO manipulation tasks into goal-conditioned tasks, our DexDLO can perform these tasks, such as DLO grabbing, DLO pulling, DLO end-tip position controlling, etc. Using the Mujoco physics simulator, we demonstrate that our framework can efficiently and effectively learn five different DLO manipulation tasks with the same framework parameters. We further provide a thorough analysis of learned policies, reward functions, and reduced observations for a comprehensive understanding of the framework.


title: X-Vine Models for Multivariate Extremes

abstract: Regular vine sequences permit the organisation of variables in a random vector along a sequence of trees. Regular vine models have become greatly popular in dependence modelling as a way to combine arbitrary bivariate copulas into higher-dimensional ones, offering flexibility, parsimony, and tractability. In this project, we use regular vine structures to decompose and construct the exponent measure density of a multivariate extreme value distribution, or, equivalently, the tail copula density. Although these densities pose theoretical challenges due to their infinite mass, their homogeneity property offers simplifications. The theory sheds new light on existing parametric families and facilitates the construction of new ones, called X-vines. Computations proceed via recursive formulas in terms of bivariate model components. We develop simulation algorithms for X-vine multivariate Pareto distributions as well as methods for parameter estimation and model selection on the basis of threshold exceedances. The methods are illustrated by Monte Carlo experiments and a case study on US flight delay data.


title: Impact of anisotropic cosmic-ray transport on the gamma-ray signatures in the Galactic Center

abstract: The very high energy (VHE) emission of the Central Molecular Zone (CMZ) is rarely modelled in 3D. Most approaches describe the morphology in 1D or simplify the diffusion to the isotropic case. In this work we show the impact of a realistic 3D magnetic field configuration and gas distribution on the VHE gamma-ray distribution of the CMZ. We solve the 3D cosmic-ray transport equation with an anisotropic diffusion tensor using the approach of stochastic differential equations as implemented in the CRPropa framework. We test two different source distributions for five different anisotropies of the diffusion tensor, covering the range of effectively fieldline-parallel diffusion to isotropic diffusion. Within the tested magnetic field configuration the anisotropy of the diffusion tensor is close to the isotropic case and three point sources within the CMZ are favoured. Future missions like the upcoming CTA will reveal more small-scale structures which are not jet included in the model. Therefor a more detailed 3D gas distribution and magnetic field structure will be needed.


title: Finite time horizon mixed control of vibrational systems

abstract: We consider a vibrational system control problem over a finite time horizon. The performance measure of the system is taken to be $p$-mixed $H_2$ norm which generalizes the standard $H_2$ norm. We present an algorithm for efficient calculation of this norm in the case when the system is parameter dependent and the number of inputs or outputs of the system is significantly smaller than the order of the system. Our approach is based on a novel procedure which is not based on solving Lyapunov equations and which takes into account the structure of the system. We use a characterization of the $H_2$ norm given in terms of integrals which we solve using adaptive quadrature rules. This enables us to use recycling strategies as well as parallelization. The efficiency of the new algorithm allows for an analysis of the influence of various system parameters and different finite time horizons on the value of the $p$-mixed $H_2$ norm. We illustrate our approach by numerical examples concerning an $n$-mass oscillator with one damper.


title: Non-equilibrium-diffusion limit of the compressible Euler radiation model

abstract: We justify rigorously the non-equilibrium-diffusion limit of the compressible Euler model coupled with a radiative transfer equation arising in radiation hydrodynamics. For general initial data, we establish the uniform existence of the solution to the coupled model in $\mathbb{T}^{3}$ and prove the convergence of the solutions to the limiting system in the nonequilibrium-diffusion regime. Moreover, the initial layer for the radiative density is constructed to get the strong convergence in $L^\infty$ norm.


title: A dynamic approach to ceteris paribus counterfactuals

abstract: Counterfactuals are conditional statements describing consequences of states of affairs that might not have occurred. Ceteris paribus counterfactuals take into account specific conditions which hold at the actual state of affairs, and which ought to be kept unchanged throughout the evaluation. Inspired by the approach of Girard and Triplett, we define ceteris paribus conditionals as dynamic operators over (weakly) centered sphere models. We introduce three ways of evaluating the operators, by updating sphere models based on ceteris paribus sets of formulas. Our approach features two main novelties: on the one hand, we define our ceteris paribus conditionals as proper dynamic operators, thus allowing for iterated evaluations. On the other hand, when updating the worlds within a system of sphere we additionally take into account a notion of 'significance' of the formulas that ought to be kept unchanged. We discuss the relations of our model updates with other prioritisations introduced in the literature, and show completeness of the set of valid formulas in the updated centered (resp. weakly centered) sphere models with respect to Lewis' axiomatization of the conditional logic VC (resp. VW).


title: Kinetic derivation of a compressible Leslie--Ericksen equation for rarified calamitic gases

abstract: Nematic ordering describes the phenomenon where anisotropic molecules tend to locally align, like matches in a matchbox. This ordering can arise in solids (as nematic elastomers), liquids (as liquid crystals), and in gases. In the 1940s, Onsager described how nematic ordering can arise in dilute colloidal suspensions from the molecular point of view. However, the kinetic theory of nonspherical molecules has not, thus far, accounted for phenomena relating to the presence of nematic ordering. In this work we develop a kinetic theory for the behavior of rarified calamitic (rodlike) gases in the presence of nematic ordering. Building on previous work by Curtiss, we derive from kinetic theory the rate of work hypothesis that forms the starting point for Leslie--Ericksen theory. We incorporate ideas from the variational theory of nematic liquid crystals to create a moment closure that preserves the coupling between the laws of linear and angular momentum. The coupling between these laws is a key feature of our theory, in contrast to the kinetic theory proposed by {Curtiss \& Dahler}, where the couple stress tensor is assumed to be zero. This coupling allows the characterization of anisotropic phenomena arising from the nematic ordering. Furthermore, the theory leads to an energy functional that is a compressible variant of the classical Oseen--Frank energy (with a pressure-dependent Frank constant) and to a compressible analogue of the Leslie--Ericksen equations. The emergence of compressible aspects in the theory for nematic fluids enhances our understanding of these complex systems.


title: MACE-OFF23: Transferable Machine Learning Force Fields for Organic Molecules

abstract: Classical empirical force fields have dominated biomolecular simulation for over 50 years. Although widely used in drug discovery, crystal structure prediction, and biomolecular dynamics, they generally lack the accuracy and transferability required for predictive modelling. In this paper, we introduce MACE-OFF23, a transferable force field for organic molecules created using state-of-the-art machine learning technology and first-principles reference data computed with a high level of quantum mechanical theory. MACE-OFF23 demonstrates the remarkable capabilities of local, short-range models by accurately predicting a wide variety of gas and condensed phase properties of molecular systems. It produces accurate, easy-to-converge dihedral torsion scans of unseen molecules, as well as reliable descriptions of molecular crystals and liquids, including quantum nuclear effects. We further demonstrate the capabilities of MACE-OFF23 by determining free energy surfaces in explicit solvent, as well as the folding dynamics of peptides. Finally, we simulate a fully solvated small protein, observing accurate secondary structure and vibrational spectrum. These developments enable first-principles simulations of molecular systems for the broader chemistry community at high accuracy and low computational cost.


title: Stochastic models of memristive behavior

abstract: Under normal operations, memristive devices undergo variability in time and space and have internal dynamics. Interplay of memory and stochastic signal processing in memristive devices makes them candidates for performing bio-inspired tasks of information transduction and transformation, where intrinsic random behavior can be harnessed for high performance of circuits built up of individual memory storing elements. The paper discusses models of single memristive devices exhibiting both - dynamic hysteresis and Stochastic Resonance, addressing also the cooperative effect of correlated noises acting on the system and occurrence of dirty hysteretic rounding.


title: Comparing machine learning potentials for water: Kernel-based regression and Behler-Parrinello neural networks

abstract: In this paper we investigate the performance of different machine learning potentials (MLPs) in predicting key thermodynamic properties of water using RPBE+D3. Specifically, we scrutinize kernel-based regression and high-dimensional neural networks trained on a highly accurate dataset consisting of about 1,500 structures, as well as a smaller data set, about half the size, obtained using only on-the-fly learning. The study reveals that despite minor differences between the MLPs, their agreement on observables such as the diffusion constant and pair-correlation functions is excellent, especially for the large training dataset. Variations in the predicted density isobars, albeit somewhat larger, are also acceptable, particularly given the errors inherent to approximate density functional theory. Overall, the study emphasizes the relevance of the database over the fitting method. Finally, the study underscores the limitations of root mean square errors and the need for comprehensive testing, advocating the use of multiple MLPs for enhanced certainty, particularly when simulating complex thermodynamic properties that may not be fully captured by simpler tests.


title: Isospectral CR manifolds with respect to the Kohn Laplacian

abstract: We prove that the spectrum of the Kohn Laplacian does not determine the equivalence classes of CR manifolds. We construct pairs of odd-dimensional elliptic manifolds that are not equivalent as CR manifolds but whose Kohn Laplacians have the same spectrum. These manifolds are endowed with the CR structures inherited from the canonical CR structure on the sphere of the same dimension. We provide three different constructions among lens spaces and an additional one among elliptic manifolds with non-cyclic fundamental groups.


title: Conceptualising an Anti-Digital Forensics Kill Chain for Smart Homes

abstract: The widespread integration of Internet of Things (IoT) devices in households generates extensive digital footprints, notably within Smart Home ecosystems. These IoT devices, brimming with data about residents, inadvertently offer insights into human activities, potentially embodying even criminal acts, such as a murder. As technology advances, so does the concern for criminals seeking to exploit various techniques to conceal evidence and evade investigations. This paper delineates the application of Anti-Digital Forensics (ADF) in Smart Home scenarios and recognises its potential to disrupt (digital) investigations. It does so by elucidating the current challenges and gaps and by arguing, in response, the conceptualisation of an ADF Kill Chain tailored to Smart Home ecosystems. While seemingly arming criminals, the Kill Chain will allow a better understanding of the distinctive peculiarities of Anti-Digital Forensics in Smart Home scenario. This understanding is essential for fortifying the Digital Forensics process and, in turn, developing robust countermeasures against malicious activities.


title: Calculate electronic excited states using neural networks with effective core potential

abstract: The essence of atomic structure theory, quantum chemistry, and computational materials science is solving the multi-electron stationary Schr\"odinger equation. The Quantum Monte Carlo-based neural network wave function method has surpassed traditional post-Hartree-Fock methods in precision across various systems. However, its energy uncertainty is limited to 0.01%, posing challenges in accurately determining excited states and ionization energies, especially for elements beyond the fourth period. Using effective core potentials to account for inner electrons enhances the precision of vertical excitation and ionization energies. This approach has proved effective in computing ground state energies for elements like Lithium to Gallium and in calculating energy levels and wave functions for atoms and molecules with second and fourth period elements. Additionally, by integrating effective core potentials with Ferminet, we've achieved multiple excited state calculations with a precision comparable to experimental results, marking a significant advancement in practical applications and setting a new standard for theoretical excited state calculations.


title: Constructing a T-test for Value Function Comparison of Individualized Treatment Regimes in the Presence of Multiple Imputation for Missing Data

abstract: Optimal individualized treatment decision-making has improved health outcomes in recent years. The value function is commonly used to evaluate the goodness of an individualized treatment decision rule. Despite recent advances, comparing value functions between different treatment decision rules or constructing confidence intervals around value functions remains difficult. We propose a t-test based method applied to a test set that generates valid p-values to compare value functions between a given pair of treatment decision rules when some of the data are missing. We demonstrate the ease in use of this method and evaluate its performance via simulation studies and apply it to the China Health and Nutrition Survey data.


title: Generalized Neural Networks for Real-Time Earthquake Early Warning

abstract: Deep learning enhances earthquake monitoring capabilities by mining seismic waveforms directly. However, current neural networks, trained within specific areas, face challenges in generalizing to diverse regions. Here, we employ a data recombination method to create generalized earthquakes occurring at any location with arbitrary station distributions for neural network training. The trained models can then be applied to various regions with different monitoring setups for earthquake detection and parameter evaluation from continuous seismic waveform streams. This allows real-time Earthquake Early Warning (EEW) to be initiated at the very early stages of an occurring earthquake. When applied to substantial earthquake sequences across Japan and California (US), our models reliably report earthquake locations and magnitudes within 4 seconds after the first triggered station, with mean errors of 2.6-6.3 km and 0.05-0.17, respectively. These generalized neural networks facilitate global applications of real-time EEW, eliminating complex empirical configurations typically required by traditional methods.


title: Scale Optimization Using Evolutionary Reinforcement Learning for Object Detection on Drone Imagery

abstract: Object detection in aerial imagery presents a significant challenge due to large scale variations among objects. This paper proposes an evolutionary reinforcement learning agent, integrated within a coarse-to-fine object detection framework, to optimize the scale for more effective detection of objects in such images. Specifically, a set of patches potentially containing objects are first generated. A set of rewards measuring the localization accuracy, the accuracy of predicted labels, and the scale consistency among nearby patches are designed in the agent to guide the scale optimization. The proposed scale-consistency reward ensures similar scales for neighboring objects of the same category. Furthermore, a spatial-semantic attention mechanism is designed to exploit the spatial semantic relations between patches. The agent employs the proximal policy optimization strategy in conjunction with the evolutionary strategy, effectively utilizing both the current patch status and historical experience embedded in the agent. The proposed model is compared with state-of-the-art methods on two benchmark datasets for object detection on drone imagery. It significantly outperforms all the compared methods.


title: Look-ahead Search on Top of Policy Networks in Imperfect Information Games

abstract: Search in test time is often used to improve the performance of reinforcement learning algorithms. Performing theoretically sound search in fully adversarial two-player games with imperfect information is notoriously difficult and requires a complicated training process. We present a method for adding test-time search to an arbitrary policy-gradient algorithm that learns from sampled trajectories. Besides the policy network, the algorithm trains an additional critic network, which estimates the expected values of players following various transformations of the policies given by the policy network. These values are then used for depth-limited search. We show how the values from this critic can create a value function for imperfect information games. Moreover, they can be used to compute the summary statistics necessary to start the search from an arbitrary decision point in the game. The presented algorithm is scalable to very large games since it does not require any search during train time. We evaluate the algorithm's performance when trained along Regularized Nash Dynamics, and we evaluate the benefit of using the search in the standard benchmark game of Leduc hold'em, multiple variants of imperfect information Goofspiel, and Battleships.


title: Learning from diversity: jati fractionalization, social expectations and improved sanitation practices in India

abstract: Prevalence of open defecation is associated with adverse health effects, detrimental not only for the individual but also the community. Therefore, neighborhood characteristics can influence collective progressive behavior such as improved sanitation practices. This paper uses primary data collected from rural and urban areas of Bihar to study the relationship between jati (sub-castes) level fractionalization within the community and toilet ownership and its usage for defecation. The findings indicate a diversity dividend wherein jati fractionalization is found to improve toilet ownership and usage significantly. While exploring the channels, we find social expectations to play an important role, where individuals from diverse communities tend to believe that there is a higher prevalence of toilet usage within the community. To assess the reasons for the existence of these social expectations, we use data from an egocentric network survey on a sub-sample of the households. The findings reveal that in fractionalized communities, the neighbors with whom our respondents interacted are more likely to be from different jatis. They are also more likely to use toilets and approve of its usage due to health reasons. Discussions about toilets are more common among neighbors from fractionalized communities, which underscore the discernible role of social learning. The inferences drawn from the paper have significant implications for community level behavioral change interventions that aim at reducing open defecation.


title: Towards reaching a consensus in Bayesian trial designs: the case of 2-arm trials

abstract: Practical employment of Bayesian trial designs has been rare, in part due to the regulators' requirement to calibrate such designs with an upper bound for Type 1 error rate. This has led to an internally inconsistent hybrid methodology, where important advantages from applying the Bayesian principles are lost. To present an alternative approach, we consider the prototype case of a 2-arm superiority trial with binary outcomes. The design is adaptive, applying block randomization for treatment assignment and using error tolerance criteria based on sequentially updated posterior probabilities, to conclude efficacy of the experimental treatment or futility of the trial. The method also contains the option of applying a decision rule for terminating the trial early if the predicted costs from continuing would exceed the corresponding gains. We propose that the control of Type 1 error rate be replaced by a control of false discovery rate (FDR), a concept that lends itself to both frequentist and Bayesian interpretations. Importantly, if the regulators and the investigators can agree on a consensus distribution to represent their shared understanding on the effect sizes, the selected level of risk tolerance against false conclusions during the data analysis will also be a valid bound for the FDR. The approach can lower the ultimately unnecessary barriers from the practical application of Bayesian trial designs. This can lead to more flexible experimental protocols and more efficient use of trial data while still effectively guarding against falsely claimed discoveries.


title: A Survey on Large Language Models for Software Engineering

abstract: Software Engineering (SE) is the systematic design, development, and maintenance of software applications, underpinning the digital infrastructure of our modern mainworld. Very recently, the SE community has seen a rapidly increasing number of techniques employing Large Language Models (LLMs) to automate a broad range of SE tasks. Nevertheless, existing information of the applications, effects, and possible limitations of LLMs within SE is still not well-studied. In this paper, we provide a systematic survey to summarize the current state-of-the-art research in the LLM-based SE community. We summarize 30 representative LLMs of Source Code across three model architectures, 15 pre-training objectives across four categories, and 16 downstream tasks across five categories. We then present a detailed summarization of the recent SE studies for which LLMs are commonly utilized, including 155 studies for 43 specific code-related tasks across four crucial phases within the SE workflow. Besides, we summarize existing attempts to empirically evaluate LLMs in SE, such as benchmarks, empirical studies, and exploration of SE education. We also discuss several critical aspects of optimization and applications of LLMs in SE, such as security attacks, model tuning, and model compression. Finally, we highlight several challenges and potential opportunities on applying LLMs for future SE studies, such as exploring domain LLMs and constructing clean evaluation datasets. Overall, our work can help researchers gain a comprehensive understanding about the achievements of the existing LLM-based SE studies and promote the practical application of these techniques. Our artifacts are publicly available and will continuously updated at the living repository: \url{https://github.com/iSEngLab/AwesomeLLM4SE}.


title: LLM-Powered Hierarchical Language Agent for Real-time Human-AI Coordination

abstract: AI agents powered by Large Language Models (LLMs) have made significant advances, enabling them to assist humans in diverse complex tasks and leading to a revolution in human-AI coordination. LLM-powered agents typically require invoking LLM APIs and employing artificially designed complex prompts, which results in high inference latency. While this paradigm works well in scenarios with minimal interactive demands, such as code generation, it is unsuitable for highly interactive and real-time applications, such as gaming. Traditional gaming AI often employs small models or reactive policies, enabling fast inference but offering limited task completion and interaction abilities. In this work, we consider Overcooked as our testbed where players could communicate with natural language and cooperate to serve orders. We propose a Hierarchical Language Agent (HLA) for human-AI coordination that provides both strong reasoning abilities while keeping real-time execution. In particular, HLA adopts a hierarchical framework and comprises three modules: a proficient LLM, referred to as Slow Mind, for intention reasoning and language interaction, a lightweight LLM, referred to as Fast Mind, for generating macro actions, and a reactive policy, referred to as Executor, for transforming macro actions into atomic actions. Human studies show that HLA outperforms other baseline agents, including slow-mind-only agents and fast-mind-only agents, with stronger cooperation abilities, faster responses, and more consistent language communications.


title: Statistical Inference with Limited Memory: A Survey

abstract: The problem of statistical inference in its various forms has been the subject of decades-long extensive research. Most of the effort has been focused on characterizing the behavior as a function of the number of available samples, with far less attention given to the effect of memory limitations on performance. Recently, this latter topic has drawn much interest in the engineering and computer science literature. In this survey paper, we attempt to review the state-of-the-art of statistical inference under memory constraints in several canonical problems, including hypothesis testing, parameter estimation, and distribution property testing/estimation. We discuss the main results in this developing field, and by identifying recurrent themes, we extract some fundamental building blocks for algorithmic construction, as well as useful techniques for lower bound derivations.


title: The Table of the Structure Constants for the Complex Simple Lie Algebra of Type G_2 and Chevalley Commutator Formulas in the Chevalley Group of Type G_2 over a Field

abstract: This article is the second in the series and is devoted to the type G_2. The work consists of two parts. In the first part we calculate the structure constants of the complex simple Lie algebra of type G_2. All structure constants are represented as functions of the structure constants corresponding to extraspecial pairs. The results obtained are used to calculate the commutator Chevalley formulas for [x_r(u),x_s(y)], when the sum r+s is a root. Further, in the second part there is a table of structure constants and Chevalley commutator formulas in the special case, when all structure constants corresponding to extraspecial pairs are positive.


title: Considering a Classical Upper Bound on the Frobenius Number

abstract: In this paper we study the (classical) Frobenius problem, namely the problem of finding the largest integer that cannot be represented as a nonnegative integral combination of given relatively prime (strictly) positive integers (known as the Frobenius number). The main contribution of this paper are observations regarding a previously known upper bound on the Frobenius number where, in particular, we observe that a previously presented argument features a subtle error, which alters the value of the upper bound. Despite this, we demonstrate that the subtle error does not impact upon on the validity of the upper bound, although it does impact on the upper bounds tightness. Notably, we formally state the corrected result and additionally compare the relative tightness of the corrected upper bound with the original. In particular, we show that the updated bound is tighter in all but only a relatively "small" number of cases using both formal techniques and via Monte Carlo simulation techniques.


title: Adversarial Data Poisoning for Fake News Detection: How to Make a Model Misclassify a Target News without Modifying It

abstract: Fake news detection models are critical to countering disinformation but can be manipulated through adversarial attacks. In this position paper, we analyze how an attacker can compromise the performance of an online learning detector on specific news content without being able to manipulate the original target news. In some contexts, such as social networks, where the attacker cannot exert complete control over all the information, this scenario can indeed be quite plausible. Therefore, we show how an attacker could potentially introduce poisoning data into the training data to manipulate the behavior of an online learning method. Our initial findings reveal varying susceptibility of logistic regression models based on complexity and attack type.


title: Regularized PolyKervNets: Optimizing Expressiveness and Efficiency for Private Inference in Deep Neural Networks

abstract: Private computation of nonlinear functions, such as Rectified Linear Units (ReLUs) and max-pooling operations, in deep neural networks (DNNs) poses significant challenges in terms of storage, bandwidth, and time consumption. To address these challenges, there has been a growing interest in utilizing privacy-preserving techniques that leverage polynomial activation functions and kernelized convolutions as alternatives to traditional ReLUs. However, these alternative approaches often suffer from a trade-off between achieving faster private inference (PI) and sacrificing model accuracy. In particular, when applied to much deeper networks, these methods encounter training instabilities, leading to issues like exploding gradients (resulting in NaNs) or suboptimal approximations. In this study, we focus on PolyKervNets, a technique known for offering improved dynamic approximations in smaller networks but still facing instabilities in larger and more complex networks. Our primary objective is to empirically explore optimization-based training recipes to enhance the performance of PolyKervNets in larger networks. By doing so, we aim to potentially eliminate the need for traditional nonlinear activation functions, thereby advancing the state-of-the-art in privacy-preserving deep neural network architectures. Code can be found on GitHub at: \url{https://github.com/tolusophy/PolyKervNets/}


title: PERP: Rethinking the Prune-Retrain Paradigm in the Era of LLMs

abstract: Neural Networks can be efficiently compressed through pruning, significantly reducing storage and computational demands while maintaining predictive performance. Simple yet effective methods like Iterative Magnitude Pruning (IMP, Han et al., 2015) remove less important parameters and require a costly retraining procedure to recover performance after pruning. However, with the rise of Large Language Models (LLMs), full retraining has become infeasible due to memory and compute constraints. In this study, we challenge the practice of retraining all parameters by demonstrating that updating only a small subset of highly expressive parameters is often sufficient to recover or even improve performance compared to full retraining. Surprisingly, retraining as little as 0.27%-0.35% of the parameters of GPT-architectures achieves comparable performance to One Shot IMP across various sparsity levels. Our approach, Parameter-Efficient Retraining after Pruning (PERP), drastically reduces compute and memory demands, enabling pruning and retraining of up to 30 billion parameter models on a single NVIDIA A100 GPU within minutes. Despite magnitude pruning being considered as unsuited for pruning LLMs, our findings show that PERP positions it as a strong contender against state-of-the-art retraining-free approaches such as Wanda (Sun et al., 2023) and SparseGPT (Frantar & Alistarh, 2023), opening up a promising alternative to avoiding retraining.


title: Sensing-Enhanced Secure Communication: Joint Time Allocation and Beamforming Design

abstract: The integration of sensing and communication enables wireless communication systems to serve environment-aware applications. In this paper, we propose to leverage sensing to enhance physical layer security (PLS) in multiuser communication systems in the presence of a suspicious target. To this end, we develop a two-phase framework to first estimate the location of the potential eavesdropper by sensing and then utilize the estimated information to enhance PLS for communication. In particular, in the first phase, a dual-functional radar and communication (DFRC) base station (BS) exploits a sensing signal to mitigate the sensing information uncertainty of the potential eavesdropper. Then, in the second phase, to facilitate joint sensing and secure communication, the DFRC BS employs beamforming and artificial noise to enhance secure communication. The design objective is to maximize the system sum rate while alleviating the information leakage by jointly optimizing the time allocation and beamforming policy. Capitalizing on monotonic optimization theory, we develop a two-layer globally optimal algorithm to reveal the performance upper bound of the considered system. Simulation results show that the proposed scheme achieves a significant sum rate gain over two baseline schemes that adopt existing techniques. Moreover, our results unveil that ISAC is a promising paradigm for enhancing secure communication in wireless networks.


title: On Harnack inequality and harmonic Schwarz lemma

abstract: In this paper, we study the $(s, C(s))$-Harnack inequality in a domain $G\subset \mathbb{R}^n$ for $s\in(0,1)$ and $C(s)\geq1$ and present a series of inequalities related to $(s, C(s))$-Harnack functions and the Harnack metric. We also investigate the behavior of the Harnack metric under $K$-quasiconformal and $K$-quasiregular mappings, where $K\geq 1$. Finally, we provide a type of harmonic Schwarz lemma and improve the Schwarz-Pick estimate for a real-valued harmonic function.


title: Sample selection with noise rate estimation in noise learning of medical image analysis

abstract: Deep learning techniques have demonstrated remarkable success in the field of medical image analysis. However, the existence of label noise within data significantly hampers its performance. In this paper, we introduce a novel noise-robust learning method which integrates noise rate estimation into sample selection approaches for handling noisy datasets. We first estimate the noise rate of a dataset with Linear Regression based on the distribution of loss values. Then, potentially noisy samples are excluded based on this estimated noise rate, and sparse regularization is further employed to improve the robustness of our deep learning model. Our proposed method is evaluated on five benchmark medical image classification datasets, including two datasets featuring 3D medical images. Experiments show that our method outperforms other existing noise-robust learning methods, especially when noise rate is very big.


title: Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems

abstract: In the rapidly evolving landscape of artificial intelligence (AI), generative large language models (LLMs) stand at the forefront, revolutionizing how we interact with our data. However, the computational intensity and memory consumption of deploying these models present substantial challenges in terms of serving efficiency, particularly in scenarios demanding low latency and high throughput. This survey addresses the imperative need for efficient LLM serving methodologies from a machine learning system (MLSys) research perspective, standing at the crux of advanced AI innovations and practical system optimizations. We provide in-depth analysis, covering a spectrum of solutions, ranging from cutting-edge algorithmic modifications to groundbreaking changes in system designs. The survey aims to provide a comprehensive understanding of the current state and future directions in efficient LLM serving, offering valuable insights for researchers and practitioners in overcoming the barriers of effective LLM deployment, thereby reshaping the future of AI.


title: MASTER: Market-Guided Stock Transformer for Stock Price Forecasting

abstract: Stock price forecasting has remained an extremely challenging problem for many decades due to the high volatility of the stock market. Recent efforts have been devoted to modeling complex stock correlations toward joint stock price forecasting. Existing works share a common neural architecture that learns temporal patterns from individual stock series and then mixes up temporal representations to establish stock correlations. However, they only consider time-aligned stock correlations stemming from all the input stock features, which suffer from two limitations. First, stock correlations often occur momentarily and in a cross-time manner. Second, the feature effectiveness is dynamic with market variation, which affects both the stock sequential patterns and their correlations. To address the limitations, this paper introduces MASTER, a MArkert-Guided Stock TransformER, which models the momentary and cross-time stock correlation and leverages market information for automatic feature selection. MASTER elegantly tackles the complex stock correlation by alternatively engaging in intra-stock and inter-stock information aggregation. Experiments show the superiority of MASTER compared with previous works and visualize the captured realistic stock correlation to provide valuable insights.


title: Classifying Soccer Ball-on-Goal Position Through Kicker Shooting Action

abstract: This research addresses whether the ball's direction after a soccer free-kick can be accurately predicted solely by observing the shooter's kicking technique. To investigate this, we meticulously curated a dataset of soccer players executing free kicks and conducted manual temporal segmentation to identify the moment of the kick precisely. Our approach involves utilizing neural networks to develop a model that integrates Human Action Recognition (HAR) embeddings with contextual information, predicting the ball-on-goal position (BoGP) based on two temporal states: the kicker's run-up and the instant of the kick. The study encompasses a performance evaluation for eleven distinct HAR backbones, shedding light on their effectiveness in BoGP estimation during free-kick situations. An extra tabular metadata input is introduced, leading to an interesting model enhancement without introducing bias. The promising results reveal 69.1% accuracy when considering two primary BoGP classes: right and left. This underscores the model's proficiency in predicting the ball's destination towards the goal with high accuracy, offering promising implications for understanding free-kick dynamics in soccer.


title: Towards Fine-Grained Explainability for Heterogeneous Graph Neural Network

abstract: Heterogeneous graph neural networks (HGNs) are prominent approaches to node classification tasks on heterogeneous graphs. Despite the superior performance, insights about the predictions made from HGNs are obscure to humans. Existing explainability techniques are mainly proposed for GNNs on homogeneous graphs. They focus on highlighting salient graph objects to the predictions whereas the problem of how these objects affect the predictions remains unsolved. Given heterogeneous graphs with complex structures and rich semantics, it is imperative that salient objects can be accompanied with their influence paths to the predictions, unveiling the reasoning process of HGNs. In this paper, we develop xPath, a new framework that provides fine-grained explanations for black-box HGNs specifying a cause node with its influence path to the target node. In xPath, we differentiate the influence of a node on the prediction w.r.t. every individual influence path, and measure the influence by perturbing graph structure via a novel graph rewiring algorithm. Furthermore, we introduce a greedy search algorithm to find the most influential fine-grained explanations efficiently. Empirical results on various HGNs and heterogeneous graphs show that xPath yields faithful explanations efficiently, outperforming the adaptations of advanced GNN explanation approaches.


title: NoPose-NeuS: Jointly Optimizing Camera Poses with Neural Implicit Surfaces for Multi-view Reconstruction

abstract: Learning neural implicit surfaces from volume rendering has become popular for multi-view reconstruction. Neural surface reconstruction approaches can recover complex 3D geometry that are difficult for classical Multi-view Stereo (MVS) approaches, such as non-Lambertian surfaces and thin structures. However, one key assumption for these methods is knowing accurate camera parameters for the input multi-view images, which are not always available. In this paper, we present NoPose-NeuS, a neural implicit surface reconstruction method that extends NeuS to jointly optimize camera poses with the geometry and color networks. We encode the camera poses as a multi-layer perceptron (MLP) and introduce two additional losses, which are multi-view feature consistency and rendered depth losses, to constrain the learned geometry for better estimated camera poses and scene surfaces. Extensive experiments on the DTU dataset show that the proposed method can estimate relatively accurate camera poses, while maintaining a high surface reconstruction quality with 0.89 mean Chamfer distance.


title: QoE modeling for Voice over IP: Simplified E-model Enhancement Utilizing the Subjective MOS Prediction Model

abstract: This research proposes an enhanced measurement method for VoIP quality assessment which provides an improvement to accuracy and reliability. To improve the objective measurement tool called the simplified E-model for the selected codec, G.729, it has been enhanced by utilizing a subjective MOS prediction model based on native Thai users, who use the Thai-tonal language. Then, the different results from the simplified E-model and subjective MOS prediction model were used to create the Bias function, before adding to the simplified E-model. Finally, it has been found that the outputs from the enhanced simplified E-model for the G.729 codec shows better accuracy when compared to the original simplified E-model, specially, after the enhanced model has been evaluated with 4 test sets. The major contribution of this enhancement is that errors are reduced by 58.87 % when compared to the generic simplified E-model. That means the enhanced simplified E-model as proposed in this study can provide improvement beyond the original simplified one significantly.


title: Axion-pion scattering at finite temperature in chiral perturbation theory and its influence in axion thermalization

abstract: Axion-pion scattering amplitudes at finite temperatures are calculated within chiral perturbation theory up to the one loop level. Unitarization procedure is implemented to these amplitudes in order to extend the applicable range of energy and temperature. The influence of the thermal axion-pion scattering amplitudes on the $a\pi\to\pi\pi$ cross sections and the axion thermalization rate is investigated, with the emphasis on the comparison with the zero-temperature-amplitude case. A brief discussion on the cosmological implication of the axion thermalization rate, that is calculated by using the $a\pi\to\pi\pi$ amplitudes at finite temperatures, is also given. The thermal corrections to the axion-pion scattering amplitudes can cause around a $10\%$ shift of the determination of the axion decay constant $f_a$ and its mass $m_a$, comparing with the results by using the $a\pi\to\pi\pi$ amplitudes at zero temperature.


title: Measuring Value Alignment

abstract: As artificial intelligence (AI) systems become increasingly integrated into various domains, ensuring that they align with human values becomes critical. This paper introduces a novel formalism to quantify the alignment between AI systems and human values, using Markov Decision Processes (MDPs) as the foundational model. We delve into the concept of values as desirable goals tied to actions and norms as behavioral guidelines, aiming to shed light on how they can be used to guide AI decisions. This framework offers a mechanism to evaluate the degree of alignment between norms and values by assessing preference changes across state transitions in a normative world. By utilizing this formalism, AI developers and ethicists can better design and evaluate AI systems to ensure they operate in harmony with human values. The proposed methodology holds potential for a wide range of applications, from recommendation systems emphasizing well-being to autonomous vehicles prioritizing safety.


title: CaLDiff: Camera Localization in NeRF via Pose Diffusion

abstract: With the widespread use of NeRF-based implicit 3D representation, the need for camera localization in the same representation becomes manifestly apparent. Doing so not only simplifies the localization process -- by avoiding an outside-the-NeRF-based localization -- but also has the potential to offer the benefit of enhanced localization. This paper studies the problem of localizing cameras in NeRF using a diffusion model for camera pose adjustment. More specifically, given a pre-trained NeRF model, we train a diffusion model that iteratively updates randomly initialized camera poses, conditioned upon the image to be localized. At test time, a new camera is localized in two steps: first, coarse localization using the proposed pose diffusion process, followed by local refinement steps of a pose inversion process in NeRF. In fact, the proposed camera localization by pose diffusion (CaLDiff) method also integrates the pose inversion steps within the diffusion process. Such integration offers significantly better localization, thanks to our downstream refinement-aware diffusion process. Our exhaustive experiments on challenging real-world data validate our method by providing significantly better results than the compared methods and the established baselines. Our source code will be made publicly available.


title: Thermodynamic uncertainty relations in the presence of non-linear friction and memory

abstract: A new Thermodynamic Uncertainty Relation (TUR) is derived for systems described by linearly coupled Langevin equations in the presence of non-linear frictional forces. In our scheme, the main variable represents the velocity of a particle, while the other coupled variables describe memory effects which may arise from strongly correlated degrees of freedom with several time-scales and, in general, are associated with thermal baths at different temperatures. The new TUR gives a lower bound for the mean-squared displacement of the position of the particle, including its asymptotic diffusion coefficient. This bound, in several examples worked out here, appears to be a good analytical estimate of the real diffusion coefficient. The new TUR can be also applied in the absence of any external force (with or without thermal equilibrium between the baths), a case which usually goes beyond the scope of original TURs. We show applications to non-linear frictional models with memory, such as the Coulomb and the Prantdtl-Tomlinson models, usually representative of friction at the nano-scale and within atomic-force microscopy experiments.


title: Fluid Antenna Array Enhanced Over-the-Air Computation

abstract: Over-the-air computation (AirComp) has emerged as a promising technology for fast wireless data aggregation by harnessing the superposition property of wireless multiple-access channels. This paper investigates a fluid antenna (FA) array-enhanced AirComp system, employing the new degrees of freedom achieved by antenna movements. Specifically, we jointly optimize the transceiver design and antenna position vector (APV) to minimize the mean squared error (MSE) between target and estimated function values. To tackle the resulting highly non-convex problem, we adopt an alternating optimization technique to decompose it into three subproblems. These subproblems are then iteratively solved until convergence, leading to a locally optimal solution. Numerical results show that FA arrays with the proposed transceiver and APV design significantly outperform the traditional fixed-position antenna arrays in terms of MSE.


title: Resonant Inductive Coupling Network for Human-Sized Magnetic Particle Imaging

abstract: In Magnetic Particle Imaging, a field-free region is maneuvered throughout the field of view using a time-varying magnetic field known as the drive-field. Human-sized systems operate the drive-field in the kHz range and generate it by utilizing strong currents that can rise to the kA range within a coil called the drive field generator. Matching and tuning between a power amplifier, a band-pass filter and the drive-field generator is required. Here, for reasons of safety in future human scanners, a symmetrical topology and a transformer, called inductive coupling network is used. Our primary objectives are to achieve floating potentials to ensure patient safety, attaining high linearity and high gain for the resonant transformer. We present a novel systematic approach to the design of a loss-optimized resonant toroid with a D-shaped cross section, employing segmentation to adjust the inductance-to-resistance ratio while maintaining a constant quality factor. Simultaneously, we derive a specific matching condition of a symmetric transmit-receive circuit for magnetic particle imaging. The chosen setup filters the fundamental frequency and allows simultaneous signal transmission and reception. In addition, the decoupling of multiple drive field channels is discussed and the primary side of the transformer is evaluated for maximum coupling and minimum stray field. Two prototypes were constructed, measured, decoupled, and compared to the derived theory and to method-of-moment based simulations.


title: A Theory of Non-Acyclic Generative Flow Networks

abstract: GFlowNets is a novel flow-based method for learning a stochastic policy to generate objects via a sequence of actions and with probability proportional to a given positive reward. We contribute to relaxing hypotheses limiting the application range of GFlowNets, in particular: acyclicity (or lack thereof). To this end, we extend the theory of GFlowNets on measurable spaces which includes continuous state spaces without cycle restrictions, and provide a generalization of cycles in this generalized context. We show that losses used so far push flows to get stuck into cycles and we define a family of losses solving this issue. Experiments on graphs and continuous tasks validate those principles.


title: Prompt-Propose-Verify: A Reliable Hand-Object-Interaction Data Generation Framework using Foundational Models

abstract: Diffusion models when conditioned on text prompts, generate realistic-looking images with intricate details. But most of these pre-trained models fail to generate accurate images when it comes to human features like hands, teeth, etc. We hypothesize that this inability of diffusion models can be overcome through well-annotated good-quality data. In this paper, we look specifically into improving the hand-object-interaction image generation using diffusion models. We collect a well annotated hand-object interaction synthetic dataset curated using Prompt-Propose-Verify framework and finetune a stable diffusion model on it. We evaluate the image-text dataset on qualitative and quantitative metrics like CLIPScore, ImageReward, Fedility, and alignment and show considerably better performance over the current state-of-the-art benchmarks.


title: Type-II Apollonian Model

abstract: The family of planar graphs is a particularly important family and models many real-world networks. In this paper, we propose a principled framework based on the widely-known Apollonian packing process to generate new planar network, i.e., Type-II Apollonian network $\mathcal{A}_{t}$. The manipulation is different from that of the typical Apollonian network, and is proceeded in terms of the iterative addition of triangle instead of vertex. As a consequence, network $\mathcal{A}_{t}$ turns out to be hamiltonian and eulerian, however, the typical Apollonian network is not. Then, we in-depth study some fundamental structural properties on network $\mathcal{A}_{t}$, and verify that network $\mathcal{A}_{t}$ is sparse like most real-world networks, has scale-free feature and small-world property, and exhibits disassortative mixing structure. Next, we design an effective algorithm for solving the problem of how to enumerate spanning trees on network $\mathcal{A}_{t}$, and derive the asymptotic solution of the spanning tree entropy, which suggests that Type-II Apollonian network is more reliable to a random removal of edges than the typical Apollonian network. Additionally, we study trapping problem on network $\mathcal{A}_{t}$, and use average trapping time as metric to show that Type-II Apollonian network $\mathcal{A}_{t}$ has better structure for fast information diffusion than the typical Apollonian network.


title: QoE Modeling Associated with QoS Impairment Parameters in 5G Networks

abstract: This paper aims to propose the quality of experience (QoE) models based on the expectation and/or the perception of 5G users to evaluate for mean opinion score (MOS) for real-time or interactive services/applications with high reliability. Therefore, Based on the fundamental QoE concept, the analytic hierarchy process (AHP) decision making technique has been applied.


title: A Security Enhanced Authentication Protocol

abstract: Internet of Things (IoT) have gained popularity in recent times. With an increase in the number of IoT devices, security and privacy vulnerabilities are also increasing. For sensitive domains like healthcare and industrial sectors, such vulnerabilities can cause havoc. Thus, authentication is an important aspect for establishing a secure communication between various participants. In this paper, we study the two recent authentication and key exchange protocols. We prove that these protocols are vulnerable to replay attack and modification attack, and also suffer from technical correctness. We then present the possible improvements to overcome the discussed vulnerabilities. The enhancement preserves performance of the original protocols.


title: A forced Boussinesq model with a sponge layer

abstract: The movement of water waves is a topic of interest to researchers from different areas. While their propagation is described by Euler equations, there are instances where simplified models can also provide accurate approximations. A well-known reduced model employed to study the wave dynamics is the Boussinesq model. Despite being extensively studied, to our knowledge, there is no research available on a Boussinesq model featuring a sponge layer. Therefore, in this work, we present a Boussinesq model with a sponge layer. Furthermore, we carry out a numerical investigation to explore the advantages and limitations of the proposed model. For this purpose, we compare the numerical solutions of the model with and without the sponge in three different scenarios. The numerical solutions are computed by a pseudospectral method. Our results show that the Boussinesq model with a sponge layer is numerically stable and advantageous because it is able to absorb low-amplitude waves, allowing it to run the numerical simulations for long periods of time without requiring a large spatial domain, but it is not able to absorb high-amplitude waves.


title: DTIAM: A unified framework for predicting drug-target interactions, binding affinities and activation/inhibition mechanisms

abstract: Accurate and robust prediction of drug-target interactions (DTIs) plays a vital role in drug discovery. Despite extensive efforts have been invested in predicting novel DTIs, existing approaches still suffer from insufficient labeled data and cold start problems. More importantly, there is currently a lack of studies focusing on elucidating the mechanism of action (MoA) between drugs and targets. Distinguishing the activation and inhibition mechanisms is critical and challenging in drug development. Here, we introduce a unified framework called DTIAM, which aims to predict interactions, binding affinities, and activation/inhibition mechanisms between drugs and targets. DTIAM learns drug and target representations from large amounts of label-free data through self-supervised pre-training, which accurately extracts the substructure and contextual information of drugs and targets, and thus benefits the downstream prediction based on these representations. DTIAM achieves substantial performance improvement over other state-of-the-art methods in all tasks, particularly in the cold start scenario. Moreover, independent validation demonstrates the strong generalization ability of DTIAM. All these results suggested that DTIAM can provide a practically useful tool for predicting novel DTIs and further distinguishing the MoA of candidate drugs. DTIAM, for the first time, provides a unified framework for accurate and robust prediction of drug-target interactions, binding affinities, and activation/inhibition mechanisms.


title: Efficient Deformable Tissue Reconstruction via Orthogonal Neural Plane

abstract: Intraoperative imaging techniques for reconstructing deformable tissues in vivo are pivotal for advanced surgical systems. Existing methods either compromise on rendering quality or are excessively computationally intensive, often demanding dozens of hours to perform, which significantly hinders their practical application. In this paper, we introduce Fast Orthogonal Plane (Forplane), a novel, efficient framework based on neural radiance fields (NeRF) for the reconstruction of deformable tissues. We conceptualize surgical procedures as 4D volumes, and break them down into static and dynamic fields comprised of orthogonal neural planes. This factorization iscretizes the four-dimensional space, leading to a decreased memory usage and faster optimization. A spatiotemporal importance sampling scheme is introduced to improve performance in regions with tool occlusion as well as large motions and accelerate training. An efficient ray marching method is applied to skip sampling among empty regions, significantly improving inference speed. Forplane accommodates both binocular and monocular endoscopy videos, demonstrating its extensive applicability and flexibility. Our experiments, carried out on two in vivo datasets, the EndoNeRF and Hamlyn datasets, demonstrate the effectiveness of our framework. In all cases, Forplane substantially accelerates both the optimization process (by over 100 times) and the inference process (by over 15 times) while maintaining or even improving the quality across a variety of non-rigid deformations. This significant performance improvement promises to be a valuable asset for future intraoperative surgical applications. The code of our project is now available at https://github.com/Loping151/ForPlane.