title: Transfer learning-based physics-informed convolutional neural network for simulating flow in porous media with time-varying controls

abstract: A physics-informed convolutional neural network is proposed to simulate two phase flow in porous media with time-varying well controls. While most of PICNNs in existing literatures worked on parameter-to-state mapping, our proposed network parameterizes the solution with time-varying controls to establish a control-to-state regression. Firstly, finite volume scheme is adopted to discretize flow equations and formulate loss function that respects mass conservation laws. Neumann boundary conditions are seamlessly incorporated into the semi-discretized equations so no additional loss term is needed. The network architecture comprises two parallel U-Net structures, with network inputs being well controls and outputs being the system states. To capture the time-dependent relationship between inputs and outputs, the network is well designed to mimic discretized state space equations. We train the network progressively for every timestep, enabling it to simultaneously predict oil pressure and water saturation at each timestep. After training the network for one timestep, we leverage transfer learning techniques to expedite the training process for subsequent timestep. The proposed model is used to simulate oil-water porous flow scenarios with varying reservoir gridblocks and aspects including computation efficiency and accuracy are compared against corresponding numerical approaches. The results underscore the potential of PICNN in effectively simulating systems with numerous grid blocks, as computation time does not scale with model dimensionality. We assess the temporal error using 10 different testing controls with variation in magnitude and another 10 with higher alternation frequency with proposed control-to-state architecture. Our observations suggest the need for a more robust and reliable model when dealing with controls that exhibit significant variations in magnitude or frequency.


title: Automatic Generation of Test Cases based on Bug Reports: a Feasibility Study with Large Language Models

abstract: Software testing is a core discipline in software engineering where a large array of research results has been produced, notably in the area of automatic test generation. Because existing approaches produce test cases that either can be qualified as simple (e.g. unit tests) or that require precise specifications, most testing procedures still rely on test cases written by humans to form test suites. Such test suites, however, are incomplete: they only cover parts of the project or they are produced after the bug is fixed. Yet, several research challenges, such as automatic program repair, and practitioner processes, build on the assumption that available test suites are sufficient. There is thus a need to break existing barriers in automatic test case generation. While prior work largely focused on random unit testing inputs, we propose to consider generating test cases that realistically represent complex user execution scenarios, which reveal buggy behaviour. Such scenarios are informally described in bug reports, which should therefore be considered as natural inputs for specifying bug-triggering test cases. In this work, we investigate the feasibility of performing this generation by leveraging large language models (LLMs) and using bug reports as inputs. Our experiments include the use of ChatGPT, as an online service, as well as CodeGPT, a code-related pre-trained LLM that was fine-tuned for our task. Overall, we experimentally show that bug reports associated to up to 50% of Defects4J bugs can prompt ChatGPT to generate an executable test case. We show that even new bug reports can indeed be used as input for generating executable test cases. Finally, we report experimental results which confirm that LLM-generated test cases are immediately useful in software engineering tasks such as fault localization as well as patch validation in automated program repair.


title: Calibrating approximate Bayesian credible intervals of gravitational-wave parameters

abstract: Approximations are commonly employed in realistic applications of scientific Bayesian inference, often due to convenience if not necessity. In the field of gravitational-wave (GW) data analysis, fast-to-evaluate but approximate waveform models of astrophysical GW signals are sometimes used in lieu of more accurate models to infer properties of a true GW signal buried within detector noise. In addition, a Fisher-information-based normal approximation to the posterior distribution can also be used to conduct inference in bulk, without the need for extensive numerical calculations such as Markov chain Monte Carlo (MCMC) simulations. Such approximations can generally lead to an inaccurate posterior distribution with poor statistical coverage of the true posterior. In this article, we present a novel calibration procedure that calibrates the credible sets for a family of approximate posterior distributions, to ensure coverage of the true posterior at a level specified by the analyst. Tools such as autoencoders and artificial neural networks are used within our calibration model to compress the data (for efficiency) and to perform tasks such as logistic regression. As a proof of principle, we demonstrate our formalism on the GW signal from a high-mass binary black hole merger, a promising source for the near-future space-based GW observatory LISA.


title: Predicting Three Types of Freezing of Gait Events Using Deep Learning Models

abstract: Freezing of gait is a Parkinson's Disease symptom that episodically inflicts a patient with the inability to step or turn while walking. While medical experts have discovered various triggers and alleviating actions for freezing of gait, the underlying causes and prediction models are still being explored today. Current freezing of gait prediction models that utilize machine learning achieve high sensitivity and specificity in freezing of gait predictions based on time-series data; however, these models lack specifications on the type of freezing of gait events. We develop various deep learning models using the transformer encoder architecture plus Bidirectional LSTM layers and different feature sets to predict the three different types of freezing of gait events. The best performing model achieves a score of 0.427 on testing data, which would rank top 5 in Kaggle's Freezing of Gait prediction competition, hosted by THE MICHAEL J. FOX FOUNDATION. However, we also recognize overfitting in training data that could be potentially improved through pseudo labelling on additional data and model architecture simplification.


title: Neural ring homomorphism preserves mandatory sets required for open convexity

abstract: It has been studied by Curto et al. (SIAM J. on App. Alg. and Geom., 1(1) : 222 $\unicode{x2013}$ 238, 2017) that a neural code that has an open convex realization does not have any local obstruction relative to the neural code. Further, a neural code $ \mathcal{C} $ has no local obstructions if and only if it contains the set of mandatory codewords, $ \mathcal{C}_{\min}(\Delta),$ which depends only on the simplicial complex $\Delta=\Delta(\mathcal{C})$. Thus if $\mathcal{C} \not \supseteq \mathcal{C}_{\min}(\Delta)$, then $\mathcal{C}$ cannot be open convex. However, the problem of constructing $ \mathcal{C}_{\min}(\Delta) $ for any given code $ \mathcal{C} $ is undecidable. There is yet another way to capture the local obstructions via the homological mandatory set, $ \mathcal{M}_H(\Delta). $ The significance of $ \mathcal{M}_H(\Delta) $ for a given code $ \mathcal{C} $ is that $ \mathcal{M}_H(\Delta) \subseteq \mathcal{C}_{\min}(\Delta)$ and so $ \mathcal{C} $ will have local obstructions if $ \mathcal{C}\not\supseteq\mathcal{M}_H(\Delta). $ In this paper we study the affect on the sets $\mathcal{C}_{\min}(\Delta) $ and $\mathcal{M}_H(\Delta)$ under the action of various surjective elementary code maps. Further, we study the relationship between Stanley-Reisner rings of the simplicial complexes associated with neural codes of the elementary code maps. Moreover, using this relationship, we give an alternative proof to show that $ \mathcal{M}_H(\Delta) $ is preserved under the elementary code maps.


title: On the density at infinity of definable functions

abstract: In this paper, we give a simple proof that the density at infinity of fibers of a definable function is locally Lipschitz outside the set of asymptotic critical values.


title: Long-time behavior for the Kirchhoff diffusion problem with magnetic fractional Laplace operator

abstract: We consider a Kirchhoff-type diffusion problem driven by the magnetic fractional Laplace operator. The main result in this paper establishes that infinite time blow-up cannot occur for the problem. The proof is based on the potential well method, in relationship with energy and Nehari functionals.


title: I2SRM: Intra- and Inter-Sample Relationship Modeling for Multimodal Information Extraction

abstract: Multimodal information extraction is attracting research attention nowadays, which requires aggregating representations from different modalities. In this paper, we present the Intra- and Inter-Sample Relationship Modeling (I2SRM) method for this task, which contains two modules. Firstly, the intra-sample relationship modeling module operates on a single sample and aims to learn effective representations. Embeddings from textual and visual modalities are shifted to bridge the modality gap caused by distinct pre-trained language and image models. Secondly, the inter-sample relationship modeling module considers relationships among multiple samples and focuses on capturing the interactions. An AttnMixup strategy is proposed, which not only enables collaboration among samples but also augments data to improve generalization. We conduct extensive experiments on the multimodal named entity recognition datasets Twitter-2015 and Twitter-2017, and the multimodal relation extraction dataset MNRE. Our proposed method I2SRM achieves competitive results, 77.12% F1-score on Twitter-2015, 88.40% F1-score on Twitter-2017, and 84.12% F1-score on MNRE.


title: Improved iron-tolerance in recycled aluminum alloys via direct strip casting process

abstract: Recycled aluminum alloys are pivotal for sustainable manufacturing, offering strength, durability, and environmental advantages. However, the presence of iron (Fe) impurities poses a major challenge, undermining their properties and recyclability. Conventional manufacturing processes result in coarse Fe-rich intermetallic compounds that limit the tolerance of Fe content and negatively influence performance of advanced aluminum alloys. To address this, rapid solidification techniques like direct strip casting have been explored. In this work, a detailed study of the strip cast microstructure was conducted by scanning electron microscopy, electron backscattered diffraction and atom probe tomography. Our results reveal that alloys produced by DSC exhibit significantly refined microstructures and are free from coarse Fe-rich intermetallics, thereby retaining the majority of Fe in solid solution. These findings indicate that strip casting significantly enhances Fe-tolerance in aluminum alloys, making it an attractive process for future aluminum recycling, with implications for sustainable high-performance applications.


title: Antenna Response Consistency Driven Self-supervised Learning for WIFI-based Human Activity Recognition

abstract: Self-supervised learning (SSL) for WiFi-based human activity recognition (HAR) holds great promise due to its ability to address the challenge of insufficient labeled data. However, directly transplanting SSL algorithms, especially contrastive learning, originally designed for other domains to CSI data, often fails to achieve the expected performance. We attribute this issue to the inappropriate alignment criteria, which disrupt the semantic distance consistency between the feature space and the input space. To address this challenge, we introduce \textbf{A}ntenna \textbf{R}esponse \textbf{C}onsistency (ARC) as a solution to define proper alignment criteria. ARC is designed to retain semantic information from the input space while introducing robustness to real-world noise. Moreover, we substantiate the effectiveness of ARC through a comprehensive set of experiments, demonstrating its capability to enhance the performance of self-supervised learning for WiFi-based HAR by achieving an increase of over 5\% in accuracy in most cases and achieving a best accuracy of 94.97\%.


title: Precise Payload Delivery via Unmanned Aerial Vehicles: An Approach Using Object Detection Algorithms

abstract: Recent years have seen tremendous advancements in the area of autonomous payload delivery via unmanned aerial vehicles, or drones. However, most of these works involve delivering the payload at a predetermined location using its GPS coordinates. By relying on GPS coordinates for navigation, the precision of payload delivery is restricted to the accuracy of the GPS network and the availability and strength of the GPS connection, which may be severely restricted by the weather condition at the time and place of operation. In this work we describe the development of a micro-class UAV and propose a novel navigation method that improves the accuracy of conventional navigation methods by incorporating a deep-learning-based computer vision approach to identify and precisely align the UAV with a target marked at the payload delivery position. This proposed method achieves a 500% increase in average horizontal precision over conventional GPS-based approaches.


title: Multivariate moment least-squares estimators for reversible Markov chains

abstract: Markov chain Monte Carlo (MCMC) is a commonly used method for approximating expectations with respect to probability distributions. Uncertainty assessment for MCMC estimators is essential in practical applications. Moreover, for multivariate functions of a Markov chain, it is important to estimate not only the auto-correlation for each component but also to estimate cross-correlations, in order to better assess sample quality, improve estimates of effective sample size, and use more effective stopping rules. Berg and Song [2022] introduced the moment least squares (momentLS) estimator, a shape-constrained estimator for the autocovariance sequence from a reversible Markov chain, for univariate functions of the Markov chain. Based on this sequence estimator, they proposed an estimator of the asymptotic variance of the sample mean from MCMC samples. In this study, we propose novel autocovariance sequence and asymptotic variance estimators for Markov chain functions with multiple components, based on the univariate momentLS estimators from Berg and Song [2022]. We demonstrate strong consistency of the proposed auto(cross)-covariance sequence and asymptotic variance matrix estimators. We conduct empirical comparisons of our method with other state-of-the-art approaches on simulated and real-data examples, using popular samplers including the random-walk Metropolis sampler and the No-U-Turn sampler from STAN.


title: Geometry of spectral bounds of curves of unitary operators

abstract: This article presents a new proof of a theorem concerning bounds of the spectrum of the product of unitary operators and a generalization for differentiable curves of this theorem. The proofs involve metric geometric arguments in the group of unitary operators and the sphere where these operators act.


title: CrowdRec: 3D Crowd Reconstruction from Single Color Images

abstract: This is a technical report for the GigaCrowd challenge. Reconstructing 3D crowds from monocular images is a challenging problem due to mutual occlusions, server depth ambiguity, and complex spatial distribution. Since no large-scale 3D crowd dataset can be used to train a robust model, the current multi-person mesh recovery methods can hardly achieve satisfactory performance in crowded scenes. In this paper, we exploit the crowd features and propose a crowd-constrained optimization to improve the common single-person method on crowd images. To avoid scale variations, we first detect human bounding-boxes and 2D poses from the original images with off-the-shelf detectors. Then, we train a single-person mesh recovery network using existing in-the-wild image datasets. To promote a more reasonable spatial distribution, we further propose a crowd constraint to refine the single-person network parameters. With the optimization, we can obtain accurate body poses and shapes with reasonable absolute positions from a large-scale crowd image using a single-person backbone. The code will be publicly available at~\url{https://github.com/boycehbz/CrowdRec}.


title: Learning bounded-degree polytrees with known skeleton

abstract: We establish finite-sample guarantees for efficient proper learning of bounded-degree polytrees, a rich class of high-dimensional probability distributions and a subclass of Bayesian networks, a widely-studied type of graphical model. Recently, Bhattacharyya et al. (2021) obtained finite-sample guarantees for recovering tree-structured Bayesian networks, i.e., 1-polytrees. We extend their results by providing an efficient algorithm which learns $d$-polytrees in polynomial time and sample complexity for any bounded $d$ when the underlying undirected graph (skeleton) is known. We complement our algorithm with an information-theoretic sample complexity lower bound, showing that the dependence on the dimension and target accuracy parameters are nearly tight.

categories: cs.LG cs.DS math.PR math.ST stat.ML stat.TH


title: Improved charge storage capacity of supercapacitor electrodes by engineering surfaces: the case of Janus MXenes

abstract: Surface Engineering in two-dimensional(2D) materials has turned out to be an useful technique to improve their functional properties. By designing Janus compounds MM$^{\prime}$C in MXene family of compounds M$_{2}$C where the two surfaces are constituted by two different transition metal M and M$^{\prime}$, we have explored their potentials as electrodes in a supercapacitor with acidic electrolyte. Using Density functional Theory (DFT) \cite{dft} in conjunction with classical solvation model we have made an in depth analysis of the electrochemical parameters of three Janus MXenes, passivated by oxygen - NbVC, MnVC and CrMnC. Comparisons with the corresponding end point MXenes Nb$_{2}$C, V$_{2}$C, Mn$_{2}$C and Cr$_{2}$C are also made. We find that the surface redox activity enhances due to formation of Janus, improving the charge storage capacities of MXene electrodes significantly. Our analysis reveals that the improved functionality has its root in the variations in the charge state of one of the constituents in the Janus compound which, in turn, has its origin in the electronic structure changes due to the surface manipulation. Our work, which is the first on the electrochemical properties of Janus MXenes for supercapacitor applications, suggests the surface engineering by forming appropriate Janus compounds as a possible route to extract high power density in a MXene electrode-acidic electrolyte based energy storage devices.


title: BBCA-CHAIN: Low Latency, High Throughput BFT Consensus on a DAG

abstract: This paper presents a partially synchronous BFT consensus protocol powered by BBCA, a lightly modified Byzantine Consistent Broadcast (BCB) primitive. BBCA provides a Complete-Adopt semantic through an added probing interface to allow either aborting the broadcast by correct nodes or exclusively, adopting the message consistently in case of a potential delivery. It does not introduce any extra types of messages or additional communication costs to BCB. BBCA is harnessed into BBCA-CHAIN to make direct commits on a chained backbone of a causally ordered graph of blocks, without any additional voting blocks or artificial layering. With the help of Complete-Adopt, the additional knowledge gained from the underlying BCB completely removes the voting latency in popular DAG-based protocols. At the same time, causal ordering allows nodes to propose blocks in parallel and achieve high throughput. BBCA-CHAIN thus closes up the gap between protocols built by consistent broadcasts (e.g., Bullshark) to those without such an abstraction (e.g., PBFT/HotStuff), emphasizing their shared fundamental principles. Using a Bracha-style BCB as an example, we fully specify BBCA-CHAIN with simplicity, serving as a solid basis for high-performance replication systems (and blockchains).


title: HoloFed: Environment-Adaptive Positioning via Multi-band Reconfigurable Holographic Surfaces and Federated Learning

abstract: Positioning is an essential service for various applications and is expected to be integrated with existing communication infrastructures in 5G and 6G. Though current Wi-Fi and cellular base stations (BSs) can be used to support this integration, the resulting precision is unsatisfactory due to the lack of precise control of the wireless signals. Recently, BSs adopting reconfigurable holographic surfaces (RHSs) have been advocated for positioning as RHSs' large number of antenna elements enable generation of arbitrary and highly-focused signal beam patterns. However, existing designs face two major challenges: i) RHSs only have limited operating bandwidth, and ii) the positioning methods cannot adapt to the diverse environments encountered in practice. To overcome these challenges, we present HoloFed, a system providing high-precision environment-adaptive user positioning services by exploiting multi-band(MB)-RHS and federated learning (FL). For improving the positioning performance, a lower bound on the error variance is obtained and utilized for guiding MB-RHS's digital and analog beamforming design. For better adaptability while preserving privacy, an FL framework is proposed for users to collaboratively train a position estimator, where we exploit the transfer learning technique to handle the lack of position labels of the users. Moreover, a scheduling algorithm for the BS to select which users train the position estimator is designed, jointly considering the convergence and efficiency of FL. Our simulation results confirm that HoloFed achieves a 57% lower positioning error variance compared to a beam-scanning baseline and can effectively adapt to diverse environments.


title: Local Style Awareness of Font Images

abstract: When we compare fonts, we often pay attention to styles of local parts, such as serifs and curvatures. This paper proposes an attention mechanism to find important local parts. The local parts with larger attention are then considered important. The proposed mechanism can be trained in a quasi-self-supervised manner that requires no manual annotation other than knowing that a set of character images is from the same font, such as Helvetica. After confirming that the trained attention mechanism can find style-relevant local parts, we utilize the resulting attention for local style-aware font generation. Specifically, we design a new reconstruction loss function to put more weight on the local parts with larger attention for generating character images with more accurate style realization. This loss function has the merit of applicability to various font generation models. Our experimental results show that the proposed loss function improves the quality of generated character images by several few-shot font generation models.


title: Better Safe than Sorry: Recovering after Adversarial Majority

abstract: The security of blockchain protocols is a combination of two properties: safety and liveness. It is well known that no blockchain protocol can provide both to sleepy (intermittently online) clients under adversarial majority. However, safety is more critical in that a single safety violation can cause users to lose money. At the same time, liveness must not be lost forever. We show that, in a synchronous network, it is possible to maintain safety for all clients even during adversarial majority, and recover liveness after honest majority is restored. Our solution takes the form of a recovery gadget that can be applied to any protocol with certificates (such as HotStuff, Streamlet, Tendermint, and their variants).


title: Automatic nodule identification and differentiation in ultrasound videos to facilitate per-nodule examination

abstract: Ultrasound is a vital diagnostic technique in health screening, with the advantages of non-invasive, cost-effective, and radiation free, and therefore is widely applied in the diagnosis of nodules. However, it relies heavily on the expertise and clinical experience of the sonographer. In ultrasound images, a single nodule might present heterogeneous appearances in different cross-sectional views which makes it hard to perform per-nodule examination. Sonographers usually discriminate different nodules by examining the nodule features and the surrounding structures like gland and duct, which is cumbersome and time-consuming. To address this problem, we collected hundreds of breast ultrasound videos and built a nodule reidentification system that consists of two parts: an extractor based on the deep learning model that can extract feature vectors from the input video clips and a real-time clustering algorithm that automatically groups feature vectors by nodules. The system obtains satisfactory results and exhibits the capability to differentiate ultrasound videos. As far as we know, it's the first attempt to apply re-identification technique in the ultrasonic field.


title: Differential graded orders, their class groups and id\`eles

abstract: For a Dedekind domain $R$ with field of fractions $K$ a classical $R$-order in a semisimple $K$-algebra $A$ is an $R$-projective $R$-subalgebra $\Lambda$ of $A$ such that $K\Lambda=A$. We study differential graded $K$-algebras which are semisimple as $K$-algebras and define differential graded $R$-orders as a differential graded $R$-subalgebras, which are in addition classical $R$-orders in $A$. We give a series of examples for such differential graded algebras and orders. We show that any differential graded $R$-order is contained in a maximal differential graded order. We develop parts of the classical ring theory in the differential graded setting, in particular the properties of analogues of the Jacobson radical. We further define class groups of differential graded orders as subgroups of the Grothendieck group of locally free differential graded modules. We define id\`eles in this setting showing that these id\`ele groups are isomorphic to the differential graded class group. Finally we give a homomorphism to the class group of the homology of the differential graded order and prove a Mayer-Vietoris like sequence for each central idempotent of $A$, including the analogous one for the kernel groups of these morphisms.


title: Federated Learning with Reduced Information Leakage and Computation

abstract: Federated learning (FL) is a distributed learning paradigm that allows multiple decentralized clients to collaboratively learn a common model without sharing local data. Although local data is not exposed directly, privacy concerns nonetheless exist as clients' sensitive information can be inferred from intermediate computations. Moreover, such information leakage accumulates substantially over time as the same data is repeatedly used during the iterative learning process. As a result, it can be particularly difficult to balance the privacy-accuracy trade-off when designing privacy-preserving FL algorithms. In this paper, we introduce Upcycled-FL, a novel federated learning framework with first-order approximation applied at every even iteration. Under this framework, half of the FL updates incur no information leakage and require much less computation. We first conduct the theoretical analysis on the convergence (rate) of Upcycled-FL, and then apply perturbation mechanisms to preserve privacy. Experiments on real-world data show that Upcycled-FL consistently outperforms existing methods over heterogeneous data, and significantly improves privacy-accuracy trade-off while reducing 48% of the training time on average.


title: Contrastive Prompt Learning-based Code Search based on Interaction Matrix

abstract: Code search aims to retrieve the code snippet that highly matches the given query described in natural language. Recently, many code pre-training approaches have demonstrated impressive performance on code search. However, existing code search methods still suffer from two performance constraints: inadequate semantic representation and the semantic gap between natural language (NL) and programming language (PL). In this paper, we propose CPLCS, a contrastive prompt learning-based code search method based on the cross-modal interaction mechanism. CPLCS comprises:(1) PL-NL contrastive learning, which learns the semantic matching relationship between PL and NL representations; (2) a prompt learning design for a dual-encoder structure that can alleviate the problem of inadequate semantic representation; (3) a cross-modal interaction mechanism to enhance the fine-grained mapping between NL and PL. We conduct extensive experiments to evaluate the effectiveness of our approach on a real-world dataset across six programming languages. The experiment results demonstrate the efficacy of our approach in improving semantic representation quality and mapping ability between PL and NL.


title: Boosting Continuous Control with Consistency Policy

abstract: Due to its training stability and strong expression, the diffusion model has attracted considerable attention in offline reinforcement learning. However, several challenges have also come with it: 1) The demand for a large number of diffusion steps makes the diffusion-model-based methods time inefficient and limits their applications in real-time control; 2) How to achieve policy improvement with accurate guidance for diffusion model-based policy is still an open problem. Inspired by the consistency model, we propose a novel time-efficiency method named Consistency Policy with Q-Learning (CPQL), which derives action from noise by a single step. By establishing a mapping from the reverse diffusion trajectories to the desired policy, we simultaneously address the issues of time efficiency and inaccurate guidance when updating diffusion model-based policy with the learned Q-function. We demonstrate that CPQL can achieve policy improvement with accurate guidance for offline reinforcement learning, and can be seamlessly extended for online RL tasks. Experimental results indicate that CPQL achieves new state-of-the-art performance on 11 offline and 21 online tasks, significantly improving inference speed by nearly 45 times compared to Diffusion-QL. We will release our code later.


title: Filter Pruning For CNN With Enhanced Linear Representation Redundancy

abstract: Structured network pruning excels non-structured methods because they can take advantage of the thriving developed parallel computing techniques. In this paper, we propose a new structured pruning method. Firstly, to create more structured redundancy, we present a data-driven loss function term calculated from the correlation coefficient matrix of different feature maps in the same layer, named CCM-loss. This loss term can encourage the neural network to learn stronger linear representation relations between feature maps during the training from the scratch so that more homogenous parts can be removed later in pruning. CCM-loss provides us with another universal transcendental mathematical tool besides L*-norm regularization, which concentrates on generating zeros, to generate more redundancy but for the different genres. Furthermore, we design a matching channel selection strategy based on principal components analysis to exploit the maximum potential ability of CCM-loss. In our new strategy, we mainly focus on the consistency and integrality of the information flow in the network. Instead of empirically hard-code the retain ratio for each layer, our channel selection strategy can dynamically adjust each layer's retain ratio according to the specific circumstance of a per-trained model to push the prune ratio to the limit. Notably, on the Cifar-10 dataset, our method brings 93.64% accuracy for pruned VGG-16 with only 1.40M parameters and 49.60M FLOPs, the pruned ratios for parameters and FLOPs are 90.6% and 84.2%, respectively. For ResNet-50 trained on the ImageNet dataset, our approach achieves 42.8% and 47.3% storage and computation reductions, respectively, with an accuracy of 76.23%. Our code is available at https://github.com/Bojue-Wang/CCM-LRR.


title: On Multiple Shifted Convolution Sums

abstract: We prove strong estimates for averages of shifted convolution sums consisting of quadratic twists of $\mathrm{GL}_{2}$ $L$-functions. The key input involves the circle method together with standard tools such as Vorono\u{\i}, quadratic reciprocity, amplification, and divisor switching.


title: Sill distribution: genesis and salient features

abstract: We present the so-called Sill distribution, both in the nonrelativistic and relativistic cases, as a natural and simple way to include the effect of threshold(s) on the energy line shapes of resonances. The Sill is correctly normalized (even for broad states), is continuous at threshold(s), does not require any modification to the `mass part', is easily extendable to the multichannel case, and can be applied to both mesons and baryons. Here, as a novel example, we employ the Sill to describe the resonance $\psi(3770)$.


title: JointNet: Extending Text-to-Image Diffusion for Dense Distribution Modeling

abstract: We introduce JointNet, a novel neural network architecture for modeling the joint distribution of images and an additional dense modality (e.g., depth maps). JointNet is extended from a pre-trained text-to-image diffusion model, where a copy of the original network is created for the new dense modality branch and is densely connected with the RGB branch. The RGB branch is locked during network fine-tuning, which enables efficient learning of the new modality distribution while maintaining the strong generalization ability of the large-scale pre-trained diffusion model. We demonstrate the effectiveness of JointNet by using RGBD diffusion as an example and through extensive experiments, showcasing its applicability in a variety of applications, including joint RGBD generation, dense depth prediction, depth-conditioned image generation, and coherent tile-based 3D panorama generation.


title: A conditional compound Poisson process approach to the sparse Erd\H{o}s-R\'enyi random graphs: moderate deviations

abstract: We construct a compound Poisson process conditioned on its random summation that represents the sizes of the connected components in the sparse Erd\H{o}s-R\'enyi random graph $G(n,c/n)$. This new representation depicts a connection between the phase transition in the sparse random graph and the condensation transition in the zero-range model. Under this framework, we can derive moderate deviation principles for the maximun component, total number of connected components and empirical measure of the sizes in the non-critical regimes. Large deviation results are discussed.


title: Towards immersive generosity: The need for a novel framework to explore large audiovisual archives through embodied experiences in immersive environments

abstract: This article proposes an innovative framework to explore large audiovisual archives using Immersive Environments to place users inside a dataset and create an embodied experience. It starts by outlining the need for such a novel interface to meet the needs of archival scholars and the GLAM sector, and discusses issues in the current modes of access, mostly restrained to traditional information retrieval systems based on metadata. The paper presents the concept of ``generous interfaces" as a preliminary approach to address these issues, and argues some of the key reasons why employing Immersive Visual Storytelling might benefit such frameworks. The theory of embodiment is leveraged to justify this claim, showing how a more embodied understanding of a collection can result in a stronger engagement for the public. By placing users as actors in the experience rather than mere spectators, the emergence of narrative is driven by their interactions, with benefits in terms of engagement with the public and understanding of the cultural component. The framework we propose is applied to two existing installations to analyze them in-depth and critique them, highlighting the key directions to pursue for further development.


title: Volume holograms with linear diffraction efficiency relation by (3+1)D printing

abstract: We demonstrate the fabrication of volume holograms using 2-photon polymerization with dynamic control of light exposure. We refer to our method as (3+1)D printing. Volume holograms that are recorded by interfering reference and signal beams have a diffraction efficiency relation that is inversely proportional with the square of the number of superimposed holograms. By using (3+1)D printing for fabrication, the refractive index of each voxel is created independently and thus by, digitally filtering the undesired interference terms, the diffraction efficiency is now inversely proportional to the number of multiplexed gratings. We experimentally demonstrated this linear dependence by recording M=50 volume gratings. To the best of our knowledge, this is the first experimental demonstration of distributed volume holograms that overcome the 1/M^2 limit.


title: Fire Detection From Image and Video Using YOLOv5

abstract: For the detection of fire-like targets in indoor, outdoor and forest fire images, as well as fire detection under different natural lights, an improved YOLOv5 fire detection deep learning algorithm is proposed. The YOLOv5 detection model expands the feature extraction network from three dimensions, which enhances feature propagation of fire small targets identification, improves network performance, and reduces model parameters. Furthermore, through the promotion of the feature pyramid, the top-performing prediction box is obtained. Fire-YOLOv5 attains excellent results compared to state-of-the-art object detection networks, notably in the detection of small targets of fire and smoke with mAP 90.5% and f1 score 88%. Overall, the Fire-YOLOv5 detection model can effectively deal with the inspection of small fire targets, as well as fire-like and smoke-like objects with F1 score 0.88. When the input image size is 416 x 416 resolution, the average detection time is 0.12 s per frame, which can provide real-time forest fire detection. Moreover, the algorithm proposed in this paper can also be applied to small target detection under other complicated situations. The proposed system shows an improved approach in all fire detection metrics such as precision, recall, and mean average precision.


title: Isomeric excitation of ^{229}\mathrm{Th} via scanning tunneling microscope

abstract: The low energy of the isomeric state of the radionuclide thorium-229 (229Th) makes it highly promising for applications in fundamental physics, precision metrology, and quantum technologies. However, directly accessing the isomeric state from its ground state remains a challenge. We propose here a tabletop approach utilizing the scanning tunneling microscope (STM) technique to induce excitation of a single 229Th nucleus. With achievable parameters, the isomeric excitation rate is advantageous over existing methods, allowing the excitation and control of 229Th on the single-nucleus level. It offers the unique potential of exciting and detecting subsequent decay from a single nucleus, providing a new direction for future experimental investigation of the 229Th isomeric state.


title: Electrified fallout from a wildfire plume

abstract: Large wildfires are becoming more frequent at temperate latitudes. Often, fires generate massive convective columns that can carry solid particles (ash) into the stratosphere. Like their meteorological counterparts, pyrocumulonimbus (pyroCb) clouds can generate intense lightning storms. Recently, pyrogenic lightning has garnered renewed interest for its capacity to ignite new fires at large distances from the initial fire (in addition to representing a hazard in and of itself). Furthermore, and in analogy with volcanogenic lightning, pyrogenic lightning may offer novel opportunities to monitor and infer the internal dynamics of wildfires remotely. However, the electrification mechanisms underlying wildfire lightning require further clarification. Here, we report on charge measurements conducted during the 2022 Cedar Creek ``megafire.'' We find that a wildfire plume associated with various pyCb events remains mildly electrified at $\sim$80 km from the fire. Our measurements suggest that individual ash particles carry charge densities on the order of 10\textsuperscript{-8} - 10\textsuperscript{-7} C m\textsuperscript{-2}. Owing to this low level of charging, additional electrification mechanisms (perhaps, those associated with the nucleation of ice) appear to be necessary to produce pyrogenic lightning at large distances from the source.


title: Transversals in a collections of trees

abstract: Let $\mathcal{S}$ be a fixed family of graphs on vertex set $V$ and $\mathcal{G}$ be a collection of elements in $\mathcal{S}$. We investigated the transversal problem of finding the maximum value of $|\mathcal{G}|$ when $\mathcal{G}$ contains no rainbow elements in $\mathcal{S}$. Specifically, we determine the exact values when $\mathcal{S}$ is a family of stars or a family of trees of the same order $n$ with $n$ dividing $|V|$. Further, all the extremal cases for $\mathcal{G}$ are characterized.


title: $\Gamma^{0}(2)$ modular forms and anomaly cancellation formulas

abstract: In [5], [6] and [8], the authors gave some modular forms over $\Gamma^0(2)$. In this note, we proceed with the study of cancellation formulas relating to the modular forms.


title: A Semantic Invariant Robust Watermark for Large Language Models

abstract: Watermark algorithms for large language models (LLMs) have achieved extremely high accuracy in detecting text generated by LLMs. Such algorithms typically involve adding extra watermark logits to the LLM's logits at each generation step. However, prior algorithms face a trade-off between attack robustness and security robustness. This is because the watermark logits for a token are determined by a certain number of preceding tokens; a small number leads to low security robustness, while a large number results in insufficient attack robustness. In this work, we propose a semantic invariant watermarking method for LLMs that provides both attack robustness and security robustness. The watermark logits in our work are determined by the semantics of all preceding tokens. Specifically, we utilize another embedding LLM to generate semantic embeddings for all preceding tokens, and then these semantic embeddings are transformed into the watermark logits through our trained watermark model. Subsequent analyses and experiments demonstrated the attack robustness of our method in semantically invariant settings: synonym substitution and text paraphrasing settings. Finally, we also show that our watermark possesses adequate security robustness. Our code and data are available at \href{https://github.com/THU-BPM/Robust_Watermark}{https://github.com/THU-BPM/Robust\_Watermark}. Additionally, our algorithm could also be accessed through MarkLLM \citep{pan2024markllm} \footnote{https://github.com/THU-BPM/MarkLLM}.


title: Adaptive Storey's null proportion estimator

abstract: False discovery rate (FDR) is a commonly used criterion in multiple testing and the Benjamini-Hochberg (BH) procedure is arguably the most popular approach with FDR guarantee. To improve power, the adaptive BH procedure has been proposed by incorporating various null proportion estimators, among which Storey's estimator has gained substantial popularity. The performance of Storey's estimator hinges on a critical hyper-parameter, where a pre-fixed configuration lacks power and existing data-driven hyper-parameters compromise the FDR control. In this work, we propose a novel class of adaptive hyper-parameters and establish the FDR control of the associated BH procedure using a martingale argument. Within this class of data-driven hyper-parameters, we present a specific configuration designed to maximize the number of rejections and characterize the convergence of this proposal to the optimal hyper-parameter under a commonly-used mixture model. We evaluate our adaptive Storey's null proportion estimator and the associated BH procedure on extensive simulated data and a motivating protein dataset. Our proposal exhibits significant power gains when dealing with a considerable proportion of weak non-nulls or a conservative null distribution.


title: Core-Intermediate-Peripheral Index: Factor Analysis of Neighborhood and Shortest Paths-based Centrality Metrics

abstract: We perform factor analysis on the raw data of the four major neighborhood and shortest paths-based centrality metrics (Degree, Eigenvector, Betweeenness and Closeness) and propose a novel quantitative measure called the Core-Intermediate-Peripheral (CIP) Index to capture the extent with which a node could play the role of a core node (nodes at the center of a network with larger values for any centrality metric) vis-a-vis a peripheral node (nodes that exist at the periphery of a network with lower values for any centrality metric). We conduct factor analysis (varimax-based rotation of the Eigenvectors) on the transpose matrix of the raw centrality metrics dataset, with the node ids as features, under the hypothesis that there are two factors (core and peripheral) that drive the values incurred by the nodes with respect to the centrality metrics. We test our approach on a diverse suite of 12 complex real-world networks.


title: Interaction of Nitrogen-Vacancy Centers in Diamond with a Dense Ensemble of Carbon-13

abstract: The nitrogen-vacancy center in diamond attracts a lot of attention in sensing applications, mainly for temperature, magnetic field, and rotation measurements. Nuclear spins of carbon-13 surrounding the nitrogen-vacancy center can be used as a memory or sensing element. In the current work, a diamond plate with a relatively large concentration of carbon-13 was synthesized and examined. The spectrum of optically detected magnetic resonance was recorded and analyzed in a magnetic field range of 5-200 G. A strain-independent measurement technique of carbon-13 isotope concentration based on the analysis of magnetic resonance spectra was developed. Additionally, narrow features in the spectrum were detected and understood.


title: On the existence of minimal expansive solutions to the $N$-body problem

abstract: We deal, for the classical $N$-body problem, with the existence of action minimizing half entire expansive solutions with prescribed asymptotic direction and initial configuration of the bodies. We tackle the cases of hyperbolic, hyperbolic-parabolic and parabolic arcs in a unitary manner. Our approach is based on the minimization of a renormalized Lagrangian action, on a suitable functional space. With this new strategy, we are able to confirm the already-known results of the existence of both hyperbolic and parabolic solutions, and we prove for the first time the existence of hyperbolic-parabolic solutions for any prescribed asymptotic expansion in a suitable class. Associated with each element of this class we find a viscosity solution of the Hamilton-Jacobi equation as a linear correction of the value function. Besides, we also manage to give a better description of the growth of parabolic and hyperbolic-parabolic solutions.


title: Anticipating Impacts: Using Large-Scale Scenario Writing to Explore Diverse Implications of Generative AI in the News Environment

abstract: The tremendous rise of generative AI has reached every part of society - including the news environment. There are many concerns about the individual and societal impact of the increasing use of generative AI, including issues such as disinformation and misinformation, discrimination, and the promotion of social tensions. However, research on anticipating the impact of generative AI is still in its infancy and mostly limited to the views of technology developers and/or researchers. In this paper, we aim to broaden the perspective and capture the expectations of three stakeholder groups (news consumers; technology developers; content creators) about the potential negative impacts of generative AI, as well as mitigation strategies to address these. Methodologically, we apply scenario writing and use participatory foresight in the context of a survey (n=119) to delve into cognitively diverse imaginations of the future. We qualitatively analyze the scenarios using thematic analysis to systematically map potential impacts of generative AI on the news environment, potential mitigation strategies, and the role of stakeholders in causing and mitigating these impacts. In addition, we measure respondents' opinions on a specific mitigation strategy, namely transparency obligations as suggested in Article 52 of the draft EU AI Act. We compare the results across different stakeholder groups and elaborate on the (non-) presence of different expected impacts across these groups. We conclude by discussing the usefulness of scenario-writing and participatory foresight as a toolbox for generative AI impact assessment.


title: InfoCL: Alleviating Catastrophic Forgetting in Continual Text Classification from An Information Theoretic Perspective

abstract: Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. We focus on continual text classification under the class-incremental setting. Recent CL studies have identified the severe performance decrease on analogous classes as a key factor for catastrophic forgetting. In this paper, through an in-depth exploration of the representation learning process in CL, we discover that the compression effect of the information bottleneck leads to confusion on analogous classes. To enable the model learn more sufficient representations, we propose a novel replay-based continual text classification method, InfoCL. Our approach utilizes fast-slow and current-past contrastive learning to perform mutual information maximization and better recover the previously learned representations. In addition, InfoCL incorporates an adversarial memory augmentation strategy to alleviate the overfitting problem of replay. Experimental results demonstrate that InfoCL effectively mitigates forgetting and achieves state-of-the-art performance on three text classification tasks. The code is publicly available at https://github.com/Yifan-Song793/InfoCL.


title: Explicit maximal totally real embeddings

abstract: This article is the continuation of the first named author work "On maximal totally real embeddings". For real analytic compact manifolds equipped with a covariant derivative operator acting on the real analytic sections of its tangent bundle, a construction of canonical maximal totally real embeddings is known from previous works by Guillemin-Stenzel, Lempert, Lempert-Sz{\"o}ke, Sz{\"o}ke and Bielawski. The construction is based on the use of Jacobi fields, which are far from being explicit. As a consequence, the form of the corresponding complex structure has been a mystery since the very beginning. A quite simple recursive expression for such complex structures has been provided in the above cited first named author work. In our series of papers we always focus on the torsion free case. In the present paper we provide a fiberwise Taylor expansion of the canonical complex structure which is expressed in terms of symmetrization of curvature monomials and a rather simple and explicit expression of the coefficients of the expansion. Our main argument applies to far more generals settings that can be useful for the study of open questions in the theory of the embeddings in consideration. In this paper we provide also evidence for some remarkable canonical vanishing of some of the integrability equations in general settings.


title: Noisy-ArcMix: Additive Noisy Angular Margin Loss Combined With Mixup Anomalous Sound Detection

abstract: Unsupervised anomalous sound detection (ASD) aims to identify anomalous sounds by learning the features of normal operational sounds and sensing their deviations. Recent approaches have focused on the self-supervised task utilizing the classification of normal data, and advanced models have shown that securing representation space for anomalous data is important through representation learning yielding compact intra-class and well-separated intra-class distributions. However, we show that conventional approaches often fail to ensure sufficient intra-class compactness and exhibit angular disparity between samples and their corresponding centers. In this paper, we propose a training technique aimed at ensuring intra-class compactness and increasing the angle gap between normal and abnormal samples. Furthermore, we present an architecture that extracts features for important temporal regions, enabling the model to learn which time frames should be emphasized or suppressed. Experimental results demonstrate that the proposed method achieves the best performance giving 0.90%, 0.83%, and 2.16% improvement in terms of AUC, pAUC, and mAUC, respectively, compared to the state-of-the-art method on DCASE 2020 Challenge Task2 dataset.


title: Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignment

abstract: Multi-Modal Entity Alignment (MMEA) is a critical task that aims to identify equivalent entity pairs across multi-modal knowledge graphs (MMKGs). However, this task faces challenges due to the presence of different types of information, including neighboring entities, multi-modal attributes, and entity types. Directly incorporating the above information (e.g., concatenation or attention) can lead to an unaligned information space. To address these challenges, we propose a novel MMEA transformer, called MoAlign, that hierarchically introduces neighbor features, multi-modal attributes, and entity types to enhance the alignment task. Taking advantage of the transformer's ability to better integrate multiple information, we design a hierarchical modifiable self-attention block in a transformer encoder to preserve the unique semantics of different information. Furthermore, we design two entity-type prefix injection methods to integrate entity-type information using type prefixes, which help to restrict the global information of entities not present in the MMKGs. Our extensive experiments on benchmark datasets demonstrate that our approach outperforms strong competitors and achieves excellent entity alignment performance.


title: On the Peak AoI of UAV-assisted IoT Networks: A Stochastic Geometry Approach

abstract: In this paper, we analyze the peak age of information (PAoI) in UAV-assisted internet of thing (IoT) networks, in which the locations of IoT devices are modeled by a Mat\'{e}rn cluster process (MCP) and UAVs are deployed at the cluster centers to collect the status updates from the devices. Specifically, we consider that IoT devices can either monitor the same physical process or different physical processes and UAVs split their resources, time or bandwidth, to serve the devices to avoid inter-cluster interference. Using tools from stochastic geometry, we are able to compute the mean activity probability of IoT devices and the conditional success probability of an individual device. We then use tools from queuing theory to compute the PAoI under two load models and two scenarios for devices, respectively. Our numerical results show interesting system insights. We first show that for a low data arrival rate, increasing the number of correlated devices can improve the PAoI for both load models. Next, we show that even though the time-splitting technique causes higher interference, it has a limited impact on the mean PAoI, and the mean PAoI benefits more from the time-splitting technique. This is because of the nature of UAV communication, especially at places where devices (users) are spatially-clustered: shorter transmission distances and better communication channels, comparing the links established by the cluster UAV and serving devices (users) to links established by interferers.


title: DrugCLIP: Contrastive Protein-Molecule Representation Learning for Virtual Screening

abstract: Virtual screening, which identifies potential drugs from vast compound databases to bind with a particular protein pocket, is a critical step in AI-assisted drug discovery. Traditional docking methods are highly time-consuming, and can only work with a restricted search library in real-life applications. Recent supervised learning approaches using scoring functions for binding-affinity prediction, although promising, have not yet surpassed docking methods due to their strong dependency on limited data with reliable binding-affinity labels. In this paper, we propose a novel contrastive learning framework, DrugCLIP, by reformulating virtual screening as a dense retrieval task and employing contrastive learning to align representations of binding protein pockets and molecules from a large quantity of pairwise data without explicit binding-affinity scores. We also introduce a biological-knowledge inspired data augmentation strategy to learn better protein-molecule representations. Extensive experiments show that DrugCLIP significantly outperforms traditional docking and supervised learning methods on diverse virtual screening benchmarks with highly reduced computation time, especially in zero-shot setting.


title: CoinSeg: Contrast Inter- and Intra- Class Representations for Incremental Segmentation

abstract: Class incremental semantic segmentation aims to strike a balance between the model's stability and plasticity by maintaining old knowledge while adapting to new concepts. However, most state-of-the-art methods use the freeze strategy for stability, which compromises the model's plasticity.In contrast, releasing parameter training for plasticity could lead to the best performance for all categories, but this requires discriminative feature representation.Therefore, we prioritize the model's plasticity and propose the Contrast inter- and intra-class representations for Incremental Segmentation (CoinSeg), which pursues discriminative representations for flexible parameter tuning. Inspired by the Gaussian mixture model that samples from a mixture of Gaussian distributions, CoinSeg emphasizes intra-class diversity with multiple contrastive representation centroids. Specifically, we use mask proposals to identify regions with strong objectness that are likely to be diverse instances/centroids of a category. These mask proposals are then used for contrastive representations to reinforce intra-class diversity. Meanwhile, to avoid bias from intra-class diversity, we also apply category-level pseudo-labels to enhance category-level consistency and inter-category diversity. Additionally, CoinSeg ensures the model's stability and alleviates forgetting through a specific flexible tuning strategy. We validate CoinSeg on Pascal VOC 2012 and ADE20K datasets with multiple incremental scenarios and achieve superior results compared to previous state-of-the-art methods, especially in more challenging and realistic long-term scenarios. Code is available at https://github.com/zkzhang98/CoinSeg.


title: Geometrically Aligned Transfer Encoder for Inductive Transfer in Regression Tasks

abstract: Transfer learning is a crucial technique for handling a small amount of data that is potentially related to other abundant data. However, most of the existing methods are focused on classification tasks using images and language datasets. Therefore, in order to expand the transfer learning scheme to regression tasks, we propose a novel transfer technique based on differential geometry, namely the Geometrically Aligned Transfer Encoder (GATE). In this method, we interpret the latent vectors from the model to exist on a Riemannian curved manifold. We find a proper diffeomorphism between pairs of tasks to ensure that every arbitrary point maps to a locally flat coordinate in the overlapping region, allowing the transfer of knowledge from the source to the target data. This also serves as an effective regularizer for the model to behave in extrapolation regions. In this article, we demonstrate that GATE outperforms conventional methods and exhibits stable behavior in both the latent space and extrapolation regions for various molecular graph datasets.


title: Advanced Efficient Strategy for Detection of Dark Objects Based on Spiking Network with Multi-Box Detection

abstract: Several deep learning algorithms have shown amazing performance for existing object detection tasks, but recognizing darker objects is the largest challenge. Moreover, those techniques struggled to detect or had a slow recognition rate, resulting in significant performance losses. As a result, an improved and accurate detection approach is required to address the above difficulty. The whole study proposes a combination of spiked and normal convolution layers as an energy-efficient and reliable object detector model. The proposed model is split into two sections. The first section is developed as a feature extractor, which utilizes pre-trained VGG16, and the second section of the proposal structure is the combination of spiked and normal Convolutional layers to detect the bounding boxes of images. We drew a pre-trained model for classifying detected objects. With state of the art Python libraries, spike layers can be trained efficiently. The proposed spike convolutional object detector (SCOD) has been evaluated on VOC and Ex-Dark datasets. SCOD reached 66.01% and 41.25% mAP for detecting 20 different objects in the VOC-12 and 12 objects in the Ex-Dark dataset. SCOD uses 14 Giga FLOPS for its forward path calculations. Experimental results indicated superior performance compared to Tiny YOLO, Spike YOLO, YOLO-LITE, Tinier YOLO and Center of loc+Xception based on mAP for the VOC dataset.


title: Partition-based differentially private synthetic data generation

abstract: Private synthetic data sharing is preferred as it keeps the distribution and nuances of original data compared to summary statistics. The state-of-the-art methods adopt a select-measure-generate paradigm, but measuring large domain marginals still results in much error and allocating privacy budget iteratively is still difficult. To address these issues, our method employs a partition-based approach that effectively reduces errors and improves the quality of synthetic data, even with a limited privacy budget. Results from our experiments demonstrate the superiority of our method over existing approaches. The synthetic data produced using our approach exhibits improved quality and utility, making it a preferable choice for private synthetic data sharing.


title: Leveraging Diffusion-Based Image Variations for Robust Training on Poisoned Data

abstract: Backdoor attacks pose a serious security threat for training neural networks as they surreptitiously introduce hidden functionalities into a model. Such backdoors remain silent during inference on clean inputs, evading detection due to inconspicuous behavior. However, once a specific trigger pattern appears in the input data, the backdoor activates, causing the model to execute its concealed function. Detecting such poisoned samples within vast datasets is virtually impossible through manual inspection. To address this challenge, we propose a novel approach that enables model training on potentially poisoned datasets by utilizing the power of recent diffusion models. Specifically, we create synthetic variations of all training samples, leveraging the inherent resilience of diffusion models to potential trigger patterns in the data. By combining this generative approach with knowledge distillation, we produce student models that maintain their general performance on the task while exhibiting robust resistance to backdoor triggers.


title: NIKA2 observations of 3 low-mass galaxy clusters at $z \sim 1$: pressure profile and $Y_{\rm SZ}$-$M$ relation

abstract: Three galaxy clusters selected from the XXL X-ray survey at high redshift and low mass ($z\sim1$ and $M_{500} \sim 1-2 \times 10^{14}$ M$_{\odot}$) were observed with NIKA2 to image their Sunyaev-Zel'dovich effect (SZ) signal. They all present an SZ morphology, together with the comparison with X-ray and optical data, that indicates dynamical activity related to merging events. Despite their disturbed intracluster medium, their high redshifts, and their low masses, the three clusters follow remarkably well the pressure profile and the SZ flux-mass relation expected from standard evolution. This suggests that the physics that drives cluster formation is already in place at $z \sim 1$ down to $M_{500} \sim 10^{14}$ M$_{\odot}$.


title: Rethinking Model Selection and Decoding for Keyphrase Generation with Pre-trained Sequence-to-Sequence Models

abstract: Keyphrase Generation (KPG) is a longstanding task in NLP with widespread applications. The advent of sequence-to-sequence (seq2seq) pre-trained language models (PLMs) has ushered in a transformative era for KPG, yielding promising performance improvements. However, many design decisions remain unexplored and are often made arbitrarily. This paper undertakes a systematic analysis of the influence of model selection and decoding strategies on PLM-based KPG. We begin by elucidating why seq2seq PLMs are apt for KPG, anchored by an attention-driven hypothesis. We then establish that conventional wisdom for selecting seq2seq PLMs lacks depth: (1) merely increasing model size or performing task-specific adaptation is not parameter-efficient; (2) although combining in-domain pre-training with task adaptation benefits KPG, it does partially hinder generalization. Regarding decoding, we demonstrate that while greedy search achieves strong F1 scores, it lags in recall compared with sampling-based methods. Based on these insights, we propose DeSel, a likelihood-based decode-select algorithm for seq2seq PLMs. DeSel improves greedy search by an average of 4.7% semantic F1 across five datasets. Our collective findings pave the way for deeper future investigations into PLM-based KPG.


title: Quantum support vector data description for anomaly detection

abstract: Anomaly detection is a critical problem in data analysis and pattern recognition, finding applications in various domains. We introduce quantum support vector data description (QSVDD), an unsupervised learning algorithm designed for anomaly detection. QSVDD utilizes a shallow-depth quantum circuit to learn a minimum-volume hypersphere that tightly encloses normal data, tailored for the constraints of noisy intermediate-scale quantum (NISQ) computing. Simulation results on the MNIST and Fashion MNIST image datasets demonstrate that QSVDD outperforms both quantum autoencoder and deep learning-based approaches under similar training conditions. Notably, QSVDD offers the advantage of training an extremely small number of model parameters, which grows logarithmically with the number of input qubits. This enables efficient learning with a simple training landscape, presenting a compact quantum machine learning model with strong performance for anomaly detection.


title: Martin-L\"of \`a la Coq

abstract: We present an extensive mechanization of the meta-theory of Martin-L\"of Type Theory (MLTT) in the Coq proof assistant. Our development builds on pre-existing work in Agda to show not only the decidability of conversion, but also the decidability of type checking, using an approach guided by bidirectional type checking. From our proof of decidability, we obtain a certified and executable type checker for a full-fledged version of MLTT with support for $\Pi$, $\Sigma$, $\mathbb{N}$, and identity types, and one universe. Furthermore, our development does not rely on impredicativity, induction-recursion or any axiom beyond MLTT with a schema for indexed inductive types and a handful of predicative universes, narrowing the gap between the object theory and the meta-theory to a mere difference in universes. Finally, we explain our formalization choices, geared towards a modular development relying on Coq's features, e.g. meta-programming facilities provided by tactics and universe polymorphism.


title: Elevated temperature effects (T > 100 {\deg}C) on the interfacial water and microstructure swelling of Na-montmorillonite

abstract: Montmorillonite-based barriers are key elements of the engineered barrier systems (EBS) in geological disposal facilities (GDF). Their performance at temperatures above 100 {\deg}C is not sufficiently understood to assess the possibility of raising the temperature limits in GDF designs that could reduce construction costs and CO2 footprint. The present work provides new fundamental insights through molecular dynamics (MD) simulations of Na-montmorillonite's water-clay interactions and swelling pressure at temperatures 298-500 K and basal spacings of 1.5-3.5 nm. At temperatures above 100 {\deg}C, the swelling behaviour is governed by the attractive van der Waals force and the repulsive hydration force instead of the repulsive electrostatic (double layer) force. The swelling pressure reduction with increasing temperature is related to the weakened hydration repulsion and electric double layer repulsion, which result from the deterioration of the interlayer water layer structure and the shrinkage of the electric double layer. The applicability and breakdown of the classic Derjaguin-Landau-Verwey-Overbeek (DLVO) theory at elevated temperatures are examined. By excluding the osmotic contribution in the DLVO theory, the summation of the van der Waals interaction in DLVO and an additional non-DLVO hydration interaction can predict our MD system's swelling under high temperatures. The findings of this study provide a fundamental understanding of the swelling behaviour and the underlying molecular-level mechanisms of the clay microstructure under extreme conditions.


title: Bounds on $k$-Uniform Quantum States

abstract: Do $N$-partite $k$-uniform states always exist when $k\leq \lfloor\frac{N}{2}\rfloor-1$? In this work, we provide new upper bounds on the parameter $k$ for the existence of $k$-uniform states in $(\mathbb{C}^{d})^{\otimes N}$ when $d=3,4,5$, which extend Rains' bound in 1999 and improve Scott's bound in 2004. Since a $k$-uniform state in $(\mathbb{C}^{d})^{\otimes N}$ corresponds to a pure $((N,1,k+1))_{d}$ quantum error-correcting codes, we also give new upper bounds on the minimum distance $k+1$ of pure $((N,1,k+1))_d$ quantum error-correcting codes. Furthermore, we generalize Scott's bound to heterogeneous systems, and show some non-existence results of absolutely maximally entangled states in $\mathbb{C}^{d_1}\otimes(\mathbb{C}^{d_2})^{\otimes 2n}$.


title: Initialization Bias of Fourier Neural Operator: Revisiting the Edge of Chaos

abstract: This paper investigates the initialization bias of the Fourier neural operator (FNO). A mean-field theory for FNO is established, analyzing the behavior of the random FNO from an \emph{edge of chaos} perspective. We uncover that the forward and backward propagation behaviors exhibit characteristics unique to FNO, induced by mode truncation, while also showcasing similarities to those of densely connected networks. Building upon this observation, we also propose an edge of chaos initialization scheme for FNO to mitigate the negative initialization bias leading to training instability. Experimental results show the effectiveness of our initialization scheme, enabling stable training of deep FNO without skip-connection.


title: CAST: Cluster-Aware Self-Training for Tabular Data

abstract: Self-training has gained attraction because of its simplicity and versatility, yet it is vulnerable to noisy pseudo-labels caused by erroneous confidence. Several solutions have been proposed to handle the problem, but they require significant modifications in self-training algorithms or model architecture, and most have limited applicability in tabular domains. To address this issue, we explore a novel direction of reliable confidence in self-training contexts and conclude that the confidence, which represents the value of the pseudo-label, should be aware of the cluster assumption. In this regard, we propose Cluster-Aware Self-Training (CAST) for tabular data, which enhances existing self-training algorithms at a negligible cost without significant modifications. Concretely, CAST regularizes the confidence of the classifier by leveraging local density for each class in the labeled training data, forcing the pseudo-labels in low-density regions to have lower confidence. Extensive empirical evaluations on up to 21 real-world datasets confirm not only the superior performance of CAST but also its robustness in various setups in self-training contexts.


title: Measurement of branching fractions and direct $CP$ asymmetries for $B \to K\pi$ and $B\to\pi\pi$ decays at Belle II

abstract: We report measurements of the branching fractions and direct $\it{CP}$ asymmetries of the decays $B^0 \to K^+ \pi^-$, $B^+ \to K^+ \pi^0$, $B^+ \to K^0 \pi^+$, and $B^0 \to K^0 \pi^0$, and use these for testing the standard model through an isospin-based sum rule. In addition, we measure the branching fraction and direct $\it{CP}$ asymmetry of the decay $B^+ \to \pi^+\pi^0$ and the branching fraction of the decay $B^0 \to \pi^+\pi^-$. The data are collected with the Belle II detector from $e^+e^-$ collisions at the $\Upsilon(4S)$ resonance produced by the SuperKEKB asymmetric-energy collider and contain $387\times 10^6$ bottom-antibottom meson pairs. Signal yields are determined in two-dimensional fits to background-discriminating variables, and range from 500 to 3900 decays, depending on the channel. We obtain $-0.03 \pm 0.13 \pm 0.04$ for the sum rule, in agreement with the standard model expectation of zero and with a precision comparable to the best existing determinations.


title: Mutual Information Metrics for Uplink MIMO-OFDM Integrated Sensing and Communication System

abstract: As the uplink sensing has the advantage of easy implementation, it attracts great attention in integrated sensing and communication (ISAC) system. This paper presents an uplink ISAC system based on multi-input multi-output orthogonal frequency division multiplexing (MIMO-OFDM) technology. The mutual information (MI) is introduced as a unified metric to evaluate the performance of communication and sensing. In this paper, firstly, the upper and lower bounds of communication and sensing MI are derived in details based on the interaction between communication and sensing. And the ISAC waveform is optimized by maximizing the weighted sum of sensing and communication MI. The Monte Carlo simulation results show that, compared with other waveform optimization schemes, the proposed ISAC scheme has the best overall performance.


title: What Makes for Robust Multi-Modal Models in the Face of Missing Modalities?

abstract: With the growing success of multi-modal learning, research on the robustness of multi-modal models, especially when facing situations with missing modalities, is receiving increased attention. Nevertheless, previous studies in this domain exhibit certain limitations, as they often lack theoretical insights or their methodologies are tied to specific network architectures or modalities. We model the scenarios of multi-modal models encountering missing modalities from an information-theoretic perspective and illustrate that the performance ceiling in such scenarios can be approached by efficiently utilizing the information inherent in non-missing modalities. In practice, there are two key aspects: (1) The encoder should be able to extract sufficiently good features from the non-missing modality; (2) The extracted features should be robust enough not to be influenced by noise during the fusion process across modalities. To this end, we introduce Uni-Modal Ensemble with Missing Modality Adaptation (UME-MMA). UME-MMA employs uni-modal pre-trained weights for the multi-modal model to enhance feature extraction and utilizes missing modality data augmentation techniques to better adapt to situations with missing modalities. Apart from that, UME-MMA, built on a late-fusion learning framework, allows for the plug-and-play use of various encoders, making it suitable for a wide range of modalities and enabling seamless integration of large-scale pre-trained encoders to further enhance performance. And we demonstrate UME-MMA's effectiveness in audio-visual datasets~(e.g., AV-MNIST, Kinetics-Sound, AVE) and vision-language datasets~(e.g., MM-IMDB, UPMC Food101).


title: Redundant and Loosely Coupled LiDAR-Wi-Fi Integration for Robust Global Localization in Autonomous Mobile Robotics

abstract: This paper presents a framework addressing the challenge of global localization in autonomous mobile robotics by integrating LiDAR-based descriptors and Wi-Fi fingerprinting in a pre-mapped environment. This is motivated by the increasing demand for reliable localization in complex scenarios, such as urban areas or underground mines, requiring robust systems able to overcome limitations faced by traditional Global Navigation Satellite System (GNSS)-based localization methods. By leveraging the complementary strengths of LiDAR and Wi-Fi sensors used to generate predictions and evaluate the confidence of each prediction as an indicator of potential degradation, we propose a redundancy-based approach that enhances the system's overall robustness and accuracy. The proposed framework allows independent operation of the LiDAR and Wi-Fi sensors, ensuring system redundancy. By combining the predictions while considering their confidence levels, we achieve enhanced and consistent performance in localization tasks.


title: 3DS-SLAM: A 3D Object Detection based Semantic SLAM towards Dynamic Indoor Environments

abstract: The existence of variable factors within the environment can cause a decline in camera localization accuracy, as it violates the fundamental assumption of a static environment in Simultaneous Localization and Mapping (SLAM) algorithms. Recent semantic SLAM systems towards dynamic environments either rely solely on 2D semantic information, or solely on geometric information, or combine their results in a loosely integrated manner. In this research paper, we introduce 3DS-SLAM, 3D Semantic SLAM, tailored for dynamic scenes with visual 3D object detection. The 3DS-SLAM is a tightly-coupled algorithm resolving both semantic and geometric constraints sequentially. We designed a 3D part-aware hybrid transformer for point cloud-based object detection to identify dynamic objects. Subsequently, we propose a dynamic feature filter based on HDBSCAN clustering to extract objects with significant absolute depth differences. When compared against ORB-SLAM2, 3DS-SLAM exhibits an average improvement of 98.01% across the dynamic sequences of the TUM RGB-D dataset. Furthermore, it surpasses the performance of the other four leading SLAM systems designed for dynamic environments.


title: Semi-infinite parabolic IC-sheaf

abstract: Let G be a connected reductive group, P its parabolic subgroup. We consider the parabolic semi-infinite category of sheaves on the affine Grassmanian of G and construct the parabolic version of the semi-infinite IC-sheaf of each orbit. We establish some of its properties and relate it to sheaves on the Drinfeld compactification of the moduli stack Bun_P of P-torsors on a curve. We also relate the parabolic semi-infinite IC-sheaf with the dual baby Verma object on the spectral side.


title: Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations

abstract: Large Language Models (LLMs) have shown remarkable success in various tasks, yet their safety and the risk of generating harmful content remain pressing concerns. In this paper, we delve into the potential of In-Context Learning (ICL) to modulate the alignment of LLMs. Specifically, we propose the In-Context Attack (ICA) which employs harmful demonstrations to subvert LLMs, and the In-Context Defense (ICD) which bolsters model resilience through examples that demonstrate refusal to produce harmful responses. We offer theoretical insights to elucidate how a limited set of in-context demonstrations can pivotally influence the safety alignment of LLMs. Through extensive experiments, we demonstrate the efficacy of ICA and ICD in respectively elevating and mitigating the success rates of jailbreaking prompts. Our findings illuminate the profound influence of ICL on LLM behavior, opening new avenues for improving the safety of LLMs.


title: Phase space of electron- and muon-neutrino and antineutrino scattering off nuclei

abstract: We discuss the electron and muon neutrino and antineutrino charged current quasielastic double differential cross sections on carbon by projecting them in the transferred momentum-energy plane. This visually allows to easily understand the surprising dominance of the muon neutrino and antineutrino cross sections over the electron ones in particular kinematical conditions.


title: Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modeling

abstract: Diffusion models excel at generating photo-realistic images but come with significant computational costs in both training and sampling. While various techniques address these computational challenges, a less-explored issue is designing an efficient and adaptable network backbone for iterative refinement. Current options like U-Net and Vision Transformer often rely on resource-intensive deep networks and lack the flexibility needed for generating images at variable resolutions or with a smaller network than used in training. This study introduces LEGO bricks, which seamlessly integrate Local-feature Enrichment and Global-content Orchestration. These bricks can be stacked to create a test-time reconfigurable diffusion backbone, allowing selective skipping of bricks to reduce sampling costs and generate higher-resolution images than the training data. LEGO bricks enrich local regions with an MLP and transform them using a Transformer block while maintaining a consistent full-resolution image across all bricks. Experimental results demonstrate that LEGO bricks enhance training efficiency, expedite convergence, and facilitate variable-resolution image generation while maintaining strong generative performance. Moreover, LEGO significantly reduces sampling time compared to other methods, establishing it as a valuable enhancement for diffusion models.


title: P5: Plug-and-Play Persona Prompting for Personalized Response Selection

abstract: The use of persona-grounded retrieval-based chatbots is crucial for personalized conversations, but there are several challenges that need to be addressed. 1) In general, collecting persona-grounded corpus is very expensive. 2) The chatbot system does not always respond in consideration of persona at real applications. To address these challenges, we propose a plug-and-play persona prompting method. Our system can function as a standard open-domain chatbot if persona information is not available. We demonstrate that this approach performs well in the zero-shot setting, which reduces the dependence on persona-ground training data. This makes it easier to expand the system to other languages without the need to build a persona-grounded corpus. Additionally, our model can be fine-tuned for even better performance. In our experiments, the zero-shot model improved the standard model by 7.71 and 1.04 points in the original persona and revised persona, respectively. The fine-tuned model improved the previous state-of-the-art system by 1.95 and 3.39 points in the original persona and revised persona, respectively. To the best of our knowledge, this is the first attempt to solve the problem of personalized response selection using prompt sequences. Our code is available on github~\footnote{https://github.com/rungjoo/plug-and-play-prompt-persona}.


title: Improved prompting and process for writing user personas with LLMs, using qualitative interviews: Capturing behaviour and personality traits of users

abstract: This draft paper presents a workflow for creating User Personas with Large Language Models, using the results of a Thematic Analysis of qualitative interviews. The proposed workflow uses improved prompting and a larger pool of Themes, compared to previous work conducted by the author for the same task. This is possible due to the capabilities of a recently released LLM which allows the processing of 16 thousand tokens (GPT3.5-Turbo-16k) and also due to the possibility to offer a refined prompting for the creation of Personas. The paper offers details of performing Phase 2 and 3 of Thematic Analysis, and then discusses the improved workflow for creating Personas. The paper also offers some reflections on the relationship between the proposed process and existing approaches to Personas such as the data-driven and qualitative Personas. Moreover, the paper offers reflections on the capacity of LLMs to capture user behaviours and personality traits, from the underlying dataset of qualitative interviews used for the analysis.


title: Co-maximal subgroup graph characterized by forbidden subgraphs

abstract: In this communication, the co-maximal subgroup graph $\Gamma(G)$ of a finite group $G$ is examined when $G$ is a finite nilpotent group, finite abelian group, dihedral group $D_n$, dicyclic group $Q_{2^n}$, and $p$-group. We derive the necessary and sufficient conditions for $\Gamma(G)$ to be a cluster graph, triangle-free graph, claw-free graph, cograph, chordal graph, threshold graph and split graph. For the case of finite nilpotent group, we are able to classify it entirely. Moreover, we derive the complete structure of finite abelian group $G$ such that $\Gamma(G)$ is a split graph. We leave the readers with a few unsolved questions.


title: Harnessing Administrative Data Inventories to Create a Reliable Transnational Reference Database for Crop Type Monitoring

abstract: With leaps in machine learning techniques and their applicationon Earth observation challenges has unlocked unprecedented performance across the domain. While the further development of these methods was previously limited by the availability and volume of sensor data and computing resources, the lack of adequate reference data is now constituting new bottlenecks. Since creating such ground-truth information is an expensive and error-prone task, new ways must be devised to source reliable, high-quality reference data on large scales. As an example, we showcase E URO C ROPS, a reference dataset for crop type classification that aggregates and harmonizes administrative data surveyed in different countries with the goal of transnational interoperability.


title: Spatial-photonic Ising machine by space-division multiplexing with physically tunable coefficients of a multi-component model

abstract: This paper proposes a space-division multiplexed spatial-photonic Ising machine (SDM-SPIM) that physically calculates the weighted sum of the Ising Hamiltonians for individual components in a multi-component model. Space-division multiplexing enables tuning a set of weight coefficients as an optical parameter and obtaining the desired Ising Hamiltonian at a time. We solved knapsack problems to verify the system's validity, demonstrating that optical parameters impact the search property. We also investigated a new dynamic coefficient search algorithm to enhance search performance. The SDM-SPIM would physically calculate the Hamiltonian and a part of the optimization with an electronics process.


title: Large out-of-plane spin-orbit torque in topological Weyl semimetal candidate TaIrTe4

abstract: Topological quantum materials, with novel spin textures and broken crystal symmetries are suitable candidates for spintronic memory technologies. Their unique electronic properties, such as protected surface states and exotic quasiparticles, can provide an out-of-plane spin polarized current needed for external field free magnetization switching of magnets with perpendicular magnetic anisotropy. Conventional spin-orbit torque materials, such as heavy metals and topological insulators, provide only an in-plane spin polarized current, and recently explored materials with lower crystal symmetries provide very low out-of-plane spin polarized current components, which is not suitable for energy-efficient spin-orbit torque (SOT) applications. Here, we demonstrate a large out-of-plane damping-like SOT at room temperature using a topological Weyl semimetal candidate TaIrTe4 with a lower crystal symmetry. We performed spin-orbit torque ferromagnetic resonance (STFMR) experiments in a TaIrTe4/Ni80Fe20 heterostructure and observed a large out-of-plane damping-like SOT efficiency. The out-of-plane spin Hall conductivity is estimated to be an order of magnitude higher than the reported values in other materials. These findings of high spin Hall conductivity and large out-of-plane SOT efficiency are suitable for the development of energy efficient and external field-free spintronic devices.


title: Adversarial Robustness in Graph Neural Networks: A Hamiltonian Approach

abstract: Graph neural networks (GNNs) are vulnerable to adversarial perturbations, including those that affect both node features and graph topology. This paper investigates GNNs derived from diverse neural flows, concentrating on their connection to various stability notions such as BIBO stability, Lyapunov stability, structural stability, and conservative stability. We argue that Lyapunov stability, despite its common use, does not necessarily ensure adversarial robustness. Inspired by physics principles, we advocate for the use of conservative Hamiltonian neural flows to construct GNNs that are robust to adversarial attacks. The adversarial robustness of different neural flow GNNs is empirically compared on several benchmark datasets under a variety of adversarial attacks. Extensive numerical experiments demonstrate that GNNs leveraging conservative Hamiltonian flows with Lyapunov stability substantially improve robustness against adversarial perturbations. The implementation code of experiments is available at https://github.com/zknus/NeurIPS-2023-HANG-Robustness.


title: Top of the Heap: Efficient Memory Error Protection for Many Heap Objects

abstract: Exploits against heap memory errors continue to be a major concern. Although many defenses have been proposed, heap data are not protected from attacks that exploit memory errors systematically. Research defenses focus on complete coverage of heap objects, often giving up on comprehensive memory safety protection and/or incurring high costs in performance overhead and memory usage. In this paper, we propose a solution for heap memory safety enforcement that aims to provide comprehensive protection from memory errors efficiently by protecting those heap objects whose accesses are provably safe from memory errors. Specifically, we present the Uriah system that statically validates spatial and type memory safety for heap objects, isolating compliant objects on a safe heap that enforces temporal type safety to prevent attacks on memory reuse. Using Uriah, 71.9% of heap allocation sites can be shown to produce objects (73% of allocations are found safe) that satisfy spatial and type safety, which are then isolated using Uriah's heap allocator from memory accesses via unsafe heap objects. Uriah only incurs 2.9% overhead and only uses 9.3% more memory on SPEC CPU2006 (C/C++) benchmarks, showing that many heap objects can be protected from all classes of memory errors efficiently.


title: On the sub-parsec scale core composition of FR 0 radio galaxies

abstract: Although Fanaroff-Riley (FR) type 0 radio galaxies are known to be the most numerous jet population in the local Universe, they are much less explored than the well-established class of FR I and FR II galaxies due to their intrinsic weakness. Observationally, their nuclear radio, optical and X-ray properties are comparable to the nuclear environment of FR Is. The recent detection of two FR 0s in the high-energy band suggests that like in FR Is, charged particles are accelerated there to energies that enable gamma-ray production. Up to now, only the lack of extended radio emission from FR 0s distinguishes them from FR Is. By comparing the spectral energy distribution of FR 0s with that of FR Is and in particular with that of M87 as a well-studied reference source of the FR I population, we find the broadband spectrum of FR 0s exceptionally close to M87's quiet core emission. Relying on that similarity, we apply a lepto-hadronic jet-accretion flow model to FR 0s. This model is able to explain the broadband spectral energy distribution, with parameters close to particle-field equipartition and matching all observational constraints. In this framework, FR 0s are multi-messenger jet sources, with a nature and highly magnetized environment similar to that of the naked quiet core of FR Is.


title: Lo-Hi: Practical ML Drug Discovery Benchmark

abstract: Finding new drugs is getting harder and harder. One of the hopes of drug discovery is to use machine learning models to predict molecular properties. That is why models for molecular property prediction are being developed and tested on benchmarks such as MoleculeNet. However, existing benchmarks are unrealistic and are too different from applying the models in practice. We have created a new practical \emph{Lo-Hi} benchmark consisting of two tasks: Lead Optimization (Lo) and Hit Identification (Hi), corresponding to the real drug discovery process. For the Hi task, we designed a novel molecular splitting algorithm that solves the Balanced Vertex Minimum $k$-Cut problem. We tested state-of-the-art and classic ML models, revealing which works better under practical settings. We analyzed modern benchmarks and showed that they are unrealistic and overoptimistic. Review: https://openreview.net/forum?id=H2Yb28qGLV Lo-Hi benchmark: https://github.com/SteshinSS/lohi_neurips2023 Lo-Hi splitter library: https://github.com/SteshinSS/lohi_splitter


title: ALMA Band 9 upgrade: a feasibility study

abstract: We present the results of a study on the feasibility of upgrading the existing ALMA Band 9 receivers (602-720 GHz). In the current configuration, each receiver is a dual channel heterodyne system capable of detecting orthogonally polarized signals through the use of a wire grid and a compact arrangement of mirrors. The main goals of the study are the upgrade of the mixer architecture from Double-Sideband (DSB) to Sideband-separating (2SB), the extension of the IF and RF bandwidth, and the analysis of the possibilities of improving the polarimetric performance. We demonstrate the performance of 2SB mixers both in the lab and on-sky with the SEPIA660 receiver at APEX, which shows image rejection ratios exceeding 20 dB and can perform successful observations of several spectral lines close to the band edges. The same architecture in ALMA Band 9 would lead to an increase in the effective spectral sensitivity and a gain of a factor two in observation time. We set up also an electromagnetic model of the optics to simulate the polarization performance of the receivers, which is currently limited by the cross-polar level and the beam squint, i.e. pointing mismatch between the two polarizations. We present the results of the simulations compared to the measurements and we conclude that the use of a polarizing grid is the main responsible of the limitations.


title: ISAC 4D Imaging System Based on 5G Downlink Millimeter Wave Signal

abstract: Integrated Sensing and Communication(ISAC) has become a key technology for the 5th generation (5G) and 6th generation (6G) wireless communications due to its high spectrum utilization efficiency. Utilizing infrastructure such as 5G Base Stations (BS) to realize environmental imaging and reconstruction is important for promoting the construction of smart cities. Current 4D imaging methods utilizing Frequency Modulated Continuous Wave (FMCW) based Fast Fourier Transform (FFT) are not suitable for ISAC scenarios due to the higher bandwidth occupation and lower resolution. We propose a 4D (3D-Coordinates, Velocity) imaging method with higher sensing accuracy based on 2D-FFT with 2D-MUSIC utilizing standard 5G Downlink (DL) millimeter wave (mmWave) signals. To improve the sensing precision we also design a transceiver antenna array element arrangement scheme based on MIMO virtual aperture technique. We further propose a target detection algorithm based on multi-dimensional Constant False Alarm (CFAR) detection, which optimizes the ISAC imaging signal processing flow and reduces the computational pressure of signal processing. Simulation results show that our proposed method has better imaging results. The code is publicly available at https://github.com/MrHaobolu/ISAC\_4D\_IMaging.git.


title: Solution of Mismatched Monotone+Lipschitz Inclusion Problems

abstract: In this article, we study the convergence of algorithms for solving monotone inclusions in the presence of adjoint mismatch. The adjoint mismatch arises when the adjoint of a linear operator is replaced by an approximation, due to computational or physical issues. This occurs in inverse problems, particularly in computed tomography. In real Hilbert spaces, monotone inclusion problems involving a maximally $\rho$-monotone operator, a cocoercive operator, and a Lipschitzian operator can be solved by the Forward-Backward-Half-Forward and the Forward-Douglas-Rachford-Forward methods. We investigate the case of a mismatched Lipschitzian operator. We propose variants of the two aforementioned methods to cope with the mismatch, and establish conditions under which the weak convergence to a solution is guaranteed for these variants. The proposed algorithms hence enable each iteration to be implemented with a possibly iteration-dependent approximation to the mismatch operator, thus allowing this operator to be modified at each iteration. Finally, we present numerical experiments on a computed tomography example in material science, showing the applicability of our theoretical findings.