title: SpeechAct: Towards Generating Whole-body Motion from Speech

abstract: This paper addresses the problem of generating whole-body motion from speech. Despite great successes, prior methods still struggle to produce reasonable and diverse whole-body motions from speech. This is due to their reliance on suboptimal representations and a lack of strategies for generating diverse results. To address these challenges, we present a novel hybrid point representation to achieve accurate and continuous motion generation, e.g., avoiding foot skating, and this representation can be transformed into an easy-to-use representation, i.e., SMPL-X body mesh, for many applications. To generate whole-body motion from speech, for facial motion, closely tied to the audio signal, we introduce an encoder-decoder architecture to achieve deterministic outcomes. However, for the body and hands, which have weaker connections to the audio signal, we aim to generate diverse yet reasonable motions. To boost diversity in motion generation, we propose a contrastive motion learning method to encourage the model to produce more distinctive representations. Specifically, we design a robust VQ-VAE to learn a quantized motion codebook using our hybrid representation. Then, we regress the motion representation from the audio signal by a translation model employing our contrastive motion learning method. Experimental results validate the superior performance and the correctness of our model. The project page is available for research purposes at http://cic.tju.edu.cn/faculty/likun/projects/SpeechAct.


title: Linear structures in the set of non-norm-attaining operators on Banach spaces

abstract: We push further the study of lineability properties related to sets from norm-attaining theory. As a matter of fact, we provide several results in the context of lineability, spaceability, maximal-spaceability, and $(\alpha, \beta)$-spaceability for sets of non-norm-attaining bounded linear operators whenever such sets are non-empty. Our results concerning the cardinality of the linear subspaces are presented in a more general framework, where classical spaces of bounded linear operators between Banach spaces and their subsets are considered as special cases. This leads to new results and generalizes several ones from the literature.


title: Anticipations and Discoveries of the Heavy Hydrogen Isotopes, 1913-1939

abstract: Just as the chemical elements from hydrogen (Z = 1) to oganesson (Z = 118) once were discovered, so were the numerous isotopes. The histories of how the isotopes were discovered are less well known, but in a few cases they are as interesting and instructive as those of the elements figuring in the periodic table. Following an overview of criteria usually associated with the concept of discovery in general, this paper examines in detail the historical developments that led to the discoveries of deuterium and tritium and also, as a by-product, the helium-3 isotope. It also includes a brief section on the neutron, which in the 1920s, when it was still a hypothetical particle, was sometimes discussed together with the mass-2 and mass-3 hydrogen isotopes. The paper concludes with a discussion of priority questions relating to suggestions of the two heavy isotopes as well as to their actual discoveries.


title: SigFormer: Sparse Signal-Guided Transformer for Multi-Modal Human Action Segmentation

abstract: Multi-modal human action segmentation is a critical and challenging task with a wide range of applications. Nowadays, the majority of approaches concentrate on the fusion of dense signals (i.e., RGB, optical flow, and depth maps). However, the potential contributions of sparse IoT sensor signals, which can be crucial for achieving accurate recognition, have not been fully explored. To make up for this, we introduce a Sparse signalguided Transformer (SigFormer) to combine both dense and sparse signals. We employ mask attention to fuse localized features by constraining cross-attention within the regions where sparse signals are valid. However, since sparse signals are discrete, they lack sufficient information about the temporal action boundaries. Therefore, in SigFormer, we propose to emphasize the boundary information at two stages to alleviate this problem. In the first feature extraction stage, we introduce an intermediate bottleneck module to jointly learn both category and boundary features of each dense modality through the inner loss functions. After the fusion of dense modalities and sparse signals, we then devise a two-branch architecture that explicitly models the interrelationship between action category and temporal boundary. Experimental results demonstrate that SigFormer outperforms the state-of-the-art approaches on a multi-modal action segmentation dataset from real industrial environments, reaching an outstanding F1 score of 0.958. The codes and pre-trained models have been available at https://github.com/LIUQI-creat/SigFormer.


title: TARGET: Template-Transferable Backdoor Attack Against Prompt-based NLP Models via GPT4

abstract: Prompt-based learning has been widely applied in many low-resource NLP tasks such as few-shot scenarios. However, this paradigm has been shown to be vulnerable to backdoor attacks. Most of the existing attack methods focus on inserting manually predefined templates as triggers in the pre-training phase to train the victim model and utilize the same triggers in the downstream task to perform inference, which tends to ignore the transferability and stealthiness of the templates. In this work, we propose a novel approach of TARGET (Template-trAnsfeRable backdoor attack aGainst prompt-basEd NLP models via GPT4), which is a data-independent attack method. Specifically, we first utilize GPT4 to reformulate manual templates to generate tone-strong and normal templates, and the former are injected into the model as a backdoor trigger in the pre-training phase. Then, we not only directly employ the above templates in the downstream task, but also use GPT4 to generate templates with similar tone to the above templates to carry out transferable attacks. Finally we have conducted extensive experiments on five NLP datasets and three BERT series models, with experimental results justifying that our TARGET method has better attack performance and stealthiness compared to the two-external baseline methods on direct attacks, and in addition achieves satisfactory attack capability in the unseen tone-similar templates.


title: A spatial analysis of COVID-19 reported cases in the Gauteng province, South Africa: Identifying wards to be targeted early in future infectious diseases outbreak

abstract: The COVID-19 pandemic caused major disruptions and contributed to the loss of livelihoods and income. The pandemic also provided public health and health systems policy shifts towards better promotion and protection in responding to such disasters and emergencies. Due to differing effects of socio-economic infectious disease vulnerabilities and pre-pandemic levels of preparedness for health emergencies, health system strengthening requires targeted and ununiform implementation. We employ spatial statistical methods on the COVID-19 confirmed cases in identifying wards that could be targeted for strengthening health security in the Gauteng Province, South Africa. In this way, the identified high-risk wards would be more effective and prepared to respond to future pandemics and emergencies.


title: Grounding Foundation Models through Federated Transfer Learning: A General Framework

abstract: Foundation Models (FMs) such as GPT-4 encoded with vast knowledge and powerful emergent abilities have achieved remarkable success in various natural language processing and computer vision tasks. Grounding FMs by adapting them to domain-specific tasks or augmenting them with domain-specific knowledge enables us to exploit the full potential of FMs. However, grounding FMs faces several challenges, stemming primarily from constrained computing resources, data privacy, model heterogeneity, and model ownership. Federated Transfer Learning (FTL), the combination of federated learning and transfer learning, provides promising solutions to address these challenges. In recent years, the need for grounding FMs leveraging FTL, coined FTL-FM, has arisen strongly in both academia and industry. Motivated by the strong growth in FTL-FM research and the potential impact of FTL-FM on industrial applications, we propose an FTL-FM framework that formulates problems of grounding FMs in the federated learning setting, construct a detailed taxonomy based on the FTL-FM framework to categorize state-of-the-art FTL-FM works, and comprehensively overview FTL-FM works based on the proposed taxonomy. We also establish correspondences between FTL-FM and conventional phases of adapting FM so that FM practitioners can align their research works with FTL-FM. In addition, we overview advanced efficiency-improving and privacy-preserving techniques because efficiency and privacy are critical concerns in FTL-FM. Last, we discuss opportunities and future research directions of FTL-FM.


title: Evolutionary accessibility of random and structured fitness landscapes

abstract: Biological evolution can be conceptualized as a search process in the space of gene sequences guided by the fitness landscape, a mapping that assigns a measure of reproductive value to each genotype. Here we discuss probabilistic models of fitness landscapes with a focus on their evolutionary accessibility, where a path in a fitness landscape is said to be accessible if the fitness values encountered along the path increase monotonically. For uncorrelated (random) landscapes with independent and identically distributed fitness values, the probability of existence of accessible paths between genotypes at a distance linear in the sequence length $L$ becomes nonzero at a nontrivial threshold value of the fitness difference between the initial and final genotype, which can be explicitly computed for large classes of genotype graphs. The behaviour in uncorrelated random landscapes is contrasted with landscape models that display additional, biologically motivated structural features. In particular, landscapes defined by a tradeoff between adaptation to environmental extremes have been found to display a combinatorially large number of accessible paths to all local fitness maxima. We show that this property is characteristic of a broad class of models that satisfy a certain global constraint, and provide further examples from this class.


title: Cospectrality results for signed graphs with two eigenvalues unequal to $\pm 1$

abstract: Recently the collection $\cal G$ of all signed graphs for which the adjacency matrix has all but at most two eigenvalues equal to $\pm 1$ has been determined. Here we investigate $\cal G$ for cospectral pairs, and for signed graphs determined by their spectrum (up to switching). If the order is at most 20, the outcome is presented in a clear table. If the spectrum is symmetric we find all signed graphs in $\cal G$ determined by their spectrum, and we obtain all signed graphs cospectral with the bipartite double of the complete graph. In addition we determine all signed graphs cospectral with the Friendship graph $F_\ell$, and show that there is no connected signed graph cospectral but not switching equivalent with $F_\ell$.


title: Group-wise Sparse and Explainable Adversarial Attacks

abstract: Sparse adversarial attacks fool deep neural networks (DNNs) through minimal pixel perturbations, typically regularized by the $\ell_0$ norm. Recent efforts have replaced this norm with a structural sparsity regularizer, such as the nuclear group norm, to craft group-wise sparse adversarial attacks. The resulting perturbations are thus explainable and hold significant practical relevance, shedding light on an even greater vulnerability of DNNs than previously anticipated. However, crafting such attacks poses an optimization challenge, as it involves computing norms for groups of pixels within a non-convex objective. In this paper, we tackle this challenge by presenting an algorithm that simultaneously generates group-wise sparse attacks within semantically meaningful areas of an image. In each iteration, the core operation of our algorithm involves the optimization of a quasinorm adversarial loss. This optimization is achieved by employing the $1/2$-quasinorm proximal operator for some iterations, a method tailored for nonconvex programming. Subsequently, the algorithm transitions to a projected Nesterov's accelerated gradient descent with $2$-norm regularization applied to perturbation magnitudes. We rigorously evaluate the efficacy of our novel attack in both targeted and non-targeted attack scenarios, on CIFAR-10 and ImageNet datasets. When compared to state-of-the-art methods, our attack consistently results in a remarkable increase in group-wise sparsity, e.g., an increase of $48.12\%$ on CIFAR-10 and $40.78\%$ on ImageNet (average case, targeted attack), all while maintaining lower perturbation magnitudes. Notably, this performance is complemented by a significantly faster computation time and a $100\%$ attack success rate.


title: MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning

abstract: We present MM-Narrator, a novel system leveraging GPT-4 with multimodal in-context learning for the generation of audio descriptions (AD). Unlike previous methods that primarily focused on downstream fine-tuning with short video clips, MM-Narrator excels in generating precise audio descriptions for videos of extensive lengths, even beyond hours, in an autoregressive manner. This capability is made possible by the proposed memory-augmented generation process, which effectively utilizes both the short-term textual context and long-term visual memory through an efficient register-and-recall mechanism. These contextual memories compile pertinent past information, including storylines and character identities, ensuring an accurate tracking and depicting of story-coherent and character-centric audio descriptions. Maintaining the training-free design of MM-Narrator, we further propose a complexity-based demonstration selection strategy to largely enhance its multi-step reasoning capability via few-shot multimodal in-context learning (MM-ICL). Experimental results on MAD-eval dataset demonstrate that MM-Narrator consistently outperforms both the existing fine-tuning-based approaches and LLM-based approaches in most scenarios, as measured by standard evaluation metrics. Additionally, we introduce the first segment-based evaluator for recurrent text generation. Empowered by GPT-4, this evaluator comprehensively reasons and marks AD generation performance in various extendable dimensions.


title: Nodal cluster solutions for the Brezis-Nirenberg problem in dimensions $N\geq 7$

abstract: We show that the classical Brezis-Nirenberg problem $$\Delta u + |u|^{4 \over N-2} u + \varepsilon u = 0 ,\quad {\mbox {in}} \quad \Omega, \quad u= 0 , \quad {\mbox {on}} \quad \partial \Omega$$ admits nodal solutions clustering around a point on the boundary of $\Omega$ as $\varepsilon \to 0$, for smooth bounded domains $\Omega \subset \mathbb{R}^N $ in dimensions $N\geq 7$.


title: Robust network formation with biological applications

abstract: We provide new results on the structure of optimal transportation networks obtained as minimizers of an energy cost functional consisting of a kinetic (pumping) and material (metabolic) cost terms, constrained by a local mass conservation law. In particular, we prove that every tree (i.e., graph without loops) represents a local minimizer of the energy with concave metabolic cost. For the linear metabolic cost, we prove that the set of minimizers contains a loop-free structure. Moreover, we enrich the energy functional such that it accounts also for robustness of the network, measured in terms of the Fiedler number of the graph with edge weights given by their conductivities. We examine fundamental properties of the modified functional, in particular, its convexity and differentiability. We provide analytical insights into the new model by considering two simple examples. Subsequently, we employ the projected subgradient method to find global minimizers of the modified functional numerically. We then present two numerical examples, illustrating how the optimal graph's structure and energy expenditure depend on the required robustness of the network.


title: CLOMO: Counterfactual Logical Modification with Large Language Models

abstract: In this study, we delve into the realm of counterfactual reasoning capabilities of large language models (LLMs). Our primary objective is to cultivate the counterfactual thought processes within LLMs and rigorously assess these processes for their validity. Specifically, we introduce a novel task, Counterfactual Logical Modification (CLOMO), and a high-quality human-annotated benchmark. In this task, LLMs must adeptly alter a given argumentative text to uphold a predetermined logical relationship. To effectively evaluate a generation model's counterfactual capabilities, we propose an innovative evaluation metric, the decomposed Self-Evaluation Score (SES) to directly evaluate the natural language output of LLMs instead of modeling the task as a multiple-choice problem. Analysis shows that the proposed automatic metric aligns well with human preference. Our experimental results show that while LLMs demonstrate a notable capacity for logical counterfactual thinking, there remains a discernible gap between their current abilities and human performance. Code and data are available at https://github.com/Eleanor-H/CLOMO.


title: From the gravitational waves to the exoplanets: the Research Highlights

abstract: In this Research Highlights, we summarize 31 contributions provided during the Workshop \textit{Multifrequency Behaviour of High Energy Cosmic Sources - XIV}, held in Palermo (Italy) from the 12th to the 17th of June 2023. We will start with the most recent discoveries in the field of gravitational waves (GWs). We will connect this topic to the contributions of Gamma-Ray Bursts (GRBs) associated with GWs and with the Kilonovae (KNe) hunting and, more in general, on GRBs. Continuing on high-energy astrophysics objects, we will delve into Active Galactic Nuclei (AGNs), neutrino astronomy and the study of the primordial universe, both from the space telescopes' observation and from the very recent proposals in terms of cosmological models. From the faraway universe, we will move to the more local scales and discuss the recent observations in Supernova Remnants (SNRs), massive star binaries, globular cluster dynamics, and exoplanets observed by Kepler.


title: Violating Constant Degree Hypothesis Requires Breaking Symmetry

abstract: The Constant Degree Hypothesis was introduced by Barrington et. al. (1990) to study some extensions of $q$-groups by nilpotent groups and the power of these groups in a certain computational model. In its simplest formulation, it establishes exponential lower bounds for $\mathrm{AND}_d \circ \mathrm{MOD}_m \circ \mathrm{MOD}_q$ circuits computing AND of unbounded arity $n$ (for constant integers $d,m$ and a prime $q$). While it has been proved in some special cases (including $d=1$), it remains wide open in its general form for over 30 years. In this paper we prove that the hypothesis holds when we restrict our attention to symmetric circuits with $m$ being a prime. While we build upon techniques by Grolmusz and Tardos (2000), we have to prove a new symmetric version of their Degree Decreasing Lemma and apply it in a highly non-trivial way. Moreover, to establish the result we perform a careful analysis of automorphism groups of $\mathrm{AND} \circ \mathrm{MOD}_m$ subcircuits and study the periodic behaviour of the computed functions. Finally, our methods also yield lower bounds when $d$ is treated as a function of $n$.


title: Asynchronous Merkle Trees

abstract: Merkle trees have become a widely successful cryptographic data structure. Enabling a vast variety of applications from checking for inconsistencies in databases like Dynamo to essential tools like Git to large scale distributed systems like Bitcoin and other blockchains. There have also been various versions of Merkle trees like Jellyfish Merkle Trees and Sparse Merkle Trees designed for different applications. However, one key drawback of all these Merkle trees is that with a large data set the cost of computing the tree increases significantly, moreover insert operations on a single leaf require re-building the entire tree. For certain use cases building the tree this way is acceptable, however in environments where compute time needs to be as low as possible and where data is processed in parallel, we are presented with a need for asynchronous computation. This paper proposes a solution where given a batch of data that has to be processed concurrently, a Merkle Tree can be constructed from the batch asynchronously without needing to recalculate the tree for every insert.


title: Quantifying Nonradiative Recombination and Resistive Losses in Perovskite Photovoltaics: A Modified Diode Model Approach

abstract: Pinpointing the origin of inefficiency can expedite the process of optimizing the efficiency of perovskite photovoltaics. However, it is challenging to discern and quantify the different loss pathways in a complete perovskite photovoltaic device under operational conditions. To address this challenge, we propose a modified diode model that can quantify bulk/interface defect-assisted recombination and series/shunt resistive losses. By adopting drift-diffusion simulation as the benchmark, we explore the physical meanings of the modified diode model parameters and evaluate the performance of the model for simulation parameters spanning many orders of magnitude. Our evaluation shows that, in most practical cases, the proposed model can accurately quantify all the aforementioned losses, and in some special cases, it is possible to identify the predominant loss pathway. Moreover, we apply the modified diode model to our lab-produced devices (based on Cs0.05FA0.95PbI3 perovskites), demonstrating its effectiveness in quantifying entangled losses in practice. Finally, we provide a set of guidelines for applying the modified diode model and interpreting the results. Source code available at https://github.com/WPT-Lab124/Modified-Diode-Model.


title: Power system investment optimization to identify carbon neutrality scenarios for Italy

abstract: In 2021, the European Commission has adopted the Fit-for-55 policy package, legally binding European countries to reduce their CO2 emissions by 55% with respect to 1990, a first step to achieve carbon neutrality in 2050. In this context, it is crucial to help national policymakers to choose the most appropriate technologies to achieve these goals and energy system modelling can be a valuable tool. This article presents a model of the Italian power system realized employing the open energy modelling framework Oemof. A Linear Programming Optimization is implemented to evaluate how to minimise system costs at decreasing CO2 emissions in 2030. The developed tool is applied to evaluate different research questions: i) pathway towards full decarbonization and power self-sufficiency of the electricity sector in Italy, ii) relevance of flexibility assets in power grids: li-ion batteries, hydrogen storage and transmission lines reinforcement. A 55% CO2 emissions reduction for the actual Italian power sector can be achieved through an increase of 30% of the total annual system cost. Full decarbonization can be reached with four times today's annual costs, which could be lowered with sector coupling and considering more technologies.


title: Genuine tripartite entanglement in a mixed spin-(1/2,1) Heisenberg tetramer

abstract: A genuine tripartite entanglement of a mixed spin-(1/2,1) Heisenberg tetramer is rigorously analyzed in a presence of external magnetic field. The couple of mixed spin-(1/2,1) dimers is arranged in a perfect rectangular square plaquette involving two nonequivalent Heisenberg exchange couplings $J$ and $J_1$. The degree of a genuine tripartite entanglement is evaluated according to the genuine tripartite negativity ${\cal N}_{ABC}$ defined as a geometric mean of all possible bipartite negativities corresponding to a decomposition into a single spin and the remaining spin dimer ${\cal N}_{A|BC}$, ${\cal N}_{B|AC}$ and ${\cal N}_{C|AB}$ after degrees of freedom of the last fourth spin $D$ are traced out. Due to the symmetry of a mixed spin-(1/2,1) Heisenberg tetramer two different genuine tripartite negativities for the trimeric system $1/2\!-\!1\!-\!1$ and $1/2\!-\!1/2\!-\!1$ were identified. It was found that the genuine tripartite negativity for the interaction ratio $J_1/J\!<\!1$ becomes nonzero solely in the tripartite system $1/2\!-\!1\!-\!1$ at low-enough magnetic fields. The opposite interaction limit $J_1/J\!>\!1$ gives rise to the nonzero genuine tripartite negativity in both tripartite systems in a presence of external magnetic field until the classical ferromagnetic state is achieved. It was shown, that the genuine tripartite negativity of a mixed spin-(1/2,1) Heisenberg tetramer can be detected also at nonzero temperatures. An enhancement of the thermal genuine tripartite negativity through the enlargement of the total spin number of a tripartite system is evidenced. The correlation between the bipartite negativity of two spins and the genuine tripartite negativity is discussed in detail.


title: Interaction tests with covariate-adaptive randomization

abstract: Treatment-covariate interaction tests are commonly applied by researchers to examine whether the treatment effect varies across patient subgroups defined by baseline characteristics. The objective of this study is to explore treatment-covariate interaction tests involving covariate-adaptive randomization. Without assuming a parametric data generating model, we investigate usual interaction tests and observe that they tend to be conservative: specifically, their limiting rejection probabilities under the null hypothesis do not exceed the nominal level and are typically strictly lower than it. To address this problem, we propose modifications to the usual tests to obtain corresponding valid tests. Moreover, we introduce a novel class of stratified-adjusted interaction tests that are simple, more powerful than the usual and modified tests, and broadly applicable to most covariate-adaptive randomization methods. The results are general to encompass two types of interaction tests: one involving stratification covariates and the other involving additional covariates that are not used for randomization. Our study clarifies the application of interaction tests in clinical trials and offers valuable tools for revealing treatment heterogeneity, crucial for advancing personalized medicine.


title: Uncertainty in Additive Feature Attribution methods

abstract: In this work, we explore various topics that fall under the umbrella of Uncertainty in post-hoc Explainable AI (XAI) methods. We in particular focus on the class of additive feature attribution explanation methods. We first describe our specifications of uncertainty and compare various statistical and recent methods to quantify the same. Next, for a particular instance, we study the relationship between a feature's attribution and its uncertainty and observe little correlation. As a result, we propose a modification in the distribution from which perturbations are sampled in LIME-based algorithms such that the important features have minimal uncertainty without an increase in computational cost. Next, while studying how the uncertainty in explanations varies across the feature space of a classifier, we observe that a fraction of instances show near-zero uncertainty. We coin the term "stable instances" for such instances and diagnose factors that make an instance stable. Next, we study how an XAI algorithm's uncertainty varies with the size and complexity of the underlying model. We observe that the more complex the model, the more inherent uncertainty is exhibited by it. As a result, we propose a measure to quantify the relative complexity of a blackbox classifier. This could be incorporated, for example, in LIME-based algorithms' sampling densities, to help different explanation algorithms achieve tighter confidence levels. Together, the above measures would have a strong impact on making XAI models relatively trustworthy for the end-user as well as aiding scientific discovery.


title: Learning-driven Zero Trust in Distributed Computing Continuum Systems

abstract: Converging Zero Trust (ZT) with learning techniques can solve various operational and security challenges in Distributed Computing Continuum Systems (DCCS). Implementing centralized ZT architecture is seen as unsuitable for the computing continuum (e.g., computing entities with limited connectivity and visibility, etc.). At the same time, implementing decentralized ZT in the computing continuum requires understanding infrastructure limitations and novel approaches to enhance resource access management decisions. To overcome such challenges, we present a novel learning-driven ZT conceptual architecture designed for DCCS. We aim to enhance ZT architecture service quality by incorporating lightweight learning strategies such as Representation Learning (ReL) and distributing ZT components across the computing continuum. The ReL helps to improve the decision-making process by predicting threats or untrusted requests. Through an illustrative example, we show how the learning process detects and blocks the requests, enhances resource access control, and reduces network and computation overheads. Lastly, we discuss the conceptual architecture, processes, and provide a research agenda.


title: On the commutator modulus of continuity for operator monotone functions

abstract: Let $f \geq 0$ be operator monotone on $[0, \infty)$. In this paper we prove that for any unitarily-invariant norm $|||-|||$ on $M_n(\mathbb{C})$ and matrices $A, B, X \in M_n(\mathbb{C})$ with $A, B \geq 0$ and $|||X||| \leq 1$, \[|||f(A)X-Xf(B)||| \leq C f(|||AX-XB|||)\] for $C < 1.01975$. We do this by reducing this inequality to a function approximation problem and we choose approximate minimizers. This is much progress toward the conjecturally optimal value of $C=1$ which is known only in the case of the Hilbert-Schmidt norm. When $|||-|||$ is the the operator norm $||-||$, we obtain a great reduction of the previously known estimate of $C = 1.25$. We further prove that for $|||X||| \leq 1$, \[|||A^{1/2}X-XB^{1/2}||| \leq 1.00891 |||AX-XB|||.\] This is a great improvement toward the conjecture of G. Pedersen that this inequality for $|||-|||$ being the operator norm holds with $C = 1$. We discuss other related inequalities, including some sharp commutator inequalities. We also prove a sharp equivalence inequality between the operator modulus of continuity and the commutator modulus of continuity for continuous functions on $\mathbb{R}$.


title: Weakly-semi-supervised object detection in remotely sensed imagery

abstract: Deep learning for detecting objects in remotely sensed imagery can enable new technologies for important applications including mitigating climate change. However, these models often require large datasets labeled with bounding box annotations which are expensive to curate, prohibiting the development of models for new tasks and geographies. To address this challenge, we develop weakly-semi-supervised object detection (WSSOD) models on remotely sensed imagery which can leverage a small amount of bounding boxes together with a large amount of point labels that are easy to acquire at scale in geospatial data. We train WSSOD models which use large amounts of point-labeled images with varying fractions of bounding box labeled images in FAIR1M and a wind turbine detection dataset, and demonstrate that they substantially outperform fully supervised models trained with the same amount of bounding box labeled images on both datasets. Furthermore, we find that the WSSOD models trained with 2-10x fewer bounding box labeled images can perform similarly to or outperform fully supervised models trained on the full set of bounding-box labeled images. We believe that the approach can be extended to other remote sensing tasks to reduce reliance on bounding box labels and increase development of models for impactful applications.


title: Continual Learning for Image Segmentation with Dynamic Query

abstract: Image segmentation based on continual learning exhibits a critical drop of performance, mainly due to catastrophic forgetting and background shift, as they are required to incorporate new classes continually. In this paper, we propose a simple, yet effective Continual Image Segmentation method with incremental Dynamic Query (CISDQ), which decouples the representation learning of both old and new knowledge with lightweight query embedding. CISDQ mainly includes three contributions: 1) We define dynamic queries with adaptive background class to exploit past knowledge and learn future classes naturally. 2) CISDQ proposes a class/instance-aware Query Guided Knowledge Distillation strategy to overcome catastrophic forgetting by capturing the inter-class diversity and intra-class identity. 3) Apart from semantic segmentation, CISDQ introduce the continual learning for instance segmentation in which instance-wise labeling and supervision are considered. Extensive experiments on three datasets for two tasks (i.e., continual semantic and instance segmentation are conducted to demonstrate that CISDQ achieves the state-of-the-art performance, specifically, obtaining 4.4% and 2.9% mIoU improvements for the ADE 100-10 (6 steps) setting and ADE 100-5 (11 steps) setting.


title: Wireless Network Digital Twin for 6G: Generative AI as A Key Enabler

abstract: Digital twin, which enables emulation, evaluation, and optimization of physical entities through synchronized digital replicas, has gained increasing attention as a promising technology for intricate wireless networks. For 6G, numerous innovative wireless technologies and network architectures have posed new challenges in establishing wireless network digital twins. To tackle these challenges, artificial intelligence (AI), particularly the flourishing generative AI, emerges as a potential solution. In this article, we discuss emerging prerequisites for wireless network digital twins considering the complicated network architecture, tremendous network scale, extensive coverage, and diversified application scenarios in the 6G era. We further explore the applications of generative AI, such as Transformer and diffusion model, to empower the 6G digital twin from multiple perspectives including physical-digital modeling, synchronization, and slicing capability. Subsequently, we propose a hierarchical generative AI-enabled wireless network digital twin at both the message-level and policy-level, and provide a typical use case with numerical results to validate the effectiveness and efficiency. Finally, open research issues for wireless network digital twins in the 6G era are discussed.


title: Nonnatural automorphisms of the Hilbert scheme of two points of some simple abelian variety

abstract: We construct nonnatural automorphisms of the Hilbert scheme of two points of some simple abelian variety preserving the big diagonal by considering automorphisms of the n-th product of the abelian varieties.


title: Privacy Measurement in Tabular Synthetic Data: State of the Art and Future Research Directions

abstract: Synthetic data (SD) have garnered attention as a privacy enhancing technology. Unfortunately, there is no standard for quantifying their degree of privacy protection. In this paper, we discuss proposed quantification approaches. This contributes to the development of SD privacy standards; stimulates multi-disciplinary discussion; and helps SD researchers make informed modeling and evaluation decisions.


title: Eden: An Ultra Fast, Provably Secure, and Fully Decentralized Blockchain Interoperability Protocol

abstract: As the blockchain ecosystem continues to evolve and expand, the need for seamless interoperability between disparate blockchain networks has become increasingly paramount. Interoperability not only enhances the functionality and reach of individual blockchains but also fosters a collaborative environment that can unlock new possibilities for decentralized applications. In this paper, we present Eden, an elastic decentralized envoy network that leverage zero-knowledge MapReduce framework to facilitates ultra-fast and secure cross-chain communication while maintaining complete decentralization. We detail the Eden's design choices, its comprehensive security model, and the innovative mechanisms it incorporates to ensure elasticity and resilience, even under challenging network conditions.


title: Experimental Generation of Spin-Photon Entanglement in Silicon Carbide

abstract: A solid-state approach for quantum networks is advantages, as it allows the integration of nanophotonics to enhance the photon emission and the utilization of weakly coupled nuclear spins for long-lived storage. Silicon carbide, specifically point defects within it, shows great promise in this regard due to the easy of availability and well-established nanofabrication techniques. Despite of remarkable progresses made, achieving spin-photon entanglement remains a crucial aspect to be realized. In this paper, we experimentally generate entanglement between a silicon vacancy defect in silicon carbide and a scattered single photon in the zero-phonon line. The spin state is measured by detecting photons scattered in the phonon sideband. The photonic qubit is encoded in the time-bin degree-of-freedom and measured using an unbalanced Mach-Zehnder interferometer. Photonic correlations not only reveal the quality of the entanglement but also verify the deterministic nature of the entanglement creation process. By harnessing two pairs of such spin-photon entanglement, it becomes straightforward to entangle remote quantum nodes at long distance.


title: DifFlow3D: Toward Robust Uncertainty-Aware Scene Flow Estimation with Diffusion Model

abstract: Scene flow estimation, which aims to predict per-point 3D displacements of dynamic scenes, is a fundamental task in the computer vision field. However, previous works commonly suffer from unreliable correlation caused by locally constrained searching ranges, and struggle with accumulated inaccuracy arising from the coarse-to-fine structure. To alleviate these problems, we propose a novel uncertainty-aware scene flow estimation network (DifFlow3D) with the diffusion probabilistic model. Iterative diffusion-based refinement is designed to enhance the correlation robustness and resilience to challenging cases, e.g. dynamics, noisy inputs, repetitive patterns, etc. To restrain the generation diversity, three key flow-related features are leveraged as conditions in our diffusion model. Furthermore, we also develop an uncertainty estimation module within diffusion to evaluate the reliability of estimated scene flow. Our DifFlow3D achieves state-of-the-art performance, with 24.0% and 29.1% EPE3D reduction respectively on FlyingThings3D and KITTI 2015 datasets. Notably, our method achieves an unprecedented millimeter-level accuracy (0.0078m in EPE3D) on the KITTI dataset. Additionally, our diffusion-based refinement paradigm can be readily integrated as a plug-and-play module into existing scene flow networks, significantly increasing their estimation accuracy. Codes are released at https://github.com/IRMVLab/DifFlow3D.


title: Electric Field-induced Charge Transport in Redox-active Molecular Junctions

abstract: The formation of well-defined three-dimensional (3D) redox-active molecular nanostructures at the electrode surfaces may open additional routes to achieve higher conductance in molecular junctions (MJs). We report here experimental and theoretical charge transport analysis on electroactive ruthenium(II)-tri(phenanthroline) [Ru(Phen)3]-based molecular junctions covalently grown on patterned ITO electrode. Thicknesses of the molecular layers are varied between 4 to 13 nm, thanks to the potential-driven electrochemical technique to achieve it. A thin layer of Al was deposited on top contact over ITO/ Ru(Phen)3 to fabricate large-area solid-state molecular junctions with a stacking configuration of ITO/[Ru(Phen)3]4nm, 10nm, 13nm/Al. The electrified molecular junctions show LUMO-mediated electron-driven resonant charge conduction with attenuation in conductance as a function of the length of Ru(Phen)3 layers (\b{eta} = 0.48 to 0.60 nm-1). Molecular junctions consisting of 4 nm Ru(Phen)3 layers follow quantum tunneling, while the thicker junctions (10, and 13 nm) follow Poole-Frenkel and electric-field induced charge conduction. Considering the energy level of frontier molecular orbitals, Fermi energy of ITO, and Al contact, a mechanism of symmetric current-voltage features with respect to the bias-polarity is predicted. The present work describes a simple, controllable, low-cost, and versatile approach to fabricating 3D molecular assembly for mimicking conventional electronic functions.


title: Quantum Neural Networks under Depolarization Noise: Exploring White-Box Attacks and Defenses

abstract: Leveraging the unique properties of quantum mechanics, Quantum Machine Learning (QML) promises computational breakthroughs and enriched perspectives where traditional systems reach their boundaries. However, similarly to classical machine learning, QML is not immune to adversarial attacks. Quantum adversarial machine learning has become instrumental in highlighting the weak points of QML models when faced with adversarial crafted feature vectors. Diving deep into this domain, our exploration shines light on the interplay between depolarization noise and adversarial robustness. While previous results enhanced robustness from adversarial threats through depolarization noise, our findings paint a different picture. Interestingly, adding depolarization noise discontinued the effect of providing further robustness for a multi-class classification scenario. Consolidating our findings, we conducted experiments with a multi-class classifier adversarially trained on gate-based quantum simulators, further elucidating this unexpected behavior.


title: Hamiltonian analysis of metric-affine-$R^2$ theory

abstract: Determining the number of propagating degrees of freedom in metric-affine theories of gravity requires the use of Hamiltonian constraint analysis, except in some subclasses of theories. We develop the technicalities necessary for such analyses and apply them to the Weyl-invariant and projective-invariant case of metric-affine-$R^2$ theory that is known to propagate just the graviton. This serves as a check of the formalism and a case study where we introduce appropriate ADM variables for the distortion 3-tensor tensor and its time derivatives, that will be useful when analyzing more general metric-affine theories where the physical spectrum is not known.


title: W-HMR: Human Mesh Recovery in World Space with Weak-supervised Camera Calibration and Orientation Correction

abstract: For a long time, in reconstructing 3D human bodies from monocular images, most methods opted to simplify the task by minimizing the influence of the camera. Using a coarse focal length setting results in the reconstructed bodies not aligning well with distorted images. Ignoring camera rotation leads to an unrealistic reconstructed body pose in world space. Consequently, the application scenarios of existing methods are confined to controlled environments. When confronted with complex and diverse in-the-wild images, they struggle to achieve accurate and reasonable reconstruction in world space. To address the above issues, we propose W-HMR, which decouples global body recovery into camera calibration, local body recovery, and global body orientation correction. We design the first weak-supervised camera calibration method for body distortion, eliminating dependence on focal length labels and achieving finer mesh-image alignment. We propose a novel orientation correction module to allow the reconstructed human body to remain normal in world space. Decoupling body orientation and body pose enables our model to consider the accuracy in camera coordinate and the reasonableness in world coordinate simultaneously, expanding the range of applications. As a result, W-HMR achieves high-quality reconstruction in dual coordinate systems, particularly in challenging scenes. Codes and demos have been released on the project page https://yw0208.github.io/w-hmr/.


title: When StyleGAN Meets Stable Diffusion: a $\mathscr{W}_+$ Adapter for Personalized Image Generation

abstract: Text-to-image diffusion models have remarkably excelled in producing diverse, high-quality, and photo-realistic images. This advancement has spurred a growing interest in incorporating specific identities into generated content. Most current methods employ an inversion approach to embed a target visual concept into the text embedding space using a single reference image. However, the newly synthesized faces either closely resemble the reference image in terms of facial attributes, such as expression, or exhibit a reduced capacity for identity preservation. Text descriptions intended to guide the facial attributes of the synthesized face may fall short, owing to the intricate entanglement of identity information with identity-irrelevant facial attributes derived from the reference image. To address these issues, we present the novel use of the extended StyleGAN embedding space $\mathcal{W}_+$, to achieve enhanced identity preservation and disentanglement for diffusion models. By aligning this semantically meaningful human face latent space with text-to-image diffusion models, we succeed in maintaining high fidelity in identity preservation, coupled with the capacity for semantic editing. Additionally, we propose new training objectives to balance the influences of both prompt and identity conditions, ensuring that the identity-irrelevant background remains unaffected during facial attribute modifications. Extensive experiments reveal that our method adeptly generates personalized text-to-image outputs that are not only compatible with prompt descriptions but also amenable to common StyleGAN editing directions in diverse settings. Our source code will be available at \url{https://github.com/csxmli2016/w-plus-adapter}.


title: Lower bound on the radii of light rings in traceless black-hole spacetimes

abstract: Photonspheres, curved hypersurfaces on which massless particles can perform closed geodesic motions around highly compact objects, are an integral part of generic black-hole spacetimes. In the present compact paper we prove, using analytical techniques, that the innermost light rings of spherically symmetric hairy black-hole spacetimes whose external matter fields are characterized by a traceless energy-momentum tensor cannot be located arbitrarily close to the central black hole. In particular, we reveal the physically interesting fact that the non-linearly coupled Einstein-matter field equations set the lower bound $r_{\gamma}\geq {6\over5}r_{\text{H}}$ on the radii of traceless black-hole photonspheres, where $r_{\text{H}}$ is the radius of the outermost black-hole horizon.


title: Constructing Optimal $L_{\infty}$ Star Discrepancy Sets

abstract: The $L_{\infty}$ star discrepancy is a very well-studied measure used to quantify the uniformity of a point set distribution. Constructing optimal point sets for this measure is seen as a very hard problem in the discrepancy community. Indeed, optimal point sets are, up to now, known only for $n\leq 6$ in dimension 2 and $n \leq 2$ for higher dimensions. We introduce in this paper mathematical programming formulations to construct point sets with as low $L_{\infty}$ star discrepancy as possible. Firstly, we present two models to construct optimal sets and show that there always exist optimal sets with the property that no two points share a coordinate. Then, we provide possible extensions of our models to other measures, such as the extreme and periodic discrepancies. For the $L_{\infty}$ star discrepancy, we are able to compute optimal point sets for up to 21 points in dimension 2 and for up to 8 points in dimension 3. For $d=2$ and $n\ge 7$ points, these point sets have around a 50% lower discrepancy than the current best point sets, and show a very different structure.


title: Distribution of a bipartite entanglement in a mixed spin-(1/2,1) Heisenberg tetramer

abstract: The distribution of bipartite entanglement in a mixed spin-(1/2,1) Heisenberg tetramer composed from two spin-1/2 and two spin-1 entities is investigated in detail in presence of an external magnetic field. Four different negativities measuring a strength of bipartite entanglement are analyzed at zero and non-zero temperatures. Derived rigorous analytic results and respective numerical results are discussed with the particular emphasis laid on the significance of a strength of the pair spin-spin interactions and spin diversity in the entanglement description. Based on both aforementioned driving forces the regions of parametric space, where the bipartite entanglement can exist solely for one type of spin pair or all four spin pairs, were identified.


title: AgentAvatar: Disentangling Planning, Driving and Rendering for Photorealistic Avatar Agents

abstract: In this study, our goal is to create interactive avatar agents that can autonomously plan and animate nuanced facial movements realistically, from both visual and behavioral perspectives. Given high-level inputs about the environment and agent profile, our framework harnesses LLMs to produce a series of detailed text descriptions of the avatar agents' facial motions. These descriptions are then processed by our task-agnostic driving engine into motion token sequences, which are subsequently converted into continuous motion embeddings that are further consumed by our standalone neural-based renderer to generate the final photorealistic avatar animations. These streamlined processes allow our framework to adapt to a variety of non-verbal avatar interactions, both monadic and dyadic. Our extensive study, which includes experiments on both newly compiled and existing datasets featuring two types of agents -- one capable of monadic interaction with the environment, and the other designed for dyadic conversation -- validates the effectiveness and versatility of our approach. To our knowledge, we advanced a leap step by combining LLMs and neural rendering for generalized non-verbal prediction and photo-realistic rendering of avatar agents.


title: Slot-Mixup with Subsampling: A Simple Regularization for WSI Classification

abstract: Whole slide image (WSI) classification requires repetitive zoom-in and out for pathologists, as only small portions of the slide may be relevant to detecting cancer. Due to the lack of patch-level labels, multiple instance learning (MIL) is a common practice for training a WSI classifier. One of the challenges in MIL for WSIs is the weak supervision coming only from the slide-level labels, often resulting in severe overfitting. In response, researchers have considered adopting patch-level augmentation or applying mixup augmentation, but their applicability remains unverified. Our approach augments the training dataset by sampling a subset of patches in the WSI without significantly altering the underlying semantics of the original slides. Additionally, we introduce an efficient model (Slot-MIL) that organizes patches into a fixed number of slots, the abstract representation of patches, using an attention mechanism. We empirically demonstrate that the subsampling augmentation helps to make more informative slots by restricting the over-concentration of attention and to improve interpretability. Finally, we illustrate that combining our attention-based aggregation model with subsampling and mixup, which has shown limited compatibility in existing MIL methods, can enhance both generalization and calibration. Our proposed methods achieve the state-of-the-art performance across various benchmark datasets including class imbalance and distribution shifts.


title: Design of platform trials with a change in the control treatment arm

abstract: Platform trials are a more efficient way of testing multiple treatments compared to running separate trials. In this paper we consider platform trials where, if a treatment is found to be superior to the control, it will become the new standard of care (and the control in the platform). The remaining treatments are then tested against this new control. In such a setting, one can either keep the information on both the new standard of care and the other active treatments before the control is changed or one could discard this information when testing for benefit of the remaining treatments. We will show analytically and numerically that retaining the information collected before the change in control can be detrimental to the power of the study. Specifically, we consider the overall power, the probability that the active treatment with the greatest treatment effect is found during the trial. We also consider the conditional power of the active treatments, the probability a given treatment can be found superior against the current control. We prove when, in a multi-arm multi-stage trial where no arms are added, retaining the information is detrimental to both overall and conditional power of the remaining treatments. This loss of power is studied for a motivating example. We then discuss the effect on platform trials in which arms are added later. On the basis of these observations we discuss different aspects to consider when deciding whether to run a continuous platform trial or whether one may be better running a new trial.


title: Renormalization of non-local gluon operators in lattice perturbation theory

abstract: In this study, we investigate the renormalization of a complete set of gauge-invariant non-local gluon operators up to one-loop in lattice perturbation theory. Our computations have been performed in both dimensional and lattice regularizations, using the Wilson gluon action, leading to the renormalization functions in the modified Minimal Subtraction $(\overline{\text{MS}})$ scheme, as well as conversion factors from the modified regularization invariant $(RI')$ scheme to $\overline{\text{MS}}$.


title: R\'eductions d'un syst\`eme bidimensionnel de sine-Gordon \`a la sixi\`eme \'equation de Painlev\'e

abstract: We derive all the reductions of the system of two coupled sine-Gordon equations introduced by Konopelchenko and Rogers to ordinary differential equations. All these reductions are degeneracies of a master reduction to an equation found by Chazy "curious for its elegance", an algebraic transform of the most general sixth equation of Painlev\'e. -- -- Nous \'etablissons toutes les r\'eductions du syst\`eme de deux \'equations coupl\'ees de sine-Gordon introduit par Konopelchenko et Rogers \`a des \'equations diff\'erentielles ordinaires. Ces r\'eductions sont toutes des d\'eg\'en\'erescences d'une r\'eduction ma{\^\i}tresse \`a une \'equation jug\'ee par Chazy "curieuse en raison de [son] \'el\'egance", transform\'ee alg\'ebrique de la sixi\`eme \'equation de Painlev\'e la plus g\'en\'erale.


title: Complete frequencies for Koenigs domains

abstract: We provide a complete characterization of those non-elliptic semigroups of holomorphic self-maps of the unit disc for which the linear span of eigenvectors of the generator of the corresponding semigroup of composition operators is weak-star dense in $H^\infty$. We also give some necessary and sufficient conditions for completeness in $H^p$. This problem is equivalent to the completeness of the corresponding exponential functions in $H^\infty$ (in the weak-star sense) or in $H^p$ of the Koenigs domain of the semigroup. As a tool needed for the results, we introduce and study discontinuities of semigroups of holomorphic self-maps of the unit disc.


title: Distributed AI in Zero-touch Provisioning for Edge Networks: Challenges and Research Directions

abstract: Zero-touch network is anticipated to inaugurate the generation of intelligent and highly flexible resource provisioning strategies where multiple service providers collaboratively offer computation and storage resources. This transformation presents substantial challenges to network administration and service providers regarding sustainability and scalability. This article combines Distributed Artificial Intelligence (DAI) with Zero-touch Provisioning (ZTP) for edge networks. This combination helps to manage network devices seamlessly and intelligently by minimizing human intervention. In addition, several advantages are also highlighted that come with incorporating Distributed AI into ZTP in the context of edge networks. Further, we draw potential research directions to foster novel studies in this field and overcome the current limitations.


title: Status of $e^+e^-$ Higgs Factory Projects

abstract: An electron-positron collider designed for precision studies of the Higgs boson, a so-called Higgs factory is the highest-priority next collider of the particle physics community. This contribution summarises the key physics goals of such a Higgs factory and reviews the status of the various proposed realisations from mature concepts to very recent ideas. The commonalities and special advantages of circular and linear approaches will be discussed, respectively, before highlighting some recent developments regarding the key technologies, the operation scenarios and sustainability aspects for future colliders.


title: Exploring Multi-Reader Buffers and Channel Placement during Dataflow Network Mapping to Heterogeneous Many-core Systems

abstract: This paper presents an approach for reducing the memory requirements of dataflow applications, while minimizing the execution period when deployed on a many-core target. Often, straightforward implementations of dataflow applications suffer from data duplication if identical data has to be processed by multiple actors. In fact, multi-cast actors can produce huge memory overheads when storing and communicating copies of the same data. As a remedy, so-called Multi-Reader Buffers (MRBs) can be utilized to forward identical data to multiple actors in a FIFO manner while storing each data item only once. However, MRBs may increase the achievable period due to communication contention when accessing the shared data. A novel multi-objective design space exploration approach is proposed that selectively replaces multi-cast actors with MRBs and explores actor and FIFO channel mappings to find trade-offs between the objectives of period, memory footprint, and core cost. Our approach considers (i) memory-size constraints, (ii) hierarchical memories to implement the buffers, (iii) supports heterogeneous many-core platforms, and (iv) optimizes the buffer placement and overall scheduling to minimize the execution period by proposing a novel combined actor and communications scheduling heuristic for period minimization called CAPS-HMS. Our results show that the explored Pareto fronts improve a hypervolume indicator over a reference approach by up to 66 % for small to mid-size applications and 90 % for large applications. Moreover, selectively replacing multi-cast actors with corresponding MRBs proves to be always superior to never or always replacing them. Finally, it is shown that the quality of the explored Pareto fronts does not degrade when replacing the efficient scheduling heuristic CAPS-HMS by an exact integer linear programming (ILP) solver.


title: Large Language Models for Networking: Applications, Enabling Techniques, and Challenges

abstract: The rapid evolution of network technologies and the growing complexity of network tasks necessitate a paradigm shift in how networks are designed, configured, and managed. With a wealth of knowledge and expertise, large language models (LLMs) are one of the most promising candidates. This paper aims to pave the way for constructing domain-adapted LLMs for networking. Firstly, we present potential LLM applications for vertical network fields and showcase the mapping from natural language to network language. Then, several enabling technologies are investigated, including parameter-efficient finetuning and prompt engineering. The insight is that language understanding and tool usage are both required for network LLMs. Driven by the idea of embodied intelligence, we propose the ChatNet, a domain-adapted network LLM framework with access to various external network tools. ChatNet can reduce the time required for burdensome network planning tasks significantly, leading to a substantial improvement in efficiency. Finally, key challenges and future research directions are highlighted.


title: CLiSA: A Hierarchical Hybrid Transformer Model using Orthogonal Cross Attention for Satellite Image Cloud Segmentation

abstract: Clouds in optical satellite images are a major concern since their presence hinders the ability to carry accurate analysis as well as processing. Presence of clouds also affects the image tasking schedule and results in wastage of valuable storage space on ground as well as space-based systems. Due to these reasons, deriving accurate cloud masks from optical remote-sensing images is an important task. Traditional methods such as threshold-based, spatial filtering for cloud detection in satellite images suffer from lack of accuracy. In recent years, deep learning algorithms have emerged as a promising approach to solve image segmentation problems as it allows pixel-level classification and semantic-level segmentation. In this paper, we introduce a deep-learning model based on hybrid transformer architecture for effective cloud mask generation named CLiSA - Cloud segmentation via Lipschitz Stable Attention network. In this context, we propose an concept of orthogonal self-attention combined with hierarchical cross attention model, and we validate its Lipschitz stability theoretically and empirically. We design the whole setup under adversarial setting in presence of Lov\'asz-Softmax loss. We demonstrate both qualitative and quantitative outcomes for multiple satellite image datasets including Landsat-8, Sentinel-2, and Cartosat-2s. Performing comparative study we show that our model performs preferably against other state-of-the-art methods and also provides better generalization in precise cloud extraction from satellite multi-spectral (MX) images. We also showcase different ablation studies to endorse our choices corresponding to different architectural elements and objective functions.


title: Inference of Sample Complier Average Causal Effects in Completely Randomized Experiments

abstract: In randomized experiments with non-compliance scholars have argued that the complier average causal effect (CACE) ought to be the main causal estimand. The literature on inference of the complier average treatment effect (CACE) has focused on inference about the population CACE. However, in general individuals in the experiments are volunteers. This means that there is a risk that individuals partaking in a given experiment differ in important ways from a population of interest. It is thus of interest to focus on the sample at hand and have easy to use and correct procedures for inference about the sample CACE. We consider a more general setting than in the previous literature and construct a confidence interval based on the Wald estimator in the form of a finite closed interval that is familiar to practitioners. Furthermore, with the access of pre-treatment covariates, we propose a new regression adjustment estimator and associated methods for constructing confidence intervals. Finite sample performance of the methods is examined through a Monte Carlo simulation and the methods are used in an application to a job training experiment.


title: Mean Back Relaxation for Position and Densities

abstract: Correlation functions are a standard tool for analyzing statistical particle trajectories. Recently, a so called mean back relaxation (MBR) has been introduced, which correlates positions at three time points and which has been shown to be a marker for breakage of time reversal symmetry for confined particles. Here, we extend this discussion in several ways. We give an extension to multiple dimensions. Using a path integral approach, we provide a general expression for MBR in terms of multipoint density correlations. For Gaussian systems, this expression yields a relation between MBR and mean squared displacement. From it, several properties of MBR for Gaussian equilibrium systems can be found, such as monotonicity and positivity. Unexpectedly, in this case the particle forgets the conditioning via a power law in time. We finally demonstrate that using MBR for microscopic densities, it is a marker for broken detailed balance even in bulk systems.


title: Conventional and inverse magnetocaloric and electrocaloric effects of a mixed spin-(1/2, 1) Heisenberg dimer

abstract: The mixed spin-(1/2, 1) Heisenberg dimer accounting for two different Land\'e $g$-factors is exactly examined in presence of external magnetic and electric field by considering exchange as well as uniaxial single-ion anisotropies. Rigorously calculated ground-state phase diagrams affirm existence of three different types of zero-temperature phase transitions accompanied with a non-zero value of a residual entropy. Presence of a magnetoelectric effect accounted within Katsura-Nagaosa-Balatsky mechanism is demonstrated through the analyzis of the magnetization and dielectric polarization in response to both external fields. The analyzis of two basic magnetocaloric characteristics, the adiabatic change of temperature and the isothermal entropy change, achieved upon variation of external fields, are exactly calculated in order to investigate the (multi)caloric behavior. The obtained results confirm existence of both conventional as well as inverse magnetocaloric effects. Utilizing the refrigeration capacity coefficient it is found that the application of an electric field during the adiabatic demagnetization process may lead to an enhancement of cooling performance in the region of conventional magnetocaloric effect. On the other hand, a sufficiently large electric field can reduce an inverse caloric effect provided that the electric-field-induced transition from the fully to partially polarized state is realized.


title: CrimeGNN: Harnessing the Power of Graph Neural Networks for Community Detection in Criminal Networks

abstract: In this paper, we introduce CrimeGNN, a novel application of Graph Neural Networks (GNNs) specifically designed to uncover hidden communities within criminal networks. As criminal activities increasingly rely on complex network structures, traditional methods of network analysis often fall short in detecting the intricate and dynamic communities within these networks. Leveraging the power of GNNs, CrimeGNN provides an advanced and specialized solution to this problem. The model ingests a graph structure of a criminal network, where vertices represent individuals and edges represent relationships between them. CrimeGNN aims to identify a partition of the vertex set, such that each subset represents a distinct community within the network, maximizing the modularity function. Experimental results on several benchmark datasets demonstrate the effectiveness of CrimeGNN, outperforming existing methods in terms of both accuracy and computational efficiency. The proposed framework offers significant potential for aiding law enforcement agencies in proactive policing and crime prevention measures by providing a more in-depth understanding of the structure and operation of criminal networks.


title: Semiprime ideals in C*-algebras

abstract: We show that a not necessarily closed ideal in a C*-algebra is semiprime if and only if it is idempotent, if and only if it is closed under square roots of positive elements. Among other things, it follows that prime and semiprime ideals in C*-algebras are automatically self-adjoint. To prove the above, we isolate and study a particular class of ideals, which we call Dixmier ideals. As it turns out, there is a rich theory of powers and roots for Dixmier ideals. We show that every ideal in a C*-algebra is squeezed by Dixmier ideals from inside and outside tightly in a suitable sense, from which we are able to deduce information about the ideal in the middle.


title: The Best Constant For Inequality Involving Sum Of The Reciprocals And Product Of Positive Numbers With Unit Sum

abstract: In the paper we study a special parameter containing algebraic inequality involving sum of reciprocals and product of positive real numbers whose sum is 1. We determine the best values of the parameter using a new optimization argument. In the case of three numbers the algebraic inequality have some interesting geometric applications involving a generalization of Euler's inequality about the ratio of radii of circumscribed and inscribed circles of a triangle.


title: Challenges for Conflict Mitigation in O-RAN's RAN Intelligent Controllers

abstract: The O-RAN architecture enables a more flexible and dynamic radio access network (RAN) control by separating hardware and software components. However, the distributed nature of the O-RAN architecture also presents several challenges for mitigating network control conflicts that can arise between different network elements. In this article, we identify key challenges for conflict mitigation in O-RAN networks, including reliable conflict detection, efficient maintenance of conflict mitigation configuration, optimal conflict resolution logic, testing and evaluation methodologies, and limited observability of O-RAN components. We propose solutions to these challenges, including pre-deployment conflict mitigation, conflict detection and resolution, and supervision and adaptation. The article concludes by highlighting the need for ongoing research to address these challenges and ensure effective conflict mitigation in O-RAN deployments.


title: Classification, Challenges, and Automated Approaches to Handle Non-Functional Requirements in ML-Enabled Systems: A Systematic Literature Review

abstract: Context: Machine learning (ML) is nowadays so pervasive and diffused that virtually no application can avoid its use. Nonetheless, its enormous potential is often tempered by the need to manage non-functional requirements and navigate pressing, contrasting trade-offs. Objective: In this respect, we notice the lack of a comprehensive synthesis of the non-functional requirements affecting ML-enabled systems, other than the major challenges faced to deal with them. Such a synthesis may not only provide a comprehensive summary of the state of the art, but also drive further research on the analysis, management, and optimization of non-functional requirements of ML-intensive systems. Method: In this paper, we propose a systematic literature review targeting two key aspects such as (1) the classification of the non-functional requirements investigated so far, and (2) the challenges to be faced when developing models in ML-enabled systems. Through the combination of well-established guidelines for conducting systematic literature reviews and additional search criteria, we survey a total amount of 69 research articles. Results: Our findings report that current research identified 30 different non-functional requirements, which can be grouped into six main classes. We also compiled a catalog of more than 23 software engineering challenges, based on which further research should consider the nonfunctional requirements of machine learning-enabled systems. Conclusion: We conclude our work by distilling implications and a future outlook on the topic.


title: Notes on data-driven output-feedback control of linear MIMO systems

abstract: Recent works have approached the data-driven design of output-feedback controllers for discrete-time LTI systems by constructing non-minimal state vectors composed of past inputs and outputs. Depending on the system's complexity (order, lag and number of inputs), it was observed in several works that such an approach presents certain limitations, but no methods were proposed to overcome them. In this note, we clarify these limitations and solve them by proposing the construction of (alternative) non-minimal state vectors that facilitate output-feedback control of MIMO discrete-time LTI systems.


title: Discrete Empirical Interpolation Method for nonlinear softening problems involving damage and plasticity

abstract: Accurate simulations are essential for engineering applications, and intricate continuum mechanical material models are constructed to achieve this goal. However, the increasing complexity of the material models and geometrical properties lead to a significant increase in computational effort. Model order reduction aims to implement efficient methods for accelerating the simulation process while preserving a high degree of accuracy. Numerous studies have already demonstrated the benefits of this method for linear elastic material modeling. However, in the present work, we investigate a two-surface gradient-extended damage-plasticity model. We conducted complex simulations with this model, demonstrating both damage behavior and softening. The POD-based discrete empirical interpolation method (DEIM) is introduced and implemented. To accomplish simulations with DEIM and softening behaviour, we propose the implementation of a reduced form of the arc-length method. Existing research on calculating models with both damage and softening behavior using the DEIM and arc-length method is limited. To validate the methods, two numerical examples are thoroughly investigated in this study: a plate with a hole and an asymmetrically notched specimen. The results show that the proposed methods can create a reduced order model with high accuracy and a significant speedup of the simulation. For both examples, the analysis is conducted in three steps: first, plasticity without damage is examined, followed by damage without plasticity, and finally, the combination of plasticity and damage is investigated.


title: Non-Visible Light Data Synthesis and Application: A Case Study for Synthetic Aperture Radar Imagery

abstract: We explore the "hidden" ability of large-scale pre-trained image generation models, such as Stable Diffusion and Imagen, in non-visible light domains, taking Synthetic Aperture Radar (SAR) data for a case study. Due to the inherent challenges in capturing satellite data, acquiring ample SAR training samples is infeasible. For instance, for a particular category of ship in the open sea, we can collect only few-shot SAR images which are too limited to derive effective ship recognition models. If large-scale models pre-trained with regular images can be adapted to generating novel SAR images, the problem is solved. In preliminary study, we found that fine-tuning these models with few-shot SAR images is not working, as the models can not capture the two primary differences between SAR and regular images: structure and modality. To address this, we propose a 2-stage low-rank adaptation method, and we call it 2LoRA. In the first stage, the model is adapted using aerial-view regular image data (whose structure matches SAR), followed by the second stage where the base model from the first stage is further adapted using SAR modality data. Particularly in the second stage, we introduce a novel prototype LoRA (pLoRA), as an improved version of 2LoRA, to resolve the class imbalance problem in SAR datasets. For evaluation, we employ the resulting generation model to synthesize additional SAR data. This augmentation, when integrated into the training process of SAR classification as well as segmentation models, yields notably improved performance for minor classes


title: Taiwan LLM: Bridging the Linguistic Divide with a Culturally Aligned Language Model

abstract: In the realm of language models, the nuanced linguistic and cultural intricacies of Traditional Chinese, as spoken in Taiwan, have been largely overlooked. This paper introduces Taiwan LLM, a pioneering Large Language Model that specifically caters to the Traditional Chinese language, with a focus on the variant used in Taiwan. Leveraging a comprehensive pretraining corpus and instruction-finetuning datasets, we have developed a model that not only understands the complexities of Traditional Chinese but also embodies the cultural context of Taiwan. Taiwan LLM represents the first of its kind, a model that is not only linguistically accurate but also culturally resonant with its user base. Our evaluations demonstrate that Taiwan LLM achieves superior performance in understanding and generating Traditional Chinese text, outperforming existing models that are predominantly trained on Simplified Chinese or English. The open-source release of Taiwan LLM invites collaboration and further innovation, ensuring that the linguistic diversity of Chinese speakers is embraced and well-served. The model, datasets, and further resources are made publicly available to foster ongoing research and development in this field.


title: Hydrodynamical simulation of the structure of the X-ray pulsar accretion channel: accounting for resonant scattering

abstract: A self-consistent radiation-hydrodynamics model of an accretion channel of subcritical X-ray pulsars is constructed. The influence of the presence of resonance in the scattering cross-section on the accretion process and radiation transfer is taken into account. It is shown that the efficiency of plasma deceleration by radiation depends on the magnitude of the magnetic field $B$. For $B=1.7\times 10^{12}$ G, the spectra and the degree of linear polarization of the radiation of the accretion channel are constructed. In the obtained spectra, the shape of the cyclotron line depends on the direction of the outgoing radiation. The calculated linear polarization degree of the outgoing radiation is $30 -40\%$ near the cyclotron resonance, whereas it can be small ($\lesssim 5 - 10\%$) at energies significantly lower than the resonant one.


title: Boundary sensitive Lindbladians and relaxation dynamics

abstract: It is well known that non-Hermitian systems can be extremely sensitive to boundary conditions owing to non-Hermitian skin effect (NHSE). Analogously, we investigate two boundary-sensitive $U(1)$ symmetric Lindbladians: one carries current in the steady state, and the other does not. The numerical results indicate significant change of the Liouvillian spectrum, eigenmodes and relaxation time for both Lindbladians when the boundary conditions are altered. This phenomenon is found to be triggered by the Liouvillian skin effect (LSE), specifically the localization of eigenmodes, which stems from the NHSE of the non-Hermitian effective Hamiltonian. In addition, these two Lindbladians manifest different LSE, ultimately resulting in distinct relaxation behaviors.


title: Multithreaded parallelism for heterogeneous clusters of QPUs

abstract: In this work, we present MILQ, a quantum unrelated parallel machines scheduler and cutter. The setting of unrelated parallel machines considers independent hardware backends, each distinguished by differing setup and processing times. MILQ optimizes the total execution time of a batch of circuits scheduled on multiple quantum devices. It leverages state-of-the-art circuit-cutting techniques to fit circuits onto the devices and schedules them based on a mixed-integer linear program. Our results show a total improvement of up to 26 % compared to a baseline approach.


title: Spherical Frustum Sparse Convolution Network for LiDAR Point Cloud Semantic Segmentation

abstract: LiDAR point cloud semantic segmentation enables the robots to obtain fine-grained semantic information of the surrounding environment. Recently, many works project the point cloud onto the 2D image and adopt the 2D Convolutional Neural Networks (CNNs) or vision transformer for LiDAR point cloud semantic segmentation. However, since more than one point can be projected onto the same 2D position but only one point can be preserved, the previous 2D image-based segmentation methods suffer from inevitable quantized information loss. To avoid quantized information loss, in this paper, we propose a novel spherical frustum structure. The points projected onto the same 2D position are preserved in the spherical frustums. Moreover, we propose a memory-efficient hash-based representation of spherical frustums. Through the hash-based representation, we propose the Spherical Frustum sparse Convolution (SFC) and Frustum Fast Point Sampling (F2PS) to convolve and sample the points stored in spherical frustums respectively. Finally, we present the Spherical Frustum sparse Convolution Network (SFCNet) to adopt 2D CNNs for LiDAR point cloud semantic segmentation without quantized information loss. Extensive experiments on the SemanticKITTI and nuScenes datasets demonstrate that our SFCNet outperforms the 2D image-based semantic segmentation methods based on conventional spherical projection. The source code will be released later.


title: Mergen: The First Manchu-Korean Machine Translation Model Trained on Augmented Data

abstract: The Manchu language, with its roots in the historical Manchurian region of Northeast China, is now facing a critical threat of extinction, as there are very few speakers left. In our efforts to safeguard the Manchu language, we introduce Mergen, the first-ever attempt at a Manchu-Korean Machine Translation (MT) model. To develop this model, we utilize valuable resources such as the Manwen Laodang(a historical book) and a Manchu-Korean dictionary. Due to the scarcity of a Manchu-Korean parallel dataset, we expand our data by employing word replacement guided by GloVe embeddings, trained on both monolingual and parallel texts. Our approach is built around an encoder-decoder neural machine translation model, incorporating a bi-directional Gated Recurrent Unit (GRU) layer. The experiments have yielded promising results, showcasing a significant enhancement in Manchu-Korean translation, with a remarkable 20-30 point increase in the BLEU score.


title: Towards Higher Ranks via Adversarial Weight Pruning

abstract: Convolutional Neural Networks (CNNs) are hard to deploy on edge devices due to its high computation and storage complexities. As a common practice for model compression, network pruning consists of two major categories: unstructured and structured pruning, where unstructured pruning constantly performs better. However, unstructured pruning presents a structured pattern at high pruning rates, which limits its performance. To this end, we propose a Rank-based PruninG (RPG) method to maintain the ranks of sparse weights in an adversarial manner. In each step, we minimize the low-rank approximation error for the weight matrices using singular value decomposition, and maximize their distance by pushing the weight matrices away from its low rank approximation. This rank-based optimization objective guides sparse weights towards a high-rank topology. The proposed method is conducted in a gradual pruning fashion to stabilize the change of rank during training. Experimental results on various datasets and different tasks demonstrate the effectiveness of our algorithm in high sparsity. The proposed RPG outperforms the state-of-the-art performance by 1.13% top-1 accuracy on ImageNet in ResNet-50 with 98% sparsity. The codes are available at https://github.com/huawei-noah/Efficient-Computing/tree/master/Pruning/RPG and https://gitee.com/mindspore/models/tree/master/research/cv/RPG.


title: Resolved Raman sideband cooling of a single optically trapped cesium atom

abstract: We developed a resolved Raman sideband cooling scheme that can efficiently prepare a single optically trapped cesium (Cs) atom in its motional ground states. A two-photon Raman process between two outermost Zeeman sublevels in a single hyperfine state is applied to reduce the phonon number. Our scheme is less sensitive to the variation in the magnetic field than the commonly used scheme where the two outermost Zeeman sublevels belonging to the two separate ground hyperfine states are taken. Fast optical pumping with less spontaneous emission guarantees the efficiency of the cooling process. After cooling for 50 ms, 82% of the Cs atoms populate their three-dimensional ground states. Our scheme improves the long-term stability of Raman sideband cooling in the presence of magnetic field drift and is thus suitable for cooling other trapped atoms or ions with abundant magnetic sublevels.


title: Rotating magnetoelectric effect in a ground state of a coupled spin-electron model on a doubly decorated square lattice

abstract: Exact analytical calculations are performed to study the rotating magnetoelectric effect in a ground state of a coupled spin-electron model on a doubly decorated square lattice with and without presence of an external magnetic field. Novel spatially anisotropic magnetic ground states emergent due to a rotation in an external electric field are found at three physically interesting electron concentrations ranging from a quarter up to a half filling. In absence of the magnetic field existence of spatially anisotropic structures requires a fractional electron concentration, where a significant influence of spatial orientation of an electric field is observed. It turns out that the investigated model exhibits a rotating magnetoelectric effect at all three concentrations with one or two consecutive critical points in presence of magnetic field. At the same time, the rotating electric field has a significant effect on a critical value of an electrostatic potential, which can be enhanced or lowered upon changing the electron hopping and the magnitude of an applied magnetic field. Finally, we have found an intriguing interchange of magnetic order between the horizontal and vertical directions driven by a rotation of the electric field, which is however destabilized upon strengthening of the magnetic field.


title: A practical guide to Digital Micro-mirror Devices (DMDs) for wavefront shaping

abstract: Digital micromirror devices have gained popularity in wavefront shaping, offering a high frame rate alternative to liquid crystal spatial light modulators. They are relatively inexpensive, offer high resolution, are easy to operate, and a single device can be used in a broad optical bandwidth. However, some technical drawbacks must be considered to achieve optimal performance. These issues, often undocumented by manufacturers, mostly stem from the device's original design for video projection applications. Herein, we present a guide to characterize and mitigate these effects. Our focus is on providing simple and practical solutions that can be easily incorporated into a typical wavefront shaping setup.


title: A study of nonlocal fractional neutral stochastic integrodifferential inclusions of order $1<\alpha<2$ with impulses

abstract: This paper considers a class of nonlocal fractional neutral stochastic integrodifferential inclusions of order $1<\alpha<2$ with impulses in a Hilbert space. We study the existence of the mild solution for the cases when the multi-valued map has convex and non-convex values. The results are obtained by combining fixed-point theorems with the fractional order cosine family, semigroup theory, and stochastic techniques. A new set of sufficient conditions is developed to demonstrate the approximate controllability of the system. Finally, an example is given to illustrate the obtained results.


title: A Multiparty Commutative Hashing Protocol based on the Discrete Logarithm Problem

abstract: Let $\mathcal{X}$ and $\mathcal{Y}$ be two sets and suppose that a set of participants $P=\{P_1,P_2,\dots,P_n\}$ would like to calculate the keyed hash value of some message $m\in\mathcal{X}$ known to a single participant in $P$ called the data owner. Also, suppose that each participant $P_i$ knows a secret value $x_i\in\mathcal{X}$. In this paper, we will propose a protocol that enables the participants in this setup to calculate the value $y=H(m,x_1,x_2,\dots ,x_n)$ of a hash function $H:\mathcal{X}^{n+1}\rightarrow\mathcal{Y}$ such that the function $H$ is a one-way function, participants in $P\backslash\{P_i\}$ cannot obtain $x_i$, participants other than the data owner cannot obtain $m$, and the hash value $y=H(m,x_1,x_2,\dots ,x_n)$ remains the same regardless the order of the secret $x_i$ values.


title: Observational Chemical Signatures of the Past FU Ori Outbursts

abstract: FU Ori-type stars are young stellar objects (YSOs) experiencing luminosity outbursts by a few orders of magnitude, which last for $\sim$$10^2$ years. A dozen of FUors are known up to date, but many more currently quiescent YSOs could have experienced such outbursts in the last $\sim$$10^3$ years. To find observational signatures of possible past outbursts, we utilise ANDES, RADMC-3D code as well as CASA ALMA simulator to model the impact of the outburst on the physical and chemical structure of typical FU Ori systems and how it translates to the molecular lines' fluxes. We identify several combinations of molecular lines that may trace past FU Ori objects both with and without envelopes. The most promising outburst tracers from an observational perspective are the molecular flux combinations of the N$_{2}$H$^{+}$ $J=3-2$, C$^{18}$O $J = 2-1$, H$_2$CO $(J_{\rm K_a, K_c}) = 4_{04}-3_{03}$, and HCN $J = 3-2$ lines. We analyse the processes leading to molecular flux changes and show that they are linked with either thermal desorption or enhanced chemical reactions in the molecular layer. Using observed CO, HCN, N$_2$H$^+$ and H$_2$CO line fluxes from the literature, we identify ten nearby disc systems that might have undergone FU Ori outbursts in the past $\sim$$10^3$ years: [MGM2012] 556, [MGM2012] 371 and [MGM2012] 907 YSOs in L1641, Class II protoplanetary discs around CI Tau, AS 209 and IM Lup and transitional discs DM Tau, GM Aur, LkCa 15 and J1640-2130.


title: Spline Upwind for space--time Isogeometric Analysis of cardiac electrophysiology

abstract: We present an elaboration and application of Spline Upwind (SU) stabilization method, designed in space--time Isogeometric Analysis framework, in order to make this stabilization as suitable as possible in the context of cardiac electrophysiology. Our aim is to propose a formulation as simple and efficient as possible, effectual in preventing spurious oscillations present in plain Galerkin method and also reasonable from the computational cost point of view. For these reasons we validate the method's capability with numerical experiments, focusing on accuracy and computational aspects.


title: Disorder- and magnetic field-tuned fermionic superconductor-insulator transition in MoN thin films. Transport and STM studies

abstract: Superconductor-insulator transition (SIT) driven by disorder and transverse magnetic field has been investigated in ultrathin MoN films by means of transport measurements and scanning tunneling microscopy and spectroscopy. Upon decreasing thickness, the homogeneously disordered films show increasing sheet resistance Rs, shift of the superconducting transition Tc to lower temperatures with the 3 nm MoN being the last superconducting film and thinner films already insulating. Fermionic scenario of SIT is evidenced by applicability of the Finkelsteins model, by the fact that Tc and the superconducting gap are coupled with a constant ratio, and by the spatial homogeneity of the superconducting and electronic characteristics. The logarithmic anomaly found in the tunneling spectra of the non-superconducting films is further enhanced in increased magnetic field due to the Zeeman spin effects driving the system deeper into the insulating state and pointing also to fermionic SIT.


title: Enhancing Answer Selection in Community Question Answering with Pre-trained and Large Language Models

abstract: Community Question Answering (CQA) becomes increasingly prevalent in recent years. However, there are a large number of answers, which is difficult for users to select the relevant answers. Therefore, answer selection is a very significant subtask of CQA. In this paper, we first propose the Question-Answer cross attention networks (QAN) with pre-trained models for answer selection and utilize large language model (LLM) to perform answer selection with knowledge augmentation. Specifically, we apply the BERT model as the encoder layer to do pre-training for question subjects, question bodies and answers, respectively, then the cross attention mechanism selects the most relevant answer for different questions. Experiments show that the QAN model achieves state-of-the-art performance on two datasets, SemEval2015 and SemEval2017. Moreover, we use the LLM to generate external knowledge from questions and correct answers to achieve knowledge augmentation for the answer selection task by LLM, while optimizing the prompt of LLM in different aspects. The results show that the introduction of external knowledge can improve the correct answer selection rate of LLM on datasets SemEval2015 and SemEval2017. Meanwhile, LLM can also select the correct answer on more questions by optimized prompt.


title: Optimal controllability for multi-term time-fractional stochastic systems with non-instantaneous impulses

abstract: In the present paper, we study the existence and optimal controllability of a multi-term time-fractional stochastic system with non-instantaneous impulses. Using semigroup theory, stochastic analysis theory, and Krasnoselskii's fixed point theorem, we first establish the existence of a mild solution. Further, we obtain that there exists an optimal state-control pair of the system. Some examples are given to illustrate the abstract results.


title: PViT-6D: Overclocking Vision Transformers for 6D Pose Estimation with Confidence-Level Prediction and Pose Tokens

abstract: In the current state of 6D pose estimation, top-performing techniques depend on complex intermediate correspondences, specialized architectures, and non-end-to-end algorithms. In contrast, our research reframes the problem as a straightforward regression task by exploring the capabilities of Vision Transformers for direct 6D pose estimation through a tailored use of classification tokens. We also introduce a simple method for determining pose confidence, which can be readily integrated into most 6D pose estimation frameworks. This involves modifying the transformer architecture by decreasing the number of query elements based on the network's assessment of the scene complexity. Our method that we call Pose Vision Transformer or PViT-6D provides the benefits of simple implementation and being end-to-end learnable while outperforming current state-of-the-art methods by +0.3% ADD(-S) on Linemod-Occlusion and +2.7% ADD(-S) on the YCB-V dataset. Moreover, our method enhances both the model's interpretability and the reliability of its performance during inference.


title: A new proof of the Wulff-Gage isoperimetric inequality and its applications

abstract: A new proof of the Wulff-Gage isoperimetric inequality for origin-symmetric convex bodies is provided. As its applications, we prove the uniqueness of log-Minkowski problem and a new proof of the log-Minkowski inequality of curvature entropy for origin-symmetric convex bodies of $C^{2}$ boundaries in $\mathbb R^{2}$ is given.


title: Suppressed superconductivity in ultrathin Mo2N films due to pair-breaking at the interface

abstract: A strong disorder characterized by a small product of the Fermi vector kF and the electron mean free l drives superconductors towards insulating state. Such disorder can be introduced by making the films very thin. Here, we present 3-nm Mo2N film with k_F*l ~ 2 with a resistive superconducting transition temperature Tc = 2 K heavily suppressed in comparison with the bulk Tc. Superconducting density of states (DOS) with smeared gap-like peaks and in-gap states, so called Dynes DOS, is observed by the low temperature tunneling spectroscopy despite a sharp resistive transition. By scanning tunneling microscope the spectral maps are obtained and related to the surface topography. The maps show a spatial variation of the superconducting energy gap on the order of 20 % which is not accidental but well correlates with the surface corrugation: protrusions reveal larger gap, smaller spectral smearing and smaller in-gap states. In agreement with our previous measurements on ultrathin MoC films we suggest that the film-substrate interface introducing the local pair-breaking is responsible for the observed effects and generally for the suppression of the superconductivity in these ultrathin films.


title: Computation of outer inverse of tensors based on $t$-product

abstract: Tensor operations play an essential role in various fields of science and engineering, including multiway data analysis. In this study, we establish a few basic properties of the range and null space of a tensor using block circulant matrices and the discrete Fourier matrix. We then discuss the outer inverse of tensors based on $t$-product with a prescribed range and kernel of third-order tensors. We address the relation of this outer inverse with other generalized inverses, such as the Moore-Penrose inverse, group inverse, and Drazin inverse. In addition, we present a few algorithms for computing the outer inverses of the tensors. In particular, a $t$-QR decomposition based algorithm is developed for computing the outer inverses.


title: Model Performance Prediction for Hyperparameter Optimization of Deep Learning Models Using High Performance Computing and Quantum Annealing

abstract: Hyperparameter Optimization (HPO) of Deep Learning-based models tends to be a compute resource intensive process as it usually requires to train the target model with many different hyperparameter configurations. We show that integrating model performance prediction with early stopping methods holds great potential to speed up the HPO process of deep learning models. Moreover, we propose a novel algorithm called Swift-Hyperband that can use either classical or quantum support vector regression for performance prediction and benefit from distributed High Performance Computing environments. This algorithm is tested not only for the Machine-Learned Particle Flow model used in High Energy Physics, but also for a wider range of target models from domains such as computer vision and natural language processing. Swift-Hyperband is shown to find comparable (or better) hyperparameters as well as using less computational resources in all test cases.