title: Improving Multilingual Neural Machine Translation System for Indic Languages

abstract: Machine Translation System (MTS) serves as an effective tool for communication by translating text or speech from one language to another language. The need of an efficient translation system becomes obvious in a large multilingual environment like India, where English and a set of Indian Languages (ILs) are officially used. In contrast with English, ILs are still entreated as low-resource languages due to unavailability of corpora. In order to address such asymmetric nature, multilingual neural machine translation (MNMT) system evolves as an ideal approach in this direction. In this paper, we propose a MNMT system to address the issues related to low-resource language translation. Our model comprises of two MNMT systems i.e. for English-Indic (one-to-many) and the other for Indic-English (many-to-one) with a shared encoder-decoder containing 15 language pairs (30 translation directions). Since most of IL pairs have scanty amount of parallel corpora, not sufficient for training any machine translation model. We explore various augmentation strategies to improve overall translation quality through the proposed model. A state-of-the-art transformer architecture is used to realize the proposed model. Trials over a good amount of data reveal its superiority over the conventional models. In addition, the paper addresses the use of language relationships (in terms of dialect, script, etc.), particularly about the role of high-resource languages of the same family in boosting the performance of low-resource languages. Moreover, the experimental results also show the advantage of backtranslation and domain adaptation for ILs to enhance the translation quality of both source and target languages. Using all these key approaches, our proposed model emerges to be more efficient than the baseline model in terms of evaluation metrics i.e BLEU (BiLingual Evaluation Understudy) score for a set of ILs.


title: Improving Pulse-Compression Weather Radar via the Joint Design of Subpulses and Extended Mismatch Filter

abstract: Pulse compression can enhance both the performance in range resolution and sensitivity for weather radar. However, it will introduce the issue of high sidelobes if not delicately implemented. Motivated by this fact, we focus on the pulse compression design for weather radar in this paper. Specifically, we jointly design both the subpulse codes and extended mismatch filter based on the alternating direction method of multipliers (ADMM). This joint design will yield a pulse compression with low sidelobes, which equivalently implies a high signal-to-interference-plus-noise ratio (SINR) and a low estimation error on meteorological reflectivity. The experiment results demonstrate the efficacy of the proposed pulse compression strategy since its achieved meteorological reflectivity estimations are highly similar to the ground truth.


title: Robust Fused Lasso Penalized Huber Regression with Nonasymptotic Property and Implementation Studies

abstract: For some special data in reality, such as the genetic data, adjacent genes may have the similar function. Thus ensuring the smoothness between adjacent genes is highly necessary. But, in this case, the standard lasso penalty just doesn't seem appropriate anymore. On the other hand, in high-dimensional statistics, some datasets are easily contaminated by outliers or contain variables with heavy-tailed distributions, which makes many conventional methods inadequate. To address both issues, in this paper, we propose an adaptive Huber regression for robust estimation and inference, in which, the fused lasso penalty is used to encourage the sparsity of the coefficients as well as the sparsity of their differences, i.e., local constancy of the coefficient profile. Theoretically, we establish its nonasymptotic estimation error bounds under $\ell_2$-norm in high-dimensional setting. The proposed estimation method is formulated as a convex, nonsmooth and separable optimization problem, hence, the alternating direction method of multipliers can be employed. In the end, we perform on simulation studies and real cancer data studies, which illustrate that the proposed estimation method is more robust and predictive.


title: Finite quantum hypergroups

abstract: A finite quantum hypergroup is a finite-dimensional unital algebra $A$ over the field of complex numbers. There is a coproduct on $A$, a coassociative map from $A$ to $A\otimes A$ assumed to be unital, but it is not required to be an algebra homomorphism. There is a counit that is supposed to be a homomorphism. Finally, the main extra requirement is the existence of a faithful left integral with the right properties. For such a finite quantum hypergroup, the dual can be constructed. It is again a finite quantum hypergroup. The more general concept of an algebraic quantum hypergroup is studied in \cite{De-VD1, De-VD2}. If the underlying algebra of an algebraic quantum hypergroup is finite-dimensional, it is a finite quantum hypergroup in the sense of this paper. Here we treat finite quantum hypergroups independently with an emphasis on the development of the notion. It is meant to clarify the various steps taken in \cite{La-VD3a} and \cite{La-VD3b}. In \cite{La-VD3b} we introduce and study a still more general concept of quantum hypergroups. It not only contains the algebraic quantum hypergroups from \cite{De-VD1}, but also some topological cases. We naturally encounter these quantum hypergroups in our work on bicrossproducts, see \cite{La-VD4, La-VD5, La-VD7}. We include some examples to illustrate the theory. One kind is coming from a finite group and a subgroup. The other examples are taken from the bicrossproduct theory.


title: A comparative study of attention mechanism and generative adversarial network in facade damage segmentation

abstract: Semantic segmentation profits from deep learning and has shown its possibilities in handling the graphical data from the on-site inspection. As a result, visual damage in the facade images should be detected. Attention mechanism and generative adversarial networks are two of the most popular strategies to improve the quality of semantic segmentation. With specific focuses on these two strategies, this paper adopts U-net, a representative convolutional neural network, as the primary network and presents a comparative study in two steps. First, cell images are utilized to respectively determine the most effective networks among the U-nets with attention mechanism or generative adversarial networks. Subsequently, selected networks from the first test and their combination are applied for facade damage segmentation to investigate the performances of these networks. Besides, the combined effect of the attention mechanism and the generative adversarial network is discovered and discussed.


title: Frame Interpolation for Dynamic Scenes with Implicit Flow Encoding

abstract: In this paper, we propose an algorithm to interpolate between a pair of images of a dynamic scene. While in the past years significant progress in frame interpolation has been made, current approaches are not able to handle images with brightness and illumination changes, which are common even when the images are captured shortly apart. We propose to address this problem by taking advantage of the existing optical flow methods that are highly robust to the variations in the illumination. Specifically, using the bidirectional flows estimated using an existing pre-trained flow network, we predict the flows from an intermediate frame to the two input images. To do this, we propose to encode the bidirectional flows into a coordinate-based network, powered by a hypernetwork, to obtain a continuous representation of the flow across time. Once we obtain the estimated flows, we use them within an existing blending network to obtain the final intermediate frame. Through extensive experiments, we demonstrate that our approach is able to produce significantly better results than state-of-the-art frame interpolation algorithms.


title: LHAASO J2226+6057 as a pulsar wind nebula

abstract: The Large High Altitude Air Shower Observatory has reported the detection of cosmic-ray sources in Milky Way that can accelerate particles up to PeV (= 10$^{15}$ eV) energies. These sources, so called ``PeVatrons'', are mostly unidentified. Several classes of sources, such as supernova remnants, pulsar wind nebula, or young stellar clusters can potentially be the counterparts of these PeVatrons. The aim of this work is to study a pulsar wind nebula interpretation of one of these PeVatrons, LHAASO J2226+6057, which has a relatively well covered multi-frequency spectrum. We have performed a leptonic, time-dependent modeling of the pulsar wind nebula (PWN) associated with PSR J2229+6114 considering a time-energy-dependent diffusion-loss equation. Injection, energy losses, as well as escape of particles were considered to balance the time-dependent lepton population. We have also included the dynamics of the PWN and the associated supernova remnant (SNR) and their interaction via the reverse shock to study the reverberation phase of the system. We have considered different values of braking index ($n$) and true age ($t_{age}$) for the fitting of the multi-wavelength (MWL) spectral energy distribution (SED) of LHAASO J2226+6057. The best-fit PWN model parameters and their 1$\sigma$ confidence intervals were evaluated. We have also demonstrated the impact of reverberation on the MWL SED with increasing time. Additionally, we have discussed the resultant large radius and low magnetic field associated with the PWN in question, as caveats for the possible physical connection of the pulsar as the origin of this high energy source.


title: Autonomous and non-autonomous unbounded attractors in evolutionary problems

abstract: If the semigroup is slowly non-dissipative, i.e., its solutions can diverge to infinity as time tends to infinity, one still can study its dynamics via the approach by the unbounded attractors - the counterpart of the classical notion of global attractors. We continue the development of this theory started by Chepyzhov and Goritskii [CG92]. We provide the abstract results on the unbouded attractor existence, and we study the properties of these attractors, as well as of unbounded $\omega$-limit sets in slowly non-dissipative setting. We also develop the pullback non-autonomous counterpart of the unbounded attractor theory. The abstract theory that we develop is illustrated by the analysis of the autonomous problem governed by the equation $u_t = Au + f(u)$. In particular, using the inertial manifold approach, we provide the criteria under which the unbounded attractor coincides with the graph of the Lipschitz function, or becomes close to the graph of the Lipschitz function for large argument.


title: Testing the coincidence problem with strong gravitational lens, Type Ia supernovae and Hubble parameter observational data

abstract: In this paper, we use three different kinds of observational data, including 130 strong gravitational lensing (SGL) systems, type Ia supernovae (SNeIa: Pantheon and Union2.1) and 31 Hubble parameter data points ($H(z)$) from cosmic chronometers to constrain the phenomenological model ($\rho_x\varpropto\rho_m a^{\xi}$). By combining these three kinds of data (Union2.1+SGL+$H(z)$), we get the parameter value at the confidence interval of $2\sigma$, $\Omega_{X,0} = 0.69\pm0.34$, $\omega_x = -1.24\pm0.61$, $\xi = 3.8\pm3.9$ and $H_0 = 70.22\pm0.86$ kms$^{-1}$Mpc$^{-1}$. According to our results, we find that the $\Lambda$CDM model is still the model which is in best agreement with the observational data at present, and the coincidence problem is not alleviated. In addition, the $\Omega_X$ and $\Omega_m$ have the same order of magnitude in $0<z<1.26$. At last, we obtain the transition redshift $z_T=0.645$. If the transition occurs in $z>0.645$, it is necessary to introduce the dark energy interacting with dark matter.


title: A Benchmark Comparison of Python Malware Detection Approaches

abstract: While attackers often distribute malware to victims via open-source, community-driven package repositories, these repositories do not currently run automated malware detection systems. In this work, we explore the security goals of the repository administrators and the requirements for deployments of such malware scanners via a case study of the Python ecosystem and PyPI repository, which includes interviews with administrators and maintainers. Further, we evaluate existing malware detection techniques for deployment in this setting by creating a benchmark dataset and comparing several existing tools, including the malware checks implemented in PyPI, Bandit4Mal, and OSSGadget's OSS Detect Backdoor. We find that repository administrators have exacting technical demands for such malware detection tools. Specifically, they consider a false positive rate of even 0.01% to be unacceptably high, given the large number of package releases that might trigger false alerts. Measured tools have false positive rates between 15% and 97%; increasing thresholds for detection rules to reduce this rate renders the true positive rate useless. In some cases, these checks emitted alerts more often for benign packages than malicious ones. However, we also find a successful socio-technical malware detection system: external security researchers also perform repository malware scans and report the results to repository administrators. These parties face different incentives and constraints on their time and tooling. We conclude with recommendations for improving detection capabilities and strengthening the collaboration between security researchers and software repository administrators.


title: When Handcrafted Features and Deep Features Meet Mismatched Training and Test Sets for Deepfake Detection

abstract: The accelerated growth in synthetic visual media generation and manipulation has now reached the point of raising significant concerns and posing enormous intimidations towards society. There is an imperative need for automatic detection networks towards false digital content and avoid the spread of dangerous artificial information to contend with this threat. In this paper, we utilize and compare two kinds of handcrafted features(SIFT and HoG) and two kinds of deep features(Xception and CNN+RNN) for the deepfake detection task. We also check the performance of these features when there are mismatches between training sets and test sets. Evaluation is performed on the famous FaceForensics++ dataset, which contains four sub-datasets, Deepfakes, Face2Face, FaceSwap and NeuralTextures. The best results are from Xception, where the accuracy could surpass over 99\% when the training and test set are both from the same sub-dataset. In comparison, the results drop dramatically when the training set mismatches the test set. This phenomenon reveals the challenge of creating a universal deepfake detection system.


title: IFISS3D: A computational laboratory for investigating finite element approximation in three dimensions

abstract: IFISS is an established MATLAB finite element software package for studying strategies for solving partial differential equations (PDEs). IFISS3D is a new add-on toolbox that extends IFISS capabilities for elliptic PDEs from two to three space dimensions. The open-source MATLAB framework provides a computational laboratory for experimentation and exploration of finite element approximation and error estimation, as well as iterative solvers. The package is designed to be useful as a teaching tool for instructors and students who want to learn about state-of-the-art finite element methodology. It will also be useful for researchers as a source of reproducible test matrices of arbitrarily large dimension.


title: Uniqueness and statistical properties of the Gibbs state on general one-dimensional lattice systems with markovian structure

abstract: Let $M$ be a compact metric space and $X = M^{\mathbb{N}}$, we consider a set of admissible sequences $X_{A, I} \subset X$ determined by a continuous admissibility function $A : M \times M \to \mathbb{R}$ and a compact set $I \subset \mathbb{R}$. Given a Lipschitz continuous potential $\varphi : X_{A, I} \to \mathbb{R}$, we prove uniqueness of the Gibbs state $\mu_\varphi$ and we show that it is a Gibbs-Bowen measure and satisfies a central limit theorem.


title: Deep learning and machine learning for Malaria detection: overview, challenges and future directions

abstract: To have the greatest impact, public health initiatives must be made using evidence-based decision-making. Machine learning Algorithms are created to gather, store, process, and analyse data to provide knowledge and guide decisions. A crucial part of any surveillance system is image analysis. The communities of computer vision and machine learning has ended up curious about it as of late. This study uses a variety of machine learning and image processing approaches to detect and forecast the malarial illness. In our research, we discovered the potential of deep learning techniques as smart tools with broader applicability for malaria detection, which benefits physicians by assisting in the diagnosis of the condition. We examine the common confinements of deep learning for computer frameworks and organising, counting need of preparing data, preparing overhead, realtime execution, and explain ability, and uncover future inquire about bearings focusing on these restrictions.


title: Iterated integrals associated with colored rooted trees

abstract: In this paper, we introduce iterated integrals associated with colored rooted trees and give proofs for the shuffle relations for $\boldsymbol{p}$-adic finite and $t$-adic symmetric polylogarithms. This method generalizes the theory of the finite multiple zeta values associated with $2$-colored rooted trees introduced by Ono.


title: Gamma-ray Pulsar Halos in the Galaxy

abstract: Pulsar halos are extended gamma-ray structures generated by electrons and positrons escaping from pulsar wind nebulae (PWNe), considered a new class of gamma-ray sources. They are ideal indicators for cosmic-ray propagation in localized regions of the Galaxy and particle escape process from PWNe. The cosmic-ray diffusion coefficient inferred from pulsar halos is more than two orders of magnitude smaller than the average value in the Galaxy, which has been arousing extensive discussion. We review the recent advances in the study of pulsar halos, including the characteristics of this class of sources, the known pulsar halos, the possible mechanisms of the extremely slow diffusion, the critical roles of pulsar halos in the studies of cosmic-ray propagation and electron injection from PWNe, and the implications on the problems of the cosmic positron excess and the diffuse TeV gamma-ray excess. Finally, we give prospects for the study in this direction based on the expectation of a larger sample of pulsar halos and deeper observations for bright sources.


title: Atomically Thin Yellow Pearl: An Impetus for Thermal Nonlinear Optical Effect Assisted Continuous Wave Random Lasing

abstract: Above cryogenic temperatures, random laser (RL) emission under continuous wave (CW) optical pumping is often challenging for materials having plenty of lattice defects. Thus, intensive care is required while fabricating the RL device. Synthesis of 2D materials having unique functionality at the atomic limit is necessary for use in such devices. In this work, defects-free 2D yellow pearl (2D-YP) has been synthesized from bulk south sea pearl using liquid-phase exfoliation (LPE) technique. Thereafter, 2D-YP has been employed as passive scatterer to achieve CW pumped RL emission from a conventional gain molecule, i.e., Rhodamine B (RhB). Compared to other semiconductor (TiO2) and 2D (Graphene and h-BN) passive scatterers, ~25 times improvement in gain volume is observed for the disordered system consisting of RhB and 2D-YP, i.e., 2D-YP@RhB, which is found to be due to the formation of a large refractive index gradient, as induced by the thermal nonlinear optical (NLO) interaction. Hence, incoherent RL (ic-RL) emission ~591 nm is reported for 2D-YP@RhB at a lowest threshold input pump power and a linewidth of 65 mW and 3 nm, respectively. Additionaly, a clear transition from ic-RL to mode tunable coherent RL (c-RL) emission is also possible by altering the configuration of the 2D-YP@RhB container. Therefore, the newly designed Van der Waals heterostructure, i.e., 2D-YP with intrinsic photon trapping capability may pave an avenue towards developing future exciting optoelectronic devices.


title: Video-based estimation of pain indicators in dogs

abstract: Dog owners are typically capable of recognizing behavioral cues that reveal subjective states of their dogs, such as pain. But automatic recognition of the pain state is very challenging. This paper proposes a novel video-based, two-stream deep neural network approach for this problem. We extract and preprocess body keypoints, and compute features from both keypoints and the RGB representation over the video. We propose an approach to deal with self-occlusions and missing keypoints. We also present a unique video-based dog behavior dataset, collected by veterinary professionals, and annotated for presence of pain, and report good classification results with the proposed approach. This study is one of the first works on machine learning based estimation of dog pain state.


title: Task-dependent fractal patterns of information processing in working memory

abstract: We applied detrended fluctuation analysis, power spectral density, and eigenanalysis of detrended cross-correlations to investigate fMRI data representing a diurnal variation of working memory in four visual tasks: two verbal and two nonverbal. We show that the degree of fractal scaling is regionally dependent on engagement in cognitive tasks. A particularly apparent difference was found between memorisation in verbal and nonverbal tasks. Furthermore, the detrended cross-correlations between brain areas were predominantly indicative of differences between resting state and other tasks, between memorisation and retrieval, and between verbal and nonverbal tasks. The fractal and spectral analyses presented in our study are consistent with previous research related to visuospatial and verbal information processing, working memory (encoding and retrieval), and executive functions, but they were found to be more sensitive than Pearson correlations and showed the potential to obtain other subtler results. We conclude that regionally dependent cognitive task engagement can be distinguished based on the fractal characteristics of BOLD signals and their detrended cross-correlation structure.


title: Generalizing Stratonovich-Weyl axioms for composite systems

abstract: The statistical model of quantum mechanics is based on the mapping between operators on the Hilbert space and functions on the phase space. This map can be implemented by an operator that satisfies physically motivated Stratonovich-Weyl axioms. Arguments are given in favour of a certain extension of the axioms, provided that there is a priori knowledge about the composite nature of the quantum system.


title: Clean-limit superconductivity in Im-3m H3S synthesized from sulfur and hydrogen donor ammonia borane

abstract: We present detailed studies of the superconductivity in high-pressure H3S. X-ray diffraction measurements show that cubic Im-3m H3S was synthesized from elemental sulfur and hydrogen donor ammonia borane (NH3BH3). Our electrical transport measurements confirm superconductivity with a transition temperature Tc = 197 K at 153 GPa. From the analysis of both the normal state resistivity and the slope of the critical field, we conclude that the superconductivity is described by clean-limit behaviour. A significant broadening of the resistive transition in finite magnetic field is found, as expected for superconductors. We identify a linear temperature-over-field scaling of the resistance at the superconducting transition which is not described by existing theories.


title: Passive Non-line-of-sight Imaging for Moving Targets with an Event Camera

abstract: Non-line-of-sight (NLOS) imaging is an emerging technique for detecting objects behind obstacles or around corners. Recent studies on passive NLOS mainly focus on steady-state measurement and reconstruction methods, which show limitations in recognition of moving targets. To the best of our knowledge, we propose a novel event-based passive NLOS imaging method. We acquire asynchronous event-based data which contains detailed dynamic information of the NLOS target, and efficiently ease the degradation of speckle caused by movement. Besides, we create the first event-based NLOS imaging dataset, NLOS-ES, and the event-based feature is extracted by time-surface representation. We compare the reconstructions through event-based data with frame-based data. The event-based method performs well on PSNR and LPIPS, which is 20% and 10% better than frame-based method, while the data volume takes only 2% of traditional method.


title: Time variability of the core-shift effect in the blazar 3C 454.3

abstract: Using VLBI to measure a so-called core shift effect is a common way of obtaining estimates of the jet magnetic field strength. The VLBI core is typically identified as the bright feature at the jet's base, and the position of the core changes with the observed frequency, $r_\mathrm{core} \propto \nu^{-1/k_r}$. In this work, we investigated the time variability of the core-shift effect in the blazar 3C 454.3. We employed self-referencing analysis of multi-frequency (5, 8, 15, 22-24, and 43 GHz) VLBA data covering 19 epochs from 2005 until 2010. We found significant core shift variability ranging from 0.27 to 0.86 mas between 5 and 43 GHz, confirming the core-shift variability phenomenon observed before. Time variability of the core-shift index ($k_r$) was found typically below one, with an average value of $0.85 \pm 0.08$ and a standard deviation of $0.30$. $k_r<1$ values were found during flaring and quiescent states and our results indicate that commonly assumed conical jet shape and equipartition conditions do not always hold simultaneously. Still, these conditions are often assumed when deriving magnetic field strengths from core shift measurements, leading to unreliable results if $k_r$ significantly deviates from unity. Therefore, it is important to verify that $k_r = 1$ holds before using core shift values and the equipartition assumption to derive physical parameters in the jets. When $k_r = 1$ epochs are selected in the case of 3C 454.3, the magnetic field estimates are indeed quite consistent, even though the core shift varies with time. Additionally, our estimations of the jet's magnetic flux in 3C 454.3 show that the source is indeed in the magnetically arrested disk state. Finally, we found a good correlation of the core position with the core flux density, $r_\mathrm{core}\propto S_\mathrm{core}^{0.7}$, which is consistent with increased particle density during the flares.


title: Stellar population of the Rosette Nebula and NGC 2244: application of the probabilistic random forest

abstract: (Abridged) In this work, we study the 2.8x2.6 deg2 region in the emblematic Rosette Nebula, centred at the young cluster NGC 2244, with the aim of constructing the most reliable candidate member list to date, determining various structural and kinematic parameters, and learning about the past and the future of the region. Starting from a catalogue containing optical to mid-infrared photometry, as well as positions and proper motions from Gaia EDR3, we apply the Probabilistic Random Forest algorithm and derive membership probability for each source. Based on the list of almost 3000 probable members, of which about a third are concentrated within the radius of 20' from the centre of NGC 2244, we identify various clustered sources and stellar concentrations, and estimate the average distance of 1489+-37 pc (entire region), 1440+-32 pc (NGC 2244) and 1525+-36 pc (NGC 2237). The masses, extinction, and ages are derived by SED fitting, and the internal dynamic is assessed via proper motions relative to the mean proper motion of NGC 2244. NGC 2244 is showing a clear expansion pattern, with an expansion velocity that increases with radius. Its IMF is well represented by two power laws (dN/dM\propto M^{-\alpha}), with slopes \alpha = 1.05+-0.02 for the mass range 0.2 - 1.5 MSun, and \alpha = 2.3+-0.3 for the mass range 1.5 - 20 MSun, in agreement with other star forming regions. The mean age of the region is ~2 Myr. We find evidence for the difference in ages between NGC 2244 and the region associated with the molecular cloud, which appears slightly younger. The velocity dispersion of NGC 2244 is well above the virial velocity dispersion derived from the total mass (1000+-70 MSun) and half-mass radius (3.4+-0.2 pc). From the comparison to other clusters and to numerical simulations, we conclude that NGC 2244 may be unbound, and possibly even formed in a super-virial state.


title: Korovkin-type results and doubly stochastic transformations over Euclidean Jordan algebras

abstract: A well-known theorem of Korovkin asserts that if $\{T_k\}$ is a sequence of positive linear transformations on $C[a,b]$ such that $T_k(h)\rightarrow h$ (in the sup-norm on $C[a,b]$) for all $h\in \{1,\phi,\phi^2\}$, where $\phi(t)=t$ on $[a,b]$, then $T_k(h)\rightarrow h$ for all $h\in C[a,b]$. In particular, if $T$ is a positive linear transformation on $C[a,b]$ such that $T(h)=h$ for all $h\in \{1,\phi,\phi^2\}$, then $T$ is the Identity transformation. In this paper, we present some analogs of these results over Euclidean Jordan algebras. We show that if $T$ is a positive linear transformation on a Euclidean Jordan algebra $V$ such that $T(h)=h$ for all $h\in \{e,p,p^2\}$, where $e$ is the unit element in $V$ and $p$ is an element of $V$ with distinct eigenvalues, then $T=T^*=I$ (the Identity transformation) on the span of the Jordan frame corresponding to the spectral decomposition of $p$; consequently, if a positive linear transformation coincides with the Identity transformation on a Jordan frame, then it is doubly stochastic. We also present sequential and weak-majorization versions.


title: Oracular Byzantine Reliable Broadcast [Extended Version]

abstract: Byzantine Reliable Broadcast (BRB) is a fundamental distributed computing primitive, with applications ranging from notifications to asynchronous payment systems. Motivated by practical consideration, we study Client-Server Byzantine Reliable Broadcast (CSB), a multi-shot variant of BRB whose interface is split between broadcasting clients and delivering servers. We present Draft, an optimally resilient implementation of CSB. Like most implementations of BRB, Draft guarantees both liveness and safety in an asynchronous environment. Under good conditions, however, Draft achieves unparalleled efficiency. In a moment of synchrony, free from Byzantine misbehaviour, and at the limit of infinitely many broadcasting clients, a Draft server delivers a $b$-bits payload at an asymptotic amortized cost of $0$ signature verifications, and $\log_2(c) + b$ bits exchanged, where $c$ is the number of clients in the system. This is the information-theoretical minimum number of bits required to convey the payload ($b$ bits, assuming it is compressed), along with an identifier for its sender ($\log_2(c)$ bits, necessary to enumerate any set of $c$ elements, and optimal if broadcasting frequencies are uniform or unknown). These two achievements have profound practical implications. Real-world BRB implementations are often bottlenecked either by expensive signature verifications, or by communication overhead. For Draft, instead, the network is the limit: a server can deliver payloads as quickly as it would receive them from an infallible oracle.


title: Structure in Theorem Proving: Analyzing and Improving the Isabelle Archive of Formal Proofs

abstract: The Isabelle Archive of Formal Proofs has grown to a significant size in the past years. It makes up for an impressive body of research, which enables a number of statistical approaches to various aspects in theorem proving, and has not yet been utilized exhaustively. However, the growing size also poses some challenges to address: Material becomes increasingly harder to find, reusability and ease of understanding become more important. This thesis abstract summarizes my research plans on those topics and briefly touches on preliminary results, which indicate that the node in-degree of the dependency graph of the archive follows a scale-free distribution.


title: Embracing Consistency: A One-Stage Approach for Spatio-Temporal Video Grounding

abstract: Spatio-Temporal video grounding (STVG) focuses on retrieving the spatio-temporal tube of a specific object depicted by a free-form textual expression. Existing approaches mainly treat this complicated task as a parallel frame-grounding problem and thus suffer from two types of inconsistency drawbacks: feature alignment inconsistency and prediction inconsistency. In this paper, we present an end-to-end one-stage framework, termed Spatio-Temporal Consistency-Aware Transformer (STCAT), to alleviate these issues. Specially, we introduce a novel multi-modal template as the global objective to address this task, which explicitly constricts the grounding region and associates the predictions among all video frames. Moreover, to generate the above template under sufficient video-textual perception, an encoder-decoder architecture is proposed for effective global context modeling. Thanks to these critical designs, STCAT enjoys more consistent cross-modal feature alignment and tube prediction without reliance on any pre-trained object detectors. Extensive experiments show that our method outperforms previous state-of-the-arts with clear margins on two challenging video benchmarks (VidSTG and HC-STVG), illustrating the superiority of the proposed framework to better understanding the association between vision and natural language. Code is publicly available at https://github.com/jy0205/STCAT.


title: Text-Adaptive Multiple Visual Prototype Matching for Video-Text Retrieval

abstract: Cross-modal retrieval between videos and texts has gained increasing research interest due to the rapid emergence of videos on the web. Generally, a video contains rich instance and event information and the query text only describes a part of the information. Thus, a video can correspond to multiple different text descriptions and queries. We call this phenomenon the ``Video-Text Correspondence Ambiguity'' problem. Current techniques mostly concentrate on mining local or multi-level alignment between contents of a video and text (\textit{e.g.}, object to entity and action to verb). It is difficult for these methods to alleviate the video-text correspondence ambiguity by describing a video using only one single feature, which is required to be matched with multiple different text features at the same time. To address this problem, we propose a Text-Adaptive Multiple Visual Prototype Matching model, which automatically captures multiple prototypes to describe a video by adaptive aggregation of video token features. Given a query text, the similarity is determined by the most similar prototype to find correspondence in the video, which is termed text-adaptive matching. To learn diverse prototypes for representing the rich information in videos, we propose a variance loss to encourage different prototypes to attend to different contents of the video. Our method outperforms state-of-the-art methods on four public video retrieval datasets.


title: Safe Reinforcement Learning of Dynamic High-Dimensional Robotic Tasks: Navigation, Manipulation, Interaction

abstract: Safety is a crucial property of every robotic platform: any control policy should always comply with actuator limits and avoid collisions with the environment and humans. In reinforcement learning, safety is even more fundamental for exploring an environment without causing any damage. While there are many proposed solutions to the safe exploration problem, only a few of them can deal with the complexity of the real world. This paper introduces a new formulation of safe exploration for reinforcement learning of various robotic tasks. Our approach applies to a wide class of robotic platforms and enforces safety even under complex collision constraints learned from data by exploring the tangent space of the constraint manifold. Our proposed approach achieves state-of-the-art performance in simulated high-dimensional and dynamic tasks while avoiding collisions with the environment. We show safe real-world deployment of our learned controller on a TIAGo++ robot, achieving remarkable performance in manipulation and human-robot interaction tasks.


title: Elements of a Lie algebra acting nilpotently in all its representations

abstract: An equivalent condition for an element of a Lie algebra acting nilpotently in all its representations is obtained. Namely, it should belong to the derived algebra and go via factoring over the radical to a nilpotent element of the corresponding (semisimple) quotient algebra.


title: Elastic properties of nuclear pasta in a fully three-dimensional geometry

abstract: Realistic estimations on the elastic properties of neutron star matter are carried out with a large strain ($\varepsilon \lesssim 0.5$) in the framework of relativistic-mean-field model with Thomas-Fermi approximation, where various crystalline configurations are considered in a fully three-dimensional geometry with reflection symmetry. Our calculation confirms the validity of assuming Coulomb crystals for the droplet phase above neutron drip density, which nonetheless does not work at large densities since the elastic constants are found to be decreasing after reaching their peaks. Similarly, the analytic formulae derived in the incompressible liquid-drop model give excellent description for the rod phase at small densities, which overestimates the elastic constants at larger densities. For slabs, due to the negligence on the variations of their thicknesses, the analytic formulae from liquid-drop model agree qualitatively but not quantitatively with our numerical estimations. By fitting to the numerical results, these analytic formulae are improved by introducing dampening factors. The impacts of nuclear symmetry energy are examined adopting two parameter sets, corresponding to the slope of symmetry energy $L = 41.34$ and 89.39 MeV. Even with the uncertainties caused by the anisotropy in polycrystallines, the elastic properties of neutron star matter obtained with $L = 41.34$ and 89.39 MeV are distinctively different, results in detectable differences in various neutron star activities.


title: Optimal Placement of Base Stations in Border Surveillance using Limited Capacity Drones

abstract: Imagine an island modeled as a simple polygon $\P$ with $n$ vertices whose coastline we wish to monitor. We consider the problem of building the minimum number of refueling stations along the boundary of $\P$ in such a way that a drone can follow a polygonal route enclosing the island without running out of fuel. A drone can fly a maximum distance $d$ between consecutive stations and is restricted to move either along the boundary of $\P$ or its exterior (i.e., over water). We present an algorithm that, given $\mathcal P$, finds the locations for a set of refueling stations whose cardinality is at most the optimal plus one. The time complexity of this algorithm is $O(n^2 + \frac{L}{d} n)$, where $L$ is the length of $\mathcal P$. We also present an algorithm that returns an additive $\epsilon$-approximation for the problem of minimizing the fuel capacity required for the drones when we are allowed to place $k$ base stations around the boundary of the island; this algorithm also finds the locations of these refueling stations. Finally, we propose a practical discretization heuristic which, under certain conditions, can be used to certify optimality of the results.


title: Determination of pion distribution amplitudes from the electromagnetic form factor with the data-driven dispersion relation

abstract: We study the pion electromagnetic form factor in the modulus squared dispersion relation, and do the model independent extraction of the most important nonperturbative parameters in pion light-cone distribution amplitude. The motivation of this work is the recent measurement of timelike form factor in the resonant regions, which makes up the piece lacking solid QCD-based calculation. With the perturbative QCD calculation up to next-to-leading-order QCD corrections and twist four level of meson distribution amplitudes, we obtain the chiral mass of pion meson as $m_0^\pi(1 \, {\rm GeV}) = 1.31^{+0.27}_{-0.30} \, {\rm GeV}$. More accuracy measurement of the timelike form factor are desirable to help us to determine the lowest gegenbauer moments in pion distribution amplitudes with the data-driven dispersion relation method developed in this work.


title: Magnetogenesis from early structure formation due to Yukawa forces

abstract: Yukawa interactions can mediate relatively long-range attractive forces between fermions in the early universe. Such a globally attractive interaction creates an instability that can result in the growth of structure in the affected species even during the radiation dominated era. The formation and collapse of fermionic microhalos can create hot fireballs at the sites of the collapsing halos which inject energy into the cosmic plasma. In this paper we study a new phenomena which can take place in such models. We show that the injected energy can be partially converted into primordial magnetic fields and we estimate the correlation scale and the power spectrum of these fields. We show that they may be the seeds of the observed astrophysical magnetic fields.


title: Non-maturing deposits modelling in a Ornstein-Uhlenbeck framework

abstract: This paper builds a multivariate L\'evy-driven Ornstein-Uhlenbeck process for the management of non-maturing deposits, that are a major source of funding for banks. The contribution of the paper is both theoretical and operational. On the theoretical side, the novelty of this model is to include three independent sources of randomness in a L\'evy framework: market interest rates, deposit rates and deposit volumes. The choice of a L\'evy background driving process allows us to model rare but severe events. On the operational side, we propose a procedure to include severe volume outflows with positive probability in future scenarios simulation, explaining its implementation with an illustrative example using Italian banking sector data.


title: Validity of sound-proof approximations for magnetic buoyancy

abstract: The presence of acoustic waves in models of compressible flows can present complications for analytical and numerical analysis. Therefore, several methods have been developed to filter out these waves, leading to various "sound-proof" models, including the Boussinesq, anelastic and pseudo-incompressible models. We assess the validity of each of these approximate models for describing magnetic buoyancy in the context of the solar interior. A general sound-proof model is introduced and compared to the fully compressible system in a number of asymptotic regimes, including both non-rotating and rotating cases. We obtain specific constraints that must be satisfied in order that the model captures the leading-order behaviour of the fully compressible system. We then discuss which of the existing sound-proof models satisfy these constraints, and in what parameter regimes. We also present a variational derivation of the pseudo-incompressible MHD model, demonstrating its underlying Hamiltonian structure.


title: A non-inductive magnetic eye-tracker: from dipole tracking to gaze retrieval

abstract: We analyze the information that can be retrieved from the tracking parameters produced by an innovative wearable eye tracker. The latter is based on a permanent-magnet marked corneal lens and by an array of magnetoresistive detectors that measure the magnetostatic field in several positions in the eye proximity. We demonstrate that, despite missing information due to the axial symmetry of the measured field, physiological constraints or measurement conditions make possible to infer complete eye-pose data. Angular precision and accuracy achieved with the current prototypical device are also assessed and briefly discussed. The results show that the instrumentation considered is suitable as a new, moderately invasive medical diagnostics for the characterization of ocular movements and associated disorders.


title: A two-parameter deformation of the quasi-shuffle\\ and new bases of quasi-symmetric functions

abstract: We define a two-parameter deformation of the quasi-shuffle by means of the formal group law associated with the exponential generating function of the homogeneous Eulerian polynomials, and construct bases of $QSym$ and $\WQSym$ whose product rule is given by this operation.


title: Modeling and Control of Discrete Event Systems under Joint Sensor-Actuator Cyber Attacks

abstract: In this paper, we investigate joint sensor-actuator cyber attacks in discrete event systems. We assume that attackers can attack some sensors and actuators at the same time by altering observations and control commands. Because of the nondeterminism in observation and control caused by cyber attacks, the behavior of the supervised system becomes nondeterministic and may deviate from the safety specification. We define the upper-bound on all possible languages that can be generated by the supervised system to investigate the safety supervisory control problem under cyber attacks. After introducing CA-controllability and CA-observability, we prove that the supervisory control problem under cyber attacks is solvable if and only if the given specification language is CA-controllable and CA-observable. Furthermore, we obtain methods to calculate the state estimates under sensor attacks and to synthesize a state-estimate-based supervisor to achieve a given safety specification under cyber attacks. We further show that of all the solutions, the proposed state-estimate-based supervisor is maximally-permissive.


title: Bounds for the reduction number of primary ideal in dimension three

abstract: Let $(R,\mathfrak{m})$ be a Cohen-Macaulay local ring of dimension $d\geq 3$ and $I$ an $\mathfrak{m}$-primary ideal of $R$. Let $r_J(I)$ be the reduction number of $I$ with respect to a minimal reduction $J$ of $I$. Suppose depth $G(I)\geq d-3$. We prove that $r_J(I)\leq e_1(I)-e_0(I)+\lambda(R/I)+1+(e_2(I)-1)e_2(I)-e_3(I)$, where $e_i(I)$ are Hilbert coefficients. Suppose $d=3$ and depth $G(I^t)>0$ for some $t\geq 1$. Then we prove that $r_J(I)\leq e_1(I)-e_0(I)+\lambda(R/I)+t$.


title: Measure equivalence rigidity via s-malleable deformations

abstract: We single out a large class of groups ${\mathscr{M}}$ for which the following unique prime factorization result holds: if $\Gamma_1,\dots,\Gamma_n\in {\mathscr{M}}$ and $\Gamma_1\times\dots\times\Gamma_n$ is measure equivalent to a product $\Lambda_1\times\dots\times\Lambda_m$ of infinite icc groups, then $n \ge m$, and if $n = m$ then, after permutation of the indices, $\Gamma_i$ is measure equivalent to $\Lambda_i$, for all $1\leq i\leq n$. This provides an analogue of Monod and Shalom's theorem \cite{MS02} for groups that belong to ${\mathscr{M}}$. Class ${\mathscr{M}}$ is constructed using groups whose von Neumann algebras admit an s-malleable deformation in the sense of Sorin Popa and it contains all icc non-amenable groups $\Gamma$ for which either (i) $\Gamma$ is an arbitrary wreath product group with amenable base or (ii) $\Gamma$ admits an unbounded 1-cocycle into its left regular representation. Consequently, we derive several orbit equivalence rigidity results for actions of product groups that belong to ${\mathscr{M}}$. Finally, for groups $\Gamma$ satisfying condition (ii), we show that all embeddings of group von Neumann algebras of non-amenable inner amenable groups into $L(\Gamma)$ are ``rigid". In particular, we provide an alternative solution to a question of Popa that was recently answered in \cite{DKEP22}.


title: A panchromatic view of infrared quasars: excess star formation and radio emission in the most heavily obscured systems

abstract: To understand the Active Galactic Nuclei (AGN) phenomenon and their impact on the evolution of galaxies, a complete AGN census is required; however, finding heavily obscured AGNs is observationally challenging. Here we use the deep and extensive multi-wavelength data in the COSMOS field to select a complete sample of 578 infrared (IR) quasars ($L_{\rm AGN,IR}>10^{45}\rm \: erg\: s^{-1}$) at $z<3$, with minimal obscuration bias, using detailed UV-to-far IR spectral energy distribution (SED) fitting. We complement our SED constraints with X-ray and radio observations to further investigate the properties of the sample. Overall, 322 of the IR quasars are detected by Chandra and have individual X-ray spectral constraints. From a combination of X-ray stacking and $L_{\rm 2-10\rm keV}$ - $L_{\rm 6\: \mu m}$ analyses, we show that the majority of the X-ray faint and undetected quasars are heavily obscured (many are likely Compton thick), highlighting the effectiveness of the mid-IR band to find obscured AGNs. We find that 355 ($\approx$61%) IR quasars are obscured ($N_{\rm H}>10^{22}\rm \: cm^{-2}$) and identify differences in the average properties between the obscured and unobscured quasars: (1) obscured quasars have star-formation rates $\approx 3$ times higher than unobscured systems for no significant difference in stellar mass and (2) obscured quasars have stronger radio emission than unobscured systems, with a radio-loudness parameter $\approx 0.2 \rm \: dex$ higher. These results are inconsistent with a simple orientation model but in general agreement with either extreme host-galaxy obscuration towards the obscured quasars or a scenario where obscured quasars are an early phase in the evolution of quasars.


title: The *-product approach for linear ODEs: a numerical study of the scalar case

abstract: Solving systems of non-autonomous ordinary differential equations (ODE) is a crucial and often challenging problem. Recently a new approach was introduced based on a generalization of the Volterra composition. In this work, we explain the main ideas at the core of this approach in the simpler setting of a scalar ODE. Understanding the scalar case is fundamental since the method can be easily extended to the more challenging problem of systems of ODEs. Numerical examples illustrate the method's efficacy and its properties in the scalar case.


title: A Fog-Based Security Framework for Large-Scale Industrial Internet of Things Environments

abstract: The Industrial Internet of Things (IIoT) is a developing research area with potential global Internet connectivity, turning everyday objects into intelligent devices with more autonomous activities. IIoT services and applications are not only being used in smart homes and smart cities, but they have also become an essential element of the Industry 4.0 concept. The emergence of the IIoT helps traditional industries simplify production processes, reduce production costs, and improve industrial efficiency. However, the involvement of many heterogeneous devices, the use of third-party software, and the resource-constrained nature of the IoT devices bring new security risks to the production chain and expose vulnerabilities to the systems. The Distributed Denial of Service (DDoS) attacks are significant, among others. This article analyzes the threats and attacks in the IIoT and discusses how DDoS attacks impact the production process and communication dysfunctions with IIoT services and applications. This article also proposes a reference security framework that enhances the advantages of fog computing to demonstrate countermeasures against DDoS attacks and possible strategies to mitigate such attacks at scale.


title: pulsar_spectra: A pulsar flux density catalogue and spectrum fitting repository

abstract: We present the pulsar_spectra software repository, an open-source pulsar flux density catalogue and automated spectral fitting software that finds the best spectral model and produces publication-quality plots. The Python-based software includes features that enable users in the astronomical community to add newly published spectral measurements to the catalogue as they become available. The spectral fitting software is an implementation of the method described in Jankowski et al. (2018) which uses robust statistical methods to decide on the best-fitting model for individual pulsar spectra. pulsar_spectra is motivated by the need for a centralised repository for pulsar flux density measurements to make published measurements more accessible to the astronomical community and provide a suite of tools for measuring spectra.


title: Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models

abstract: Transformer architecture has become the fundamental element of the widespread natural language processing~(NLP) models. With the trends of large NLP models, the increasing memory and computation costs hinder their efficient deployment on resource-limited devices. Therefore, transformer quantization attracts wide research interest. Recent work recognizes that structured outliers are the critical bottleneck for quantization performance. However, their proposed methods increase the computation overhead and still leave the outliers there. To fundamentally address this problem, this paper delves into the inherent inducement and importance of the outliers. We discover that $\boldsymbol \gamma$ in LayerNorm (LN) acts as a sinful amplifier for the outliers, and the importance of outliers varies greatly where some outliers provided by a few tokens cover a large area but can be clipped sharply without negative impacts. Motivated by these findings, we propose an outlier suppression framework including two components: Gamma Migration and Token-Wise Clipping. The Gamma Migration migrates the outlier amplifier to subsequent modules in an equivalent transformation, contributing to a more quantization-friendly model without any extra burden. The Token-Wise Clipping takes advantage of the large variance of token range and designs a token-wise coarse-to-fine pipeline, obtaining a clipping range with minimal final quantization loss in an efficient way. This framework effectively suppresses the outliers and can be used in a plug-and-play mode. Extensive experiments prove that our framework surpasses the existing works and, for the first time, pushes the 6-bit post-training BERT quantization to the full-precision (FP) level. Our code is available at https://github.com/wimh966/outlier_suppression.


title: Exact augmented Lagrangian duality for mixed integer convex optimization

abstract: Augmented Lagrangian dual augments the classical Lagrangian dual with a non-negative non-linear penalty function of the violation of the relaxed/dualized constraints in order to reduce the duality gap. We investigate the cases in which mixed integer convex optimization problems have an exact penalty representation using sharp augmenting functions (norms as augmenting penalty functions). We present a generalizable constructive proof technique for proving existence of exact penalty representations for mixed integer convex programs under specific conditions using the associated value functions. This generalizes the recent results for MILP (Feizollahi, Ahmed and Sun, 2017) and MIQP (Gu, Ahmed and Dey 2020) whilst also providing an alternative proof for the aforementioned along with quantification of the finite penalty parameter in these cases.


title: Lotka-Volterra competition models on finite graphs

abstract: In this paper, we study three two competing species Lotka-Volterra competition models on finite connected graphs, with Dirichlet, Neumann or no boundary conditions. We get that when time goes to infinity, either one specie extincts while the other becomes surviving or both competing species coexist, which depend crucially on the strengh of species' competitiveness and the size of the initial population under the Neumann boundary condition and the condition that there is no boundary condition. One of our results partially answer a question posed by Slav\'{\i}k in [SIAM J. Appl. Dyn. Syst., 19 (2020)]. The critical techiniques in the proof of our main results are upper and lower solutions method, which are developed for weakly coupled parabolic systems on finite graphs in this article.


title: Hydrogen dynamics on defective monolayer graphene

abstract: The hydrogen dynamics on a graphene sheet is studied in the presence of carbon vacancies. We analyze the motion of atomic H by means of molecular dynamics (MD) simulations, using a tight-binding Hamiltonian fitted to density-functional calculations. Hydrogen passivates the dangling bonds of C atoms close to a vacancy, forming C--H bonds with H located at one or the other side of the layer plane. The hydrogen dynamics has been studied from statistical analysis of MD trajectories, along with the autocorrelation function of the atomic coordinates. For a single H atom, we find an effective barrier of 0.40~eV for crossing the graphene layer, with a jump rate $\nu = 2 \times 10^6$~s$^{-1}$ at 300~K. The atomic jumps behave as stochastic events, and their number for a given temperature and time interval follows a Poisson probability distribution. For two H atoms close to a vacancy, strong correlations in the atomic dynamics are found, with a lower jump frequency $\nu = 7 \times 10^2$~s$^{-1}$ at room temperature. These results provide insight into the diffusion mechanisms of hydrogen on graphene, paving the way for a complete understanding of its motion through defective crystalline membranes.


title: Improved Hardy inequalities with a class of weights

abstract: \begin{abstract} In the paper we state conditions on potentials $V$ to get the improved Hardy inequality with weight \begin{equation*} \begin{split} c_{N,\mu}\int_{\R^N}\frac{\varphi^2}{|x|^2}\mu(x)dx&+ \int_{\R^N}V\,\varphi^2\mu(x)dx \\&\le \int_{\R^N}|\nabla \varphi|^2\mu(x)dx +K_1 \int_{\R^N} \varphi^2\mu(x)dx, \end{split} \end{equation*} for functions $\varphi$ in a weighted Sobolev space and for weight functions $\mu$ of a quite general type. Some local improved Hardy inequalities are also given. To get the results we use a generalized vector field method. \end{abstract}


title: Analysis methods to localize and characterize X-ray sources with the Micro-channel X-ray Telescope on board the SVOM satellite

abstract: SVOM is a Sino-French space mission targeting high-energy transient astrophysical objects such as gamma-ray bursts. The soft X-ray part of the spectrum is covered by the Micro-channel X-ray Telescope (MXT) which is a narrow field telescope designed to precisely localize X-ray sources. This paper presents the method implemented on-board to characterize and localize X-ray sources with the MXT. A specific localization method was developed to accommodate the optical system of the MXT, which is based on "Lobster-Eye" grazing incidence micro-pore optics. For the first time, the algorithm takes advantage of cross-correlation techniques to achieve a localization accuracy down to 2 arcmin with less than 200 photons, which guarantees a rapid follow-up for most of the gamma-ray bursts that SVOM will observe. In this paper, we also study the limitations of the algorithm and characterize its performance.


title: EditEval: An Instruction-Based Benchmark for Text Improvements

abstract: Evaluation of text generation to date has primarily focused on content created sequentially, rather than improvements on a piece of text. Writing, however, is naturally an iterative and incremental process that requires expertise in different modular skills such as fixing outdated information or making the style more consistent. Even so, comprehensive evaluation of a model's capacity to perform these skills and the ability to edit remains sparse. This work presents EditEval: An instruction-based, benchmark and evaluation suite that leverages high-quality existing and new datasets for automatic evaluation of editing capabilities such as making text more cohesive and paraphrasing. We evaluate several pre-trained models, which shows that InstructGPT and PEER perform the best, but that most baselines fall below the supervised SOTA, particularly when neutralizing and updating information. Our analysis also shows that commonly used metrics for editing tasks do not always correlate well, and that optimization for prompts with the highest performance does not necessarily entail the strongest robustness to different models. Through the release of this benchmark and a publicly available leaderboard challenge, we hope to unlock future research in developing models capable of iterative and more controllable editing.


title: Continuous approximation by convolutional neural networks with a sigmoidal function

abstract: In this paper we present a class of convolutional neural networks (CNNs) called non-overlapping CNNs in the study of approximation capabilities of CNNs. We prove that such networks with sigmoidal activation function are capable of approximating arbitrary continuous function defined on compact input sets with any desired degree of accuracy. This result extends existing results where only multilayer feedforward networks are a class of approximators. Evaluations elucidate the accuracy and efficiency of our result and indicate that the proposed non-overlapping CNNs are less sensitive to noise.


title: Shape model and rotation acceleration of (1685) Toro and (85989) 1999 JD6 from optical observations

abstract: The Yarkovsky-O'Keefe-Radzievskii-Paddack (YORP) effect is a net torque caused by solar radiation directly reflected and thermally re-emitted from the surface of small asteroids and is considered to be crucial in their dynamical evolution. By long-term photometric observations of selected near-Earth asteroids, it's hoped to enlarge asteroid samples with a detected YORP effect to facilitate the development of a theoretical framework. Archived light-curve data are collected and photometric observations are made for (1685) Toro and (85989) 1999 JD6, which enables measurement of their YORP effect by inverting the light curve to fit observations from a convex shape model. For (1685) Toro, a YORP acceleration $\upsilon=(3.2\pm0.3)\times10^{-9}\ \rm{rad\cdot d^{-2}}(1\sigma\ error)$ is updated, which is consistent with previous YORP detection based on different light-curve data; for (85989) 1999 JD6, it is determined that the sidereal period is $7.667749\pm 0.000009$ h, the rotation pole direction locates is at $\lambda=232\pm 2^{\circ},\ \beta = -59\pm 1^{\circ}$, the acceleration is detected to be $\upsilon = (2.4\pm0.3)\times10^{-8}\ \rm{rad\cdot d^{-2}}(1\sigma\ error)$ and in addition to obtaining an excellent agreement between the observations and model. YORP should produce both spin-up and spin-down cases. However, including (85989) 1999 JD6, the $\rm{d}\omega/\rm{d}t$ values of eleven near-Earth asteroids are positive totally, which suggests that there is either a bias in the sample of YORP detections or a real feature needs to be explained.


title: High order approximations of the Cox-Ingersoll-Ross process semigroup using random grids

abstract: We present new high order approximations schemes for the Cox-Ingersoll-Ross (CIR) process that are obtained by using a recent technique developed by Alfonsi and Bally (2021) for the approximation of semigroups. The idea consists in using a suitable combination of discretization schemes calculated on different random grids to increase the order of convergence. This technique coupled with the second order scheme proposed by Alfonsi (2010) for the CIR leads to weak approximations of order $2k$, for all $k\in\mathbb{N}^*$. Despite the singularity of the square-root volatility coefficient, we show rigorously this order of convergence under some restrictions on the volatility parameters. We illustrate numerically the convergence of these approximations for the CIR process and for the Heston stochastic volatility model and show the computational time gain they give.


title: PROD: Progressive Distillation for Dense Retrieval

abstract: Knowledge distillation is an effective way to transfer knowledge from a strong teacher to an efficient student model. Ideally, we expect the better the teacher is, the better the student. However, this expectation does not always come true. It is common that a better teacher model results in a bad student via distillation due to the nonnegligible gap between teacher and student. To bridge the gap, we propose PROD, a PROgressive Distillation method, for dense retrieval. PROD consists of a teacher progressive distillation and a data progressive distillation to gradually improve the student. We conduct extensive experiments on five widely-used benchmarks, MS MARCO Passage, TREC Passage 19, TREC Document 19, MS MARCO Document and Natural Questions, where PROD achieves the state-of-the-art within the distillation methods for dense retrieval. The code and models will be released.


title: Machine learning-accelerated chemistry modeling of protoplanetary disks

abstract: Aims. With the large amount of molecular emission data from (sub)millimeter observatories and incoming James Webb Space Telescope infrared spectroscopy, access to fast forward models of the chemical composition of protoplanetary disks is of paramount importance. Methods. We used a thermo-chemical modeling code to generate a diverse population of protoplanetary disk models. We trained a K-nearest neighbors (KNN) regressor to instantly predict the chemistry of other disk models. Results. We show that it is possible to accurately reproduce chemistry using just a small subset of physical conditions, thanks to correlations between the local physical conditions in adopted protoplanetary disk models. We discuss the uncertainties and limitations of this method. Conclusions. The proposed method can be used for Bayesian fitting of the line emission data to retrieve disk properties from observations. We present a pipeline for reproducing the same approach on other disk chemical model sets.

categories: astro-ph.EP astro-ph.IM astro-ph.SR cs.LG


title: Solutions and Singularities of the Semigeostrophic Equations via the Geometry of Lagrangian Submanifolds

abstract: Using Monge-Amp\`ere geometry, we study the singular structure of a class of nonlinear Monge-Amp\`ere equations in three dimensions, arising in geophysical fluid dynamics. We extend seminal earlier work on Monge-Amp\`ere geometry by examining the role of an induced metric on Lagrangian submanifolds of the cotangent bundle. In particular, we show that the signature of the metric serves as a classification of the Monge-Amp\`ere equation, while singularities and elliptic-hyperbolic transitions are revealed by the degeneracies of the metric. The theory is illustrated by application to an example solution of the semigeostrophic equations.


title: Large network community detection by fast label propagation

abstract: Many networks exhibit some community structure. There exists a wide variety of approaches to detect communities in networks, each offering different interpretations and associated algorithms. For large networks, there is the additional requirement of speed. In this context, the so-called label propagation algorithm (LPA) was proposed, which runs in near-linear time. In partitions uncovered by LPA, each node is ensured to have most links to its assigned community. We here propose a fast variant of LPA (FLPA) that is based on processing a queue of nodes whose neighbourhood recently changed. We test FLPA exhaustively on benchmark networks and empirical networks, finding that it can run up to 700 times faster than LPA. In partitions found by FLPA, we prove that each node is again guaranteed to have most links to its assigned community. Our results show that FLPA is generally preferable to LPA.


title: Clubs and their applications

abstract: Clubs of rank k are well-celebrated objects in finite geometries introduced by Fancsali and Sziklai in 2006. After the connection with a special type of arcs known as KM-arcs, they renewed their interest. This paper aims to study clubs of rank n in PG$(1,q^n)$. We provide a classification result for (n-2)-clubs of rank n, we analyze the $\mathrm{\Gamma L}(2,q^n)$-equivalence of the known subspaces defining clubs, for some of them the problem is then translated in determining whether or not certain scattered spaces are equivalent. Then we find a polynomial description of the known families of clubs via some linearized polynomials. Then we apply our results to the theory of blocking sets, KM-arcs, polynomials and rank metric codes, obtaining new constructions and classification results.


title: Evolution of entanglement entropy in strongly correlated bosons in an optical lattice

abstract: We investigate the time evolution of the second-order R\'enyi entropy (RE) for bosons in a one-dimensional optical lattice following a sudden quench of the hopping amplitude $J$. Specifically, we examine systems that are quenched into the strongly correlated Mott-insulating (MI) regime with $J/U\ll 1$ ($U$ denotes the strength of the on-site repulsive interaction) from the MI limit with $J=0$. In this regime, the low-energy excited states can be effectively described by fermionic quasiparticles known as doublons and holons. They are excited in entangled pairs through the quench dynamics. By developing an effective theory, we derive a direct relation between the RE and correlation functions associated with doublons and holons. This relation allows us to analytically calculate the RE and obtain a physical picture for the RE, both in the ground state and during time evolution through the quench dynamics, in terms of doublon holon pairs. In particular, we show that the RE is proportional to the population of doublon-holon pairs that span the boundary of the subsystem. Our quasiparticle picture introduces some remarkable features that are absent in previous studies on the dynamics of entanglement entropy in free-fermion models. It provides with valuable insights into the dynamics of entanglement entropy in strongly-correlated systems.


title: $S_3$-Permutation Orbifolds of Virasoro Vertex Algebras

abstract: In this paper, a continuation of \cite{MPS}, we investigate the $S_3$-orbifold subalgebra of $(\mathcal{V}_c)^{\otimes 3}$, that is, we consider the $S_3$-fixed point vertex subalgebra of the tensor product of three copies of the universal Virasoro vertex operator algebras $\mathcal{V}_c$. Our main result is construction of a minimal, strong set of generators of this subalgebra for any generic values of $c$. More precisely, we show that this vertex algebra is of type $(2,4,6^2,8^2,9,10^2,11,12^3)$. We also investigate two prominent examples of simple $S_3$-orbifold algebras corresponding to central charges $c=\frac12$ (Ising model) and $c=-\frac{22}{5}$ (i.e. $(2,5)$-minimal model). We prove that the former is a new unitary $W$-algebra of type $(2,4,6,8)$ and the latter is isomorphic to the affine simple $W$-algebra of type $\frak{g}_2$ at non-admissible level $-\frac{19}{6}$. We also provide another version of this isomorphism using the affine $W$-algebra of type $\frak{g}_2$ coming from a subregular nilpotent element.


title: Order-disorder Peierls instability in the kagome metal (Cs,Rb)V$_3$Sb$_5$

abstract: The nature of the charge density wave phases in the kagome metal compound AV$_3$Sb$_5$ has raised many questions and their origin is still under debate. Here, we combine diffuse scattering (DS) and inelastic x-ray scattering (IXS) to identify a 3-dimensional (3D) precursor of the charge order with propagation vector (0.5 0 0.5), which condenses into a 3D-CDW through a first order phase transition. The quasi-elastic critical scattering indicates that the dominant contribution to the diffuse precursor is the elastic central peak without phonon softening. However, the inelastic spectra show a small broadening of the Einstein-type phonon mode on approaching the phase transition. Our results point to the situation where the Fermi surface instability at the \textit{L} point is of order-disorder type with a critical growth of quasi-static domains. The results go beyond the classical weak-coupling Peierls transition dynamics and are discussed within models including strong-electron phonon coupling and non-adiabaticity.


title: Semigroup intersection problems in the Heisenberg groups

abstract: We consider two algorithmic problems concerning sub-semigroups of Heisenberg groups and, more generally, two-step nilpotent groups. The first problem is Intersection Emptiness, which asks whether a finite number of given finitely generated semigroups have empty intersection. This problem was first studied by Markov in the 1940s. We show that Intersection Emptiness is PTIME decidable in the Heisenberg groups $\operatorname{H}_{n}(\mathbb{K})$ over any algebraic number field $\mathbb{K}$, as well as in direct products of Heisenberg groups. We also extend our decidability result to arbitrary finitely generated 2-step nilpotent groups. The second problem is Orbit Intersection, which asks whether the orbits of two matrices under multiplication by two semigroups intersect with each other. This problem was first studied by Babai et al. (1996), who showed its decidability within commutative matrix groups. We show that Orbit Intersection is decidable within the Heisenberg group $\operatorname{H}_{3}(\mathbb{Q})$.


title: BiFold: A Python code for the calculation of double folded (bifold) potentials with density-in/dependent nucleon-nucleon interactions

abstract: BiFold calculates the density-dependent (DDM3Y$n$, BDM3Y$n$, CDM3Y$n$) or independent double folded potentials between two colliding spherical nuclei. It is written in a Python package form to give the ability to use the potentials directly in a nuclear reaction/structure code. In addition to using Woods-Saxon/Fermi or Gaussian functions, the code also allows for the definition of nuclear matter densities using pre-calculated densities in a data file. The manuscript provides an overview of the double folding model and the use of the code.


title: HD 23472: A multi-planetary system with three super-Earths and two potential super-Mercuries

abstract: We report the characterisation of a multi-planetary system composed of five exoplanets orbiting the K-dwarf HD~23472 (TOI-174). In addition to the two super-Earths that were previously confirmed, we confirm and characterise three Earth-size planets in the system using ESPRESSO radial velocity observations. The planets of this compact system have periods of $P_d \sim 3.98\,$, $P_e \sim 7.90\,$, $P_f \sim 12.16\,$, $P_b \sim 17.67,\,$ and $P_c \sim 29.80\,$days and radii of $R_d \sim 0.75\,$ , $R_e \sim 0.82,$, $R_f \sim 1.13\,$, $R_b \sim 2.01,\,$ and, $R_c \sim 1.85\,$ \REarth. Because of its small size, its proximity to planet d's transit, and close resonance with planet d, planet e was only recently found. The planetary masses were estimated to be $M_d =0.54\pm0.22$, $M_e =0.76\pm0.30$, $M_f =0.64_{-0.39}^{+0.46}$, $M_b = 8.42_{-0.84}^{+0.83}$, and $M_c = 3.37_{-0.87}^{+0.92}$ \MEarth. These planets are among the lightest planets, with masses measured using the radial velocity method, demonstrating the very high precision of the ESPRESSO spectrograph. We estimated the composition of the system's five planets and found that their gas and water mass fractions increase with stellar distance, suggesting that the system was shaped by irradiation. The high density of the two inner planets ($\rho_d = 7.5_{-3.1}^{+3.9}$ and $\rho_e = 7.5_{-3.0}^{+3.9}\, \mathrm{g.cm^{-3}}$) indicates that they are likely to be super-Mercuries. This is supported by the modelling of the internal structures of the planets, which also suggests that the three outermost planets have significant water or gas content If the existence of two super-Mercuries in the system is confirmed, this system will be the only one known to feature two super-Mercuries, making it an excellent testing bed for theories of super-Mercuries formation. (Abridged)


title: Presheaves of groupoids as models for homotopy types

abstract: We introduce the notion of groupoidal (weak) test category, which is a small category A such that the groupoid-valued presheaves over A models homotopy types in a "canonical and nice" way. The definition does not require a priori that A is a (weak) test category, but we prove twon important comparison results: (1) every weak test category is a groupoidal weak test category, (2) a category is a test category if and only if it is a groupoidal test category. As an application, we obtain new models for homotopy types, such as the category of groupoids internal to cubical sets with or without connections, the category of groupoids internal to cellular sets, the category of groupoids internal to semi-simplicial sets, etc. We also prove, as a by-product result, that the category of groupoids internal to the category of small categories models homotopy types.


title: Solving homogeneous linear equations over polynomial semirings

abstract: For a subset $B$ of $\mathbb{R}$, denote by $\operatorname{U}(B)$ be the semiring of (univariate) polynomials in $\mathbb{R}[X]$ that are strictly positive on $B$. Let $\mathbb{N}[X]$ be the semiring of (univariate) polynomials with non-negative integer coefficients. We study solutions of homogeneous linear equations over the polynomial semirings $\operatorname{U}(B)$ and $\mathbb{N}[X]$. In particular, we prove local-global principles for solving single homogeneous linear equations over these semirings. We then show PTIME decidability of determining the existence of non-zero solutions over $\mathbb{N}[X]$ of single homogeneous linear equations. Our study of these polynomial semirings is largely motivated by several semigroup algorithmic problems in the wreath product $\mathbb{Z} \wr \mathbb{Z}$. As an application of our results, we show that the Identity Problem (whether a given semigroup contains the neutral element?) and the Group Problem (whether a given semigroup is a group?) for finitely generated sub-semigroups of the wreath product $\mathbb{Z} \wr \mathbb{Z}$ is decidable when elements of the semigroup generator have the form $(y, \pm 1)$.


title: Towards Real Time Thermal Simulations for Design Optimization using Graph Neural Networks

abstract: This paper presents a method to simulate the thermal behavior of 3D systems using a graph neural network. The method discussed achieves a significant speed-up with respect to a traditional finite-element simulation. The graph neural network is trained on a diverse dataset of 3D CAD designs and the corresponding finite-element simulations, representative of the different geometries, material properties and losses that appear in the design of electronic systems. We present for the transient thermal behavior of a test system. The accuracy of the network result for one-step predictions is remarkable (\SI{0.003}{\%} error). After 400 time steps, the accumulated error reaches \SI{0.78}{\%}. The computing time of each time step is \SI{50}{ms}. Reducing the accumulated error is the current focus of our work. In the future, a tool such as the one we are presenting could provide nearly instantaneous approximations of the thermal behavior of a system that can be used for design optimization.

categories: cs.CE cs.LG cs.SY eess.SY physics.comp-ph


title: Cosmological Simulation of Galaxy Groups and Clusters-II: Studying Different Modes of Feedback through X-ray Observations

abstract: The impact of feedback from Active Galactic Nuclei (AGN) on the cosmological evolution of the large scale structure is a long studied problem. However, it is still not well understood how the feedback energy couples to the ambient medium to influence the properties of AGN host galaxies and dark matter halos. In this work we investigate different modes of AGN feedback and their effect on the surrounding medium by probing the diffuse X-ray emission from the hot gas inside galaxy groups and clusters. For this purpose, we use the cosmological hydrodynamic simulation SIMBA to theoretically calculate the X-ray emission from simulated galaxy clusters/groups with the help of the Astrophysical Plasma Emission Code (APEC). We also perform synthetic observations of these systems with the Chandra X-ray telescope using the ray-tracing simulator Model of AXAF Response to X-rays (MARX). Our results show that in addition to the radiative wind mode of feedback from the AGN, jet and X-ray mode of feedback play significant roles in suppressing the X-ray emission from the diffuse gas in the vicinity of the black hole. Our mock observational maps suggest that the signatures of AGN feedback from the high redshift objects may not be detected with the instrumental resolution of current X-ray telescopes like Chandra, but provide promising prospect for detection of these features with potential X-ray missions such as Lynx.


title: Statistical Analysis of Time-Frequency Features Based On Multivariate Synchrosqueezing Transform for Hand Gesture Classification

abstract: In this study, the four joint time-frequency (TF) moments; mean, variance, skewness, and kurtosis of TF matrix obtained from Multivariate Synchrosqueezing Transform (MSST) are proposed as features for hand gesture recognition. A publicly available dataset containing surface EMG (sEMG) signals of 40 subjects performing 10 hand gestures, was used. The distinguishing power of the feature variables for the tested gestures was evaluated according to their p values obtained from the Kruskal-Wallis (KW) test. It is concluded that the mean, variance, skewness, and kurtosis of TF matrices can be candidate feature sets for the recognition of hand gestures.


title: SuperYOLO: Super Resolution Assisted Object Detection in Multimodal Remote Sensing Imagery

abstract: Accurately and timely detecting multiscale small objects that contain tens of pixels from remote sensing images (RSI) remains challenging. Most of the existing solutions primarily design complex deep neural networks to learn strong feature representations for objects separated from the background, which often results in a heavy computation burden. In this article, we propose an accurate yet fast object detection method for RSI, named SuperYOLO, which fuses multimodal data and performs high-resolution (HR) object detection on multiscale objects by utilizing the assisted super resolution (SR) learning and considering both the detection accuracy and computation cost. First, we utilize a symmetric compact multimodal fusion (MF) to extract supplementary information from various data for improving small object detection in RSI. Furthermore, we design a simple and flexible SR branch to learn HR feature representations that can discriminate small objects from vast backgrounds with low-resolution (LR) input, thus further improving the detection accuracy. Moreover, to avoid introducing additional computation, the SR branch is discarded in the inference stage, and the computation of the network model is reduced due to the LR input. Experimental results show that, on the widely used VEDAI RS dataset, SuperYOLO achieves an accuracy of 75.09% (in terms of mAP50 ), which is more than 10% higher than the SOTA large models, such as YOLOv5l, YOLOv5x, and RS designed YOLOrs. Meanwhile, the parameter size and GFLOPs of SuperYOLO are about 18 times and 3.8 times less than YOLOv5x. Our proposed model shows a favorable accuracy and speed tradeoff compared to the state-of-the-art models. The code will be open-sourced at https://github.com/icey-zhang/SuperYOLO.


title: VLSI-Inspired Methods for Student Learning Community Creation and Refinement

abstract: COVID-19 significantly disrupted how educational contents are delivered in academic institutions, rapidly accelerating the adoption of online and blended learning. This thesis explores the creation and refinement of optimized student learning communities as a mean to support online and blended learning in the pandemic and post-pandemic setting. Students enrolled in university courses can be modeled as an enrollment network akin to a circuit netlist. Learning communities are created by clustering students into groups, optimized for maximum internal connection to support student learning, and minimum external connection to reduce disease transmission. Three VLSI-based clustering algorithms: Hyperedge Coarsening, Modified Hyperedge Coarsening, and Best Choice, are modified to cluster student enrollment networks. The learning communities created by the clustering algorithms are further refined by the Simulated Annealing algorithm using the same optimization criteria. The Learning Community Creation and Refinement Framework combines all three stages of network modeling, learning community creation, and learning community refinement. The proposed framework is tested on both the 3rd year Electrical Engineering Fall 2020 enrollment dataset and a very large Fall 2020 and Winter 2021 enrollment dataset. Best Choice performed the best among the clustering algorithms, capable of creating learning communities for the optimization criteria for a given maximum cluster size. Simulated Annealing can refine the clustering results by significantly increase cluster quality. The framework is capable of creating and refining learning communities for both the small and the large enrollment networks, but it is better suited for creating tailored learning communities at a program level. Future work, including creating student learning communities based on other optimization criteria, should be explored.


title: Suppress with a Patch: Revisiting Universal Adversarial Patch Attacks against Object Detection

abstract: Adversarial patch-based attacks aim to fool a neural network with an intentionally generated noise, which is concentrated in a particular region of an input image. In this work, we perform an in-depth analysis of different patch generation parameters, including initialization, patch size, and especially positioning a patch in an image during training. We focus on the object vanishing attack and run experiments with YOLOv3 as a model under attack in a white-box setting and use images from the COCO dataset. Our experiments have shown, that inserting a patch inside a window of increasing size during training leads to a significant increase in attack strength compared to a fixed position. The best results were obtained when a patch was positioned randomly during training, while patch position additionally varied within a batch.


title: Wilcoxon-type Multivariate Cluster Elastic Net

abstract: We propose a method for high dimensional multivariate regression that is robust to random error distributions that are heavy-tailed or contain outliers, while preserving estimation accuracy in normal random error distributions. We extend the Wilcoxon-type regression to a multivariate regression model as a tuning-free approach to robustness. Furthermore, the proposed method regularizes the L1 and L2 terms of the clustering based on k-means, which is extended from the multivariate cluster elastic net. The estimation of the regression coefficient and variable selection are produced simultaneously. Moreover, considering the relationship among the correlation of response variables through the clustering is expected to improve the estimation performance. Numerical simulation demonstrates that our proposed method overperformed the multivariate cluster method and other methods of multiple regression in the case of heavy-tailed error distribution and outliers. It also showed stability in normal error distribution. Finally, we confirm the efficacy of our proposed method using a data example for the gene associated with breast cancer.


title: Algorithms for Large-scale Network Analysis and the NetworKit Toolkit

abstract: The abundance of massive network data in a plethora of applications makes scalable analysis algorithms and software tools necessary to generate knowledge from such data in reasonable time. Addressing scalability as well as other requirements such as good usability and a rich feature set, the open-source software NetworKit has established itself as a popular tool for large-scale network analysis. This chapter provides a brief overview of the contributions to NetworKit made by the DFG Priority Programme SPP 1736 Algorithms for Big Data. Algorithmic contributions in the areas of centrality computations, community detection, and sparsification are in the focus, but we also mention several other aspects -- such as current software engineering principles of the project and ways to visualize network data within a NetworKit-based workflow.


title: Hierarchical Micro-Macro Acceleration for Moment Models of Kinetic Equations

abstract: Fluid dynamical simulations are often performed using cheap macroscopic models like the Euler equations. For rarefied gases under near-equilibrium conditions, however, macroscopic models are not sufficiently accurate and a simulation using more accurate microscopic models is often expensive. In this paper, we introduce a hierarchical micro-macro acceleration based on moment models that combines the speed of macroscopic models and the accuracy of microscopic models. The hierarchical micro-macro acceleration is based on a flexible four step procedure including a micro step, restriction step, macro step, and matching step. We derive several new micro-macro methods from that and compare to existing methods. In 1D and 2D test cases, the new methods achieve high accuracy and a large speedup.


title: The Solenoidal Large Intensity Device (SoLID) for JLab 12 GeV

abstract: The Solenoidal Large Intensity Device (SoLID) is a new experimental apparatus planned for Hall A at the Thomas Jefferson National Accelerator Facility (JLab). SoLID will combine large angular and momentum acceptance with the capability to handle very high data rates at high luminosity. With a slate of approved high-impact physics experiments, SoLID will push JLab to a new limit at the QCD intensity frontier that will exploit the full potential of its 12 GeV electron beam. In this paper, we present an overview of the rich physics program that can be realized with SoLID, which encompasses the tomography of the nucleon in 3-D momentum space from Semi-Inclusive Deep Inelastic Scattering (SIDIS), expanding the phase space in the search for new physics and novel hadronic effects in parity-violating DIS (PVDIS), a precision measurement of $J/\psi$ production at threshold that probes the gluon field and its contribution to the proton mass, tomography of the nucleon in combined coordinate and momentum space with deep exclusive reactions, and more. To meet the challenging requirements, the design of SoLID described here takes full advantage of recent progress in detector, data acquisition and computing technologies. In addition, we outline potential experiments beyond the currently approved program and discuss the physics that could be explored should upgrades of CEBAF become a reality in the future.


title: Phases of methodological research in biostatistics - building the evidence base for new methods

abstract: Although the biostatistical scientific literature publishes new methods at a very high rate, many of these developments are not trustworthy enough to be adopted by the scientific community. We propose a framework to think about how a piece of methodological work contributes to the evidence base for a method. Similarly to the well-known phases of clinical research in drug development, we define four phases of methodological research. These four phases cover (I) providing logical reasoning and proofs, (II) providing empirical evidence, first in a narrow target setting, then (III) in an extended range of settings and for various outcomes, accompanied by appropriate application examples, and (IV) investigations that establish a method as sufficiently well-understood to know when it is preferred over others and when it is not. We provide basic definitions of the four phases but acknowledge that more work is needed to facilitate unambiguous classification of studies into phases. Methodological developments that have undergone all four proposed phases are still rare, but we give two examples with references. Our concept rebalances the emphasis to studies in phase III and IV, i.e., carefully planned methods comparison studies and studies that explore the empirical properties of existing methods in a wider range of problems.


title: Towards Parameter-Efficient Integration of Pre-Trained Language Models In Temporal Video Grounding

abstract: This paper explores the task of Temporal Video Grounding (TVG) where, given an untrimmed video and a natural language sentence query, the goal is to recognize and determine temporal boundaries of action instances in the video described by the query. Recent works tackled this task by improving query inputs with large pre-trained language models (PLM) at the cost of more expensive training. However, the effects of this integration are unclear, as these works also propose improvements in the visual inputs. Therefore, this paper studies the effects of PLMs in TVG and assesses the applicability of parameter-efficient training with NLP adapters. We couple popular PLMs with a selection of existing approaches and test different adapters to reduce the impact of the additional parameters. Our results on three challenging datasets show that, without changing the visual inputs, TVG models greatly benefited from the PLM integration and fine-tuning, stressing the importance of sentence query representation in this task. Furthermore, NLP adapters were an effective alternative to full fine-tuning, even though they were not tailored to our task, allowing PLM integration in larger TVG models and delivering results comparable to SOTA models. Finally, our results shed light on which adapters work best in different scenarios.


title: Draw Your Art Dream: Diverse Digital Art Synthesis with Multimodal Guided Diffusion

abstract: Digital art synthesis is receiving increasing attention in the multimedia community because of engaging the public with art effectively. Current digital art synthesis methods usually use single-modality inputs as guidance, thereby limiting the expressiveness of the model and the diversity of generated results. To solve this problem, we propose the multimodal guided artwork diffusion (MGAD) model, which is a diffusion-based digital artwork generation approach that utilizes multimodal prompts as guidance to control the classifier-free diffusion model. Additionally, the contrastive language-image pretraining (CLIP) model is used to unify text and image modalities. Extensive experimental results on the quality and quantity of the generated digital art paintings confirm the effectiveness of the combination of the diffusion model and multimodal guidance. Code is available at https://github.com/haha-lisa/MGAD-multimodal-guided-artwork-diffusion.


title: Slow and fast particles in shear-driven jamming: critical behavior and finite size scaling

abstract: We do shear-driven simulations of a simple model of non-Brownian particles in two dimensions. By examining the velocity distribution at different densities and shear rates we find strong evidence for the existence of two different processes, respectively dominated by the slower and the faster particles -- the slow process and the fast process. The leading divergence in the shear viscosity is governed by the fast process. An examination of height and position of the low-velocity peak in the distribution demonstrates that it is the slow process that is responsible for the correction-to-scaling term in the critical scaling analysis. We further find that the long range velocity correlations are primarily due to the slow process which implies that the diverging viscosity and the diverging correlation length are only indirectly related.


title: DELTAR: Depth Estimation from a Light-weight ToF Sensor and RGB Image

abstract: Light-weight time-of-flight (ToF) depth sensors are small, cheap, low-energy and have been massively deployed on mobile devices for the purposes like autofocus, obstacle detection, etc. However, due to their specific measurements (depth distribution in a region instead of the depth value at a certain pixel) and extremely low resolution, they are insufficient for applications requiring high-fidelity depth such as 3D reconstruction. In this paper, we propose DELTAR, a novel method to empower light-weight ToF sensors with the capability of measuring high resolution and accurate depth by cooperating with a color image. As the core of DELTAR, a feature extractor customized for depth distribution and an attention-based neural architecture is proposed to fuse the information from the color and ToF domain efficiently. To evaluate our system in real-world scenarios, we design a data collection device and propose a new approach to calibrate the RGB camera and ToF sensor. Experiments show that our method produces more accurate depth than existing frameworks designed for depth completion and depth super-resolution and achieves on par performance with a commodity-level RGB-D sensor. Code and data are available at https://zju3dv.github.io/deltar/.