title: Multi-Party Dynamic State Estimation that Preserves Data and Model Privacy

abstract: In this paper we focus on the dynamic state estimation which harnesses a vast amount of sensing data harvested by multiple parties and recognize that in many applications, to improve collaborations between parties, the estimation procedure must be designed with the awareness of protecting participants' data and model privacy, where the latter refers to the privacy of key parameters of observation models. We develop a state estimation paradigm for the scenario where multiple parties with data and model privacy concerns are involved. Multiple parties monitor a physical dynamic process by deploying their own sensor networks and update the state estimate according to the average state estimate of all the parties calculated by a cloud server and security module. The paradigm taps additively homomorphic encryption which enables the cloud server and security module to jointly fuse parties' data while preserving the data privacy. Meanwhile, all the parties collaboratively develop a stable (or optimal) fusion rule without divulging sensitive model information. For the proposed filtering paradigm, we analyze the stabilization and the optimality. First, to stabilize the multi-party state estimator while preserving observation model privacy, two stabilization design methods are proposed. For special scenarios, the parties directly design their estimator gains by the matrix norm relaxation. For general scenarios, after transforming the original design problem into a convex semi-definite programming problem, the parties collaboratively derive suitable estimator gains based on the ADMM. Second, an optimal collaborative gain design method with model privacy guarantees is provided, which results in the asymptotic MMSE state estimation. Finally, numerical examples are presented to illustrate our design and theoretical findings.


title: Weakly Supervised Multi-Object Tracking and Segmentation

abstract: We introduce the problem of weakly supervised Multi-Object Tracking and Segmentation, i.e. joint weakly supervised instance segmentation and multi-object tracking, in which we do not provide any kind of mask annotation. To address it, we design a novel synergistic training strategy by taking advantage of multi-task learning, i.e. classification and tracking tasks guide the training of the unsupervised instance segmentation. For that purpose, we extract weak foreground localization information, provided by Grad-CAM heatmaps, to generate a partial ground truth to learn from. Additionally, RGB image level information is employed to refine the mask prediction at the edges of the objects. We evaluate our method on KITTI MOTS, the most representative benchmark for this task, reducing the performance gap on the MOTSP metric between the fully supervised and weakly supervised approach to just 12% and 12.7% for cars and pedestrians, respectively.


title: Some recent advances in topological Hochschild homology

abstract: We give an account of the construction of the Bhatt--Morrow--Scholze motivic filtration on topological cyclic homology and related invariants, focusing on the case of equal characteristic $p$ and the connections to crystalline and de Rham--Witt theory.


title: Market Design for Tradable Mobility Credits

abstract: Tradable mobility credit (TMC) schemes are an approach to travel demand management that have received significant attention in recent years. This paper proposes and analyzes alternative market models for a TMC system -- focusing on market design aspects such as allocation/expiration of tokens, rules governing trading, transaction fees, and regulator intervention -- and develops a methodology to explicitly model the dis-aggregate behavior of individuals within the market. Extensive simulation experiments are conducted within a combined mode and departure time context for the morning commute problem to compare the performance of the alternative designs relative to congestion pricing and a no-control scenario. The simulation experiments employ a day-to-day assignment framework wherein transportation demand is modeled using a logit-mixture model with income effects and supply is modeled using a standard bottleneck model. The results indicate that small fixed transaction fees can effectively mitigate undesirable behavior in the market without a significant loss in efficiency (total welfare) whereas proportional transaction fees are less effective both in terms of efficiency and in avoiding undesirable market behavior. Further, an allocation of tokens in continuous time can be beneficial in dealing with non-recurrent events and avoiding concentrated trading activity. In the presence of income effects, despite small fixed transaction fees, the TMC system yields a marginally higher social welfare than congestion pricing while attaining revenue neutrality. Further, it is more robust in the presence of forecasting errors and non-recurrent events due to the adaptiveness of the market. Finally, as expected, the TMC scheme is more equitable (when revenues from congestion pricing are not redistributed) although it is not guaranteed to be Pareto-improving when tokens are distributed equally.


title: Representation of symmetry transformations on the sets of tripotents of spin and Cartan factors

abstract: There are six different mathematical formulations of the symmetry group in quantum mechanics, among them the set of pure states $\mathbf{P}$ -- i.e., the set of one-dimensional projections on a complex Hilbert space $H$ -- and the orthomodular lattice $\mathbf{L}$ of closed subspaces of $H$. These six groups are isomorphic when the dimension of $H$ is $\geq 3$. Despite of the difficulties caused by $M_2(\mathbb{C})$, rank two algebras are used for quantum mechanics description of the spin state of spin-$\frac12$ particles, there is a counterexample for Uhlhorn's version of Wigner's theorem for such state space. In this note we prove that in order that the description of the spin will be relativistic, it is not enough to preserve the projection lattice equipped with its natural partial order and orthogonality, but we also need to preserve the partial order set of all tripotents and orthogonality among them (a set which strictly enlarges the lattice of projections). Concretely, let $M$ and $N$ be two atomic JBW$^*$-triples not containing rank-one Cartan factors, and let $\mathcal{U} (M)$ and $\mathcal{U} (N)$ denote the set of all tripotents in $M$ and $N$, respectively. We show that each bijection $\Phi: \mathcal{U} (M)\to \mathcal{U} (N)$, preserving the partial ordering in both directions, orthogonality in one direction and satisfying some mild continuity hypothesis can be extended to a real linear triple automorphism. This, in particular, extends a result of Moln{\'a}r to the wider setting of atomic JBW$^*$-triples not containing rank-one Cartan factors, and provides new models to present quantum behavior.


title: Past, Present, and Future of Swarm Robotics

abstract: Swarm Robotics is an emerging field of adapting the phenomenon of natural swarms to robotics. It is a study of robots that are aimed to mimic natural swarms, like ants and birds, to form a system that is scalable, flexible, and robust. These robots show self-organization, autonomy, cooperation, and coordination amongst themselves. The cost and design complexity factor is aimed to keep low, hence trying to form systems that are very much similar to natural swarms. The robots operate without any central entity to control them, and the communication amongst the robots can either be direct (robot-to-robot) or indirect (robot-to-environment). Swarm robotics has a wide range of application fields, from simple household tasks to military missions. This paper reviews the swarm robotics approach from its history to its future. It discusses the basic idea of swarm robotics, its important features, simulators, projects, real life applications and some future ideas.


title: Learning optimal Bayesian prior probabilities from data

abstract: Noninformative uniform priors are staples of Bayesian inference, especially in Bayesian machine learning. This study challenges the assumption that they are optimal and their use in Bayesian inference yields optimal outcomes. Instead of using arbitrary noninformative uniform priors, we propose a machine learning based alternative method, learning optimal priors from data by maximizing a target function of interest. Applying na\"ive Bayes text classification methodology and a search algorithm developed for this study, our system learned priors from data using the positive predictive value metric as the target function. The task was to find Wikipedia articles that had not (but should have) been categorized under certain Wikipedia categories. We conducted five sets of experiments using separate Wikipedia categories. While the baseline models used the popular Bayes-Laplace priors, the study models learned the optimal priors for each set of experiments separately before using them. The results showed that the study models consistently outperformed the baseline models with a wide margin of statistical significance (p < 0.001). The measured performance improvement of the study model over the baseline was as high as 443% with the mean value of 193% over five Wikipedia categories.


title: Magnon-polaron formation in XXZ quantum Heisenberg chains

abstract: We study the formation of magnon-polaron excitations and the consequences of different time scales between the magnon and lattice dynamics. The spin-spin interactions along the 1D lattice are ruled by a Heisenberg Hamiltonian in the anisotropic form XXZ, in which each spin exhibits a vibrational degree of freedom around its equilibrium position. By considering a magnetoelastic coupling as a linear function of the relative displacement between nearest-neighbor spins, results provide an original framework for achieving a hybridized state of magnon-polaron. Such state is characterized by high cooperation between the underlying excitations, where the traveling or stationary formation of magnon-polaron depends on the effective magnetoelastic coupling. A systematic investigation reveals the critical amount of the magnon-lattice interaction ($\chi_c$) necessary to emergence of the stationary magnon-polaron quasi-particle. Different characteristic time scales of the magnon and the vibrational dynamics unveiled the threshold between the two regimes, as well as a limiting value of critical magnetoelastic interaction, above which the magnon velocity no longer interferes at the critical magnetoelastic coupling capable of inducing the stationary regime.


title: Recoding latent sentence representations -- Dynamic gradient-based activation modification in RNNs

abstract: In Recurrent Neural Networks (RNNs), encoding information in a suboptimal or erroneous way can impact the quality of representations based on later elements in the sequence and subsequently lead to wrong predictions and a worse model performance. In humans, challenging cases like garden path sentences (an instance of this being the infamous "The horse raced past the barn fell") can lead their language understanding astray. However, they are still able to correct their representation accordingly and recover when new information is encountered. Inspired by this, I propose an augmentation to standard RNNs in form of a gradient-based correction mechanism: This way I hope to enable such models to dynamically adapt their inner representation of a sentence, adding a way to correct deviations as soon as they occur. This could therefore lead to more robust models using more flexible representations, even during inference time. I conduct different experiments in the context of language modeling, where the impact of using such a mechanism is examined in detail. To this end, I look at modifications based on different kinds of time-dependent error signals and how they influence the model performance. Furthermore, this work contains a study of the model's confidence in its predictions during training and for challenging test samples and the effect of the manipulation thereof. Lastly, I also study the difference in behavior of these novel models compared to a standard LSTM baseline and investigate error cases in detail to identify points of future research. I show that while the proposed approach comes with promising theoretical guarantees and an appealing intuition, it is only able to produce minor improvements over the baseline due to challenges in its practical application and the efficacy of the tested model variants.


title: Sentiment Analysis for Open Domain Conversational Agent

abstract: The applicability of common sentiment analysis models to open domain human robot interaction is investigated within this paper. The models are used on a dataset specific to user interaction with the Alana system (a Alexa prize system) in order to determine which would be more appropriate for the task of identifying sentiment when a user interacts with a non-human driven socialbot. With the identification of a model, various improvements are attempted and detailed prior to integration into the Alana system. The study showed that a Random Forest Model with 25 trees trained on the dataset specific to user interaction with the Alana system combined with the dataset present in NLTK Vader outperforms other models. The new system (called 'Rob') matches it's output utterance sentiment with the user's utterance sentiment. This method is expected to improve user experience because it builds upon the overall sentiment detection which makes it seem that new system sympathises with user feelings. Furthermore, the results obtained from the user feedback confirms our expectation.


title: Fake Visual Content Detection Using Two-Stream Convolutional Neural Networks

abstract: Rapid progress in adversarial learning has enabled the generation of realistic-looking fake visual content. To distinguish between fake and real visual content, several detection techniques have been proposed. The performance of most of these techniques however drops off significantly if the test and the training data are sampled from different distributions. This motivates efforts towards improving the generalization of fake detectors. Since current fake content generation techniques do not accurately model the frequency spectrum of the natural images, we observe that the frequency spectrum of the fake visual data contains discriminative characteristics that can be used to detect fake content. We also observe that the information captured in the frequency spectrum is different from that of the spatial domain. Using these insights, we propose to complement frequency and spatial domain features using a two-stream convolutional neural network architecture called TwoStreamNet. We demonstrate the improved generalization of the proposed two-stream network to several unseen generation architectures, datasets, and techniques. The proposed detector has demonstrated significant performance improvement compared to the current state-of-the-art fake content detectors and fusing the frequency and spatial domain streams has also improved generalization of the detector.


title: Adjoint operations in twist-products of lattices

abstract: Given an integral commutative residuated lattice L=(L,\vee,\wedge), its full twist-product (L^2,\sqcup,\sqcap) can be endowed with two binary operations \odot and \Rightarrow introduced formerly by M. Busaniche and R. Cignoli as well as by C. Tsinakis and A. M. Wille such that it becomes a commutative residuated lattice. For every a in L we define a certain subset P_a(L) of L^2. We characterize when P_a(L) is a sublattice of the full twist-product (L^2,\sqcup,\sqcap). In this case P_a(L) together with some natural antitone involution ' becomes a pseudo-Kleene lattice. If L is distributive then (P_a(L),\sqcup,\sqcap,') becomes a Kleene lattice. We present sufficient conditions for P_a(L) being a subalgebra of (L^2,\sqcup,\sqcap,\odot,\Rightarrow) and thus for \odot and \Rightarrow being a pair of adjoint operations on P_a(L). Finally, we introduce another pair \odot and \Rightarrow of adjoint operations on the full twist-product of a bounded commutative residuated lattice such that the resulting algebra is a bounded commutative residuated lattice satisfying the double negation law and we investigate when P_a(L) is closed under these new operations \odot and \Rightarrow.


title: Mobility-Aware Seamless Handover with MPTCP in Software-Defined HetNets

abstract: In this paper, the problem of vertical handover in software-defined network (SDN) based heterogeneous networks (HetNets) is studied. In the studied model, HetNets are required to offer diverse services for mobile users. Using an SDN controller, HetNets have the capability of managing users' access and mobility issues but still have the problems of ping-pong effect and service interruption during vertical handover. To solve these problems, a mobility-aware seamless handover method based on multipath transmission control protocol (MPTCP) is proposed. The proposed handover method is executed in the controller of the software-defined HetNets (SDHetNets) and consists of three steps: location prediction, network selection, and handover execution. In particular, the method first predicts the user's location in the next moment with an echo state network (ESN). Given the predicted location, the SDHetNet controller can determine the candidate network set for the handover to pre-allocate network wireless resources. Second, the target network is selected through fuzzy analytic hierarchical process (FAHP) algorithm, jointly considering user preferences, service requirements, network attributes, and user mobility patterns. Then, seamless handover is realized through the proposed MPTCP-based handover mechanism. Simulations using real-world user trajectory data from Korea Advanced Institute of Science & Technology show that the proposed method can reduce the handover times by 10.85% to 29.12% compared with traditional methods. The proposed method also maintains at least one MPTCP subflow connected during the handover process and achieves a seamless handover.


title: Motion of a Polymer Globule with Vicsek-like Activity: From Super-diffusive to Ballistic Behavior

abstract: Via molecular dynamics simulation with Langevin thermostat we study the structure and dynamics of a flexible bead-spring active polymer model after a quench from good to poor solvent conditions. The self propulsion is introduced via a Vicsek-like alignment activity rule which works on each individual monomer in addition to the standard attractive and repulsive interactions among the monomeric beads. We observe that the final conformations are in the globular phase for the passive as well as for all the active cases. By calculating the bond length distribution, radial distribution function, etc., we show that the kinetics and also the microscopic details of these \textit{pseudo equilibrium} globular conformations are not the same in all the cases. Moreover, the center-of-mass of the polymer shows a more directed trajectory during its motion and the behavior of the mean-squared-displacement gradually changes from a super-diffusive to ballistic under the influence of the active force in contrast to the diffusive behavior in the passive case.


title: Properties of Compact Faint Radio Sources as a Function of Angular Size from Stacking

abstract: The polarization properties of radio sources powered by an Active Galactic Nucleus (AGN) have attracted considerable attention because of the significance of magnetic fields in the physics of these sources, their use as probes of plasma along the line of sight, and as a possible contaminant of polarization measurements of the cosmic microwave background. For each of these applications, a better understanding of the statistics of polarization in relation to source characteristics is crucial. In this paper, we derive the median fractional polarization, $\Pi_{0, \rm med}$, of large samples of radio sources with 1.4 GHz flux density $6.6 < S_{1.4} < 70$ mJy, by stacking 1.4 GHz NVSS polarized intensity as a function of angular size derived from the FIRST survey. Five samples with deconvolved mean angular size 1.8" to 8.2" and two samples of symmetric double sources are analyzed. These samples represent most sources smaller than or near the median angular size of the mJy radio source population We find that the median fractional polarization $\Pi_{0,\rm med}$ at 1.4 GHz is a strong function of source angular size less than ~5" and a weak function of angular size for larger sources up to ~8". We interpret our results as depolarization inside the AGN host galaxy and its circumgalactic medium. The curvature of the low-frequency radio spectrum is found to anti-correlate with $\Pi_{0,\rm med}$, a further sign that depolarization is related to the source.


title: A p-adaptive, implicit-explicit mixed finite element method for reaction-diffusion problems

abstract: A new class of implicit-explicit (IMEX) methods combined with a p-adaptive mixed finite element formulation is proposed to simulate the diffusion of reacting species. Hierarchical polynomial functions are used to construct an $H(\mathrm{Div})$-conforming base for the flux vectors, and a non-conforming $L^2$ base for the mass concentration of the species. The mixed formulation captures the distinct nonlinearities associated with the constitutive flux equations and the reaction terms. The IMEX method conveniently treats these two sources of nonlinearity implicitly and explicitly, respectively, within a single time-stepping framework. The combination of the p-adaptive mixed formulation and the IMEX method delivers a robust and efficient algorithm. The proposed methods eliminate the coupled effect of mesh size and time step on the algorithmic stability. A residual based a posteriori error estimate that provides an upper bound of the natural error norm is derived. The availability of such estimate which can be obtained with minimal computational effort and the hierarchical construction of the finite element spaces allow for the formulation of an efficient p-adaptive algorithm. A series of numerical examples demonstrate the performance of the approach. It is shown that the method with the p-adaptive strategy accurately solves problems involving travelling waves, and those with discontinuities and singularities. The flexibility of the formulation is also illustrated via selected applications in pattern formation and electrophysiology.


title: Division in group rings of surface groups

abstract: We prove a division algorithm for group rings of high genus surface groups and use it to show that some $2$-complexes with surface fundamental groups are standard. We also give an application of division to cohomological dimension of $2$-relator groups acting on $\mathbb H^n$.


title: Low rattling: A predictive principle for self-organization in active collectives

abstract: Self-organization is frequently observed in active collectives, from ant rafts to molecular motor assemblies. General principles describing self-organization away from equilibrium have been challenging to identify. We offer a unifying framework that models the behavior of complex systems as largely random, while capturing their configuration-dependent response to external forcing. This allows derivation of a Boltzmann-like principle for understanding and manipulating driven self-organization. We validate our predictions experimentally in shape-changing robotic active matter, and outline a methodology for controlling collective behavior. Our findings highlight how emergent order depends sensitively on the matching between external patterns of forcing and internal dynamical response properties, pointing towards future approaches for design and control of active particle mixtures and metamaterials.


title: Validated forward integration scheme for parabolic PDEs via Chebyshev series

abstract: In this paper we introduce a new approach to compute rigorously solutions of Cauchy problems for a class of semi-linear parabolic partial differential equations. Expanding solutions with Chebyshev series in time and Fourier series in space, we introduce a zero finding problem $F(a)=0$ on a Banach algebra $X$ of Fourier-Chebyshev sequences, whose solution solves the Cauchy problem. The challenge lies in the fact that the linear part $\mathcal{L} = DF(0)$ has an infinite block diagonal structure with blocks becoming less and less diagonal dominant at infinity. We introduce analytic estimates to show that $\mathcal{L}$ is an invertible linear operator on $X$, and we obtain explicit, rigorous and computable bounds for the operator norm $\| \mathcal{L}^{-1}\|_{B(X)}$. These bounds are then used to verify the hypotheses of a Newton-Kantorovich type argument which shows that the (Newton-like) operator $\mathcal{T}(a)=a - \mathcal{L}^{-1} F(a)$ is a contraction on a small ball centered at a numerical approximation of the Cauchy problem. The contraction mapping theorem yields a fixed point which corresponds to a classical (strong) solution of the Cauchy problem. The approach is simple to implement, numerically stable and is applicable to a class of PDE models, which include for instance Fisher's equation and the Swift-Hohenberg equation. We apply our approach to each of these models.


title: An uncountable ergodic Roth theorem and applications

abstract: We establish an uncountable amenable ergodic Roth theorem, in which the acting group is not assumed to be countable and the space need not be separable. This generalizes a previous result of Bergelson, McCutcheon and Zhang, and complements a result of Zorin-Kranich. We establish the following two additional results: First, a combinatorial application about triangular patterns in certain subsets of the Cartesian square of arbitrary amenable groups, extending a result of Bergelson, McCutcheon and Zhang for countable amenable groups. Second, a new uniformity aspect in the double recurrence theorem for $\Gamma$-systems for arbitrary uniformly amenable groups $\Gamma$. Our uncountable Roth theorem is crucial in the proof of both of these results.


title: An Evolution of CNN Object Classifiers on Low-Resolution Images

abstract: Object classification is a significant task in computer vision. It has become an effective research area as an important aspect of image processing and the building block of image localization, detection, and scene parsing. Object classification from low-quality images is difficult for the variance of object colors, aspect ratios, and cluttered backgrounds. The field of object classification has seen remarkable advancements, with the development of deep convolutional neural networks (DCNNs). Deep neural networks have been demonstrated as very powerful systems for facing the challenge of object classification from high-resolution images, but deploying such object classification networks on the embedded device remains challenging due to the high computational and memory requirements. Using high-quality images often causes high computational and memory complexity, whereas low-quality images can solve this issue. Hence, in this paper, we investigate an optimal architecture that accurately classifies low-quality images using DCNNs architectures. To validate different baselines on lowquality images, we perform experiments using webcam captured image datasets of 10 different objects. In this research work, we evaluate the proposed architecture by implementing popular CNN architectures. The experimental results validate that the MobileNet architecture delivers better than most of the available CNN architectures for low-resolution webcam image datasets.


title: Enhanced Pub/Sub Communications for Massive IoT Traffic with SARSA Reinforcement Learning

abstract: Sensors are being extensively deployed and are expected to expand at significant rates in the coming years. They typically generate a large volume of data on the internet of things (IoT) application areas like smart cities, intelligent traffic systems, smart grid, and e-health. Cloud, edge and fog computing are potential and competitive strategies for collecting, processing, and distributing IoT data. However, cloud, edge, and fog-based solutions need to tackle the distribution of a high volume of IoT data efficiently through constrained and limited resource network infrastructures. This paper addresses the issue of conveying a massive volume of IoT data through a network with limited communications resources (bandwidth) using a cognitive communications resource allocation based on Reinforcement Learning (RL) with SARSA algorithm. The proposed network infrastructure (PSIoTRL) uses a Publish/ Subscribe architecture to access massive and highly distributed IoT data. It is demonstrated that the PSIoTRL bandwidth allocation for buffer flushing based on SARSA enhances the IoT aggregator buffer occupation and network link utilization. The PSIoTRL dynamically adapts the IoT aggregator traffic flushing according to the Pub/Sub topic's priority and network constraint requirements.


title: Segmentation and genome annotation algorithms

abstract: Segmentation and genome annotation (SAGA) algorithms are widely used to understand genome activity and gene regulation. These algorithms take as input epigenomic datasets, such as chromatin immunoprecipitation-sequencing (ChIP-seq) measurements of histone modifications or transcription factor binding. They partition the genome and assign a label to each segment such that positions with the same label exhibit similar patterns of input data. SAGA algorithms discover categories of activity such as promoters, enhancers, or parts of genes without prior knowledge of known genomic elements. In this sense, they generally act in an unsupervised fashion like clustering algorithms, but with the additional simultaneous function of segmenting the genome. Here, we review the common methodological framework that underlies these methods, review variants of and improvements upon this basic framework, catalogue existing large-scale reference annotations, and discuss the outlook for future work.


title: P-wave nucleon-pion scattering amplitude in the $\Delta (1232)$ channel from lattice QCD

abstract: We determine the $\Delta(1232)$ resonance parameters using lattice QCD and the L\"uscher method. The resonance occurs in elastic pion-nucleon scattering with $J^P=3/2^+$ in the isospin $I = 3/2$, $P$-wave channel. Our calculation is performed with $N_f=2+1$ flavors of clover fermions on a lattice with $L\approx 2.8$ fm. The pion and nucleon masses are $m_\pi =255.4(1.6)$ MeV and $m_N=1073(5)$ MeV, and the strong decay channel $\Delta \rightarrow \pi N$ is found to be above the threshold. To thoroughly map out the energy-dependence of the nucleon-pion scattering amplitude, we compute the spectra in all relevant irreducible representations of the lattice symmetry groups for total momenta up to $\vec{P}=\frac{2\pi}{L}(1,1,1)$, including irreps that mix $S$ and $P$ waves. We perform global fits of the amplitude parameters to up to 21 energy levels, using a Breit-Wigner model for the $P$-wave phase shift and the effective-range expansion for the $S$-wave phase shift. From the location of the pole in the $P$-wave scattering amplitude, we obtain the resonance mass $m_\Delta=1378(7)(9)$ MeV and the coupling $g_{\Delta\text{-}\pi N}=23.8(2.7)(0.9)$.


title: CSIS: compressed sensing-based enhanced-embedding capacity image steganography scheme

abstract: Image steganography plays a vital role in securing secret data by embedding it in the cover images. Usually, these images are communicated in a compressed format. Existing techniques achieve this but have low embedding capacity. Enhancing this capacity causes a deterioration in the visual quality of the stego-image. Hence, our goal here is to enhance the embedding capacity while preserving the visual quality of the stego-image. We also intend to ensure that our scheme is resistant to steganalysis attacks. This paper proposes a Compressed Sensing Image Steganography (CSIS) scheme to achieve our goal while embedding binary data in images. The novelty of our scheme is the combination of three components in attaining the above-listed goals. First, we use compressed sensing to sparsify cover image block-wise, obtain its linear measurements, and then uniquely select permissible measurements. Further, before embedding the secret data, we encrypt it using the Data Encryption Standard (DES) algorithm, and finally, we embed two bits of encrypted data into each permissible measurement. Second, we propose a novel data extraction technique, which is lossless and completely recovers our secret data. Third, for the reconstruction of the stego-image, we use the least absolute shrinkage and selection operator (LASSO) for the resultant optimization problem. We perform experiments on several standard grayscale images and a color image, and evaluate embedding capacity, PSNR value, mean SSIM index, NCC coefficients, and entropy. We achieve 1.53 times more embedding capacity as compared to the most recent scheme. We obtain an average of 37.92 dB PSNR value, and average values close to 1 for both the mean SSIM index and the NCC coefficients, which are considered good. Moreover, the entropy of cover images and their corresponding stego-images are nearly the same.


title: CovTANet: A Hybrid Tri-level Attention Based Network for Lesion Segmentation, Diagnosis, and Severity Prediction of COVID-19 Chest CT Scans

abstract: Rapid and precise diagnosis of COVID-19 is one of the major challenges faced by the global community to control the spread of this overgrowing pandemic. In this paper, a hybrid neural network is proposed, named CovTANet, to provide an end-to-end clinical diagnostic tool for early diagnosis, lesion segmentation, and severity prediction of COVID-19 utilizing chest computer tomography (CT) scans. A multi-phase optimization strategy is introduced for solving the challenges of complicated diagnosis at a very early stage of infection, where an efficient lesion segmentation network is optimized initially which is later integrated into a joint optimization framework for the diagnosis and severity prediction tasks providing feature enhancement of the infected regions. Moreover, for overcoming the challenges with diffused, blurred, and varying shaped edges of COVID lesions with novel and diverse characteristics, a novel segmentation network is introduced, namely Tri-level Attention-based Segmentation Network (TA-SegNet). This network has significantly reduced semantic gaps in subsequent encoding decoding stages, with immense parallelization of multi-scale features for faster convergence providing considerable performance improvement over traditional networks. Furthermore, a novel tri-level attention mechanism has been introduced, which is repeatedly utilized over the network, combining channel, spatial, and pixel attention schemes for faster and efficient generalization of contextual information embedded in the feature map through feature re-calibration and enhancement operations. Outstanding performances have been achieved in all three-tasks through extensive experimentation on a large publicly available dataset containing 1110 chest CT-volumes that signifies the effectiveness of the proposed scheme at the current stage of the pandemic.


title: Learning General Policies from Small Examples Without Supervision

abstract: Generalized planning is concerned with the computation of general policies that solve multiple instances of a planning domain all at once. It has been recently shown that these policies can be computed in two steps: first, a suitable abstraction in the form of a qualitative numerical planning problem (QNP) is learned from sample plans, then the general policies are obtained from the learned QNP using a planner. In this work, we introduce an alternative approach for computing more expressive general policies which does not require sample plans or a QNP planner. The new formulation is very simple and can be cast in terms that are more standard in machine learning: a large but finite pool of features is defined from the predicates in the planning examples using a general grammar, and a small subset of features is sought for separating "good" from "bad" state transitions, and goals from non-goals. The problems of finding such a "separating surface" while labeling the transitions as "good" or "bad" are jointly addressed as a single combinatorial optimization problem expressed as a Weighted Max-SAT problem. The advantage of looking for the simplest policy in the given feature space that solves the given examples, possibly non-optimally, is that many domains have no general, compact policies that are optimal. The approach yields general policies for a number of benchmark domains.


title: Neural Networks for Keyword Spotting on IoT Devices

abstract: We explore Neural Networks (NNs) for keyword spotting (KWS) on IoT devices like smart speakers and wearables. Since we target to execute our NN on a constrained memory and computation footprint, we propose a CNN design that. (i) uses a limited number of multiplies. (ii) uses a limited number of model parameters.


title: Solving Cut-Problems in Quadratic Time for Graphs With Bounded Treewidth

abstract: In the problem (Unweighted) Max-Cut we are given a graph $G = (V,E)$ and asked for a set $S \subseteq V$ such that the number of edges from $S$ to $V \setminus S$ is maximal. In this paper we consider an even harder problem: (Weighted) Max-Bisection. Here we are given an undirected graph $G = (V,E)$ and a weight function $w \colon E \to \mathbb Q_{>0}$ and the task is to find a set $S \subseteq V$ such that (i) the sum of the weights of edges from $S$ is maximal; and (ii) $S$ contains $\left\lceil{\frac{n}{2}}\right\rceil$ vertices (where $n = \lvert V\rvert$). We design a framework that allows to solve this problem in time $\mathcal O(2^t n^2)$ if a tree decomposition of width $t$ is given as part of the input. This improves the previously best running time for Max-Bisection of [DBLP:journals/tcs/HanakaKS21] by a factor $t^2$. Under common hardness assumptions, neither the dependence on $t$ in the exponent nor the dependence on $n$ can be reduced [DBLP:journals/tcs/HanakaKS21,DBLP:journals/jcss/EibenLM21,DBLP:journals/talg/LokshtanovMS18]. Our framework can be applied to other cut problems like Min-Edge-Expansion, Sparsest-Cut, Densest-Cut, $\beta$-Balanced-Min-Cut, and Min-Bisection. It also works in the setting with arbitrary weights and directed edges.


title: HOMFLY Polynomials of Pretzel Knots

abstract: HOMFLY polynomials are one of the major knot invariants being actively studied. They are difficult to compute in the general case but can be far more easily expressed in certain specific cases. In this paper, we examine two particular knots, as well as one more general infinite class of knots. From our calculations, we see some apparent patterns in the polynomials for the knots $9_{35}$ and $9_{46}$, and in particular their $F$-factors. These properties are of a form that seems conducive to finding a general formula for them, which would yield a general formula for the HOMFLY polynomials of the two knots. Motivated by these observations, we demonstrate and conjecture some properties both of the $F$-factors and HOMFLY polynomials of these knots and of the more general class that contains them, namely pretzel knots with 3 odd parameters. We make the first steps toward a matrix-less general formula for the HOMFLY polynomials of these knots.


title: Science with the $AstroSat$ Soft X-ray Telescope: an overview

abstract: The Soft X-ray Telescope (SXT) aboard the $AstroSat$ satellite is the first Indian X-ray telescope in space. It is a modest size X-ray telescope with a charge coupled device (CCD) camera in the focal plane, which provides X-ray images in the $\sim 0.3-8.0$ keV band. A forte of SXT is in providing undistorted spectra of relatively bright X-ray sources, in which it excels some current large CCD-based X-ray telescopes. Here, we highlight some of the published spectral and timing results obtained using the SXT data to demonstrate the capabilities and overall performance of this telescope.


title: Elastodynamic Transformation Cloaking for Non-Centrosymmetric Gradient Solids

abstract: In this paper we investigate the possibility of elastodynamic transformation cloaking in bodies made of non-centrosymmetric gradient solids. The goal of transformation cloaking is to hide a hole from elastic disturbances in the sense that the mechanical response of a homogeneous and isotropic body with a hole covered by a cloak would be identical to that of the corresponding homogeneous and isotropic body outside the cloak. It is known that in the case of centrosymmetric gradient solids the balance of angular momentum is the obstruction to transformation cloaking. We will show that this is the case for non-centrosymmetric gradient solids as well.


title: Cycle Registration in Persistent Homology with Applications in Topological Bootstrap

abstract: In this article we propose a novel approach for comparing the persistent homology representations of two spaces (filtrations). Commonly used methods are based on numerical summaries such as persistence diagrams and persistence landscapes, along with suitable metrics (e.g. Wasserstein). These summaries are useful for computational purposes, but they are merely a marginal of the actual topological information that persistent homology can provide. Instead, our approach compares between two topological representations directly in the data space. We do so by defining a correspondence relation between individual persistent cycles of two different spaces, and devising a method for computing this correspondence. Our matching of cycles is based on both the persistence intervals and the spatial placement of each feature. We demonstrate our new framework in the context of topological inference, where we use statistical bootstrap methods in order to differentiate between real features and noise in point cloud data.


title: The structure of conservative gradient fields

abstract: The classical Clarke subdifferential alone is inadequate for understanding automatic differentiation in nonsmooth contexts. Instead, we can sometimes rely on enlarged generalized gradients called "conservative fields", defined through the natural path-wise chain rule: one application is the convergence analysis of gradient-based deep learning algorithms. In the semi-algebraic case, we show that all conservative fields are in fact just Clarke subdifferentials plus normals of manifolds in underlying Whitney stratifications.


title: Non-separable matrix builders for signal processing, quantum information and MIMO applications

abstract: Matrices are built and designed by applying procedures from lower order matrices. Matrix tensor products, direct sums or multiplication of matrices are such procedures and a matrix built from these is said to be a {\em separable} matrix. A {\em non-separable} matrix is a matrix which is not separable and is often referred to as {\em an entangled matrix}. The matrices built may retain properties of the lower order matrices or may also acquire new desired properties not inherent in the constituents. Here design methods for non-separable matrices of required types are derived. These can retain properties of lower order matrices or have new desirable properties. Infinite series of required non-separable matrices are constructible by the general methods. Non-separable matrices are required for applications and other uses; they can capture the structure in a unique way and thus perform much better than separable matrices. General new methods are developed with which to construct {\em multidimensional entangled paraunitary matrices}; these have applications for wavelet and filter bank design. The constructions are in addition used to design new systems of non-separable unitary matrices; these have applications in quantum information theory. Some consequences include the design of full diversity constellations of unitary matrices, which are used in MIMO systems, and methods to design infinite series of special types of Hadamard matrices.


title: Adversarial Unsupervised Domain Adaptation for Harmonic-Percussive Source Separation

abstract: This paper addresses the problem of domain adaptation for the task of music source separation. Using datasets from two different domains, we compare the performance of a deep learning-based harmonic-percussive source separation model under different training scenarios, including supervised joint training using data from both domains and pre-training in one domain with fine-tuning in another. We propose an adversarial unsupervised domain adaptation approach suitable for the case where no labelled data (ground-truth source signals) from a target domain is available. By leveraging unlabelled data (only mixtures) from this domain, experiments show that our framework can improve separation performance on the new domain without losing any considerable performance on the original domain. The paper also introduces the Tap & Fiddle dataset, a dataset containing recordings of Scandinavian fiddle tunes along with isolated tracks for 'foot-tapping' and 'violin'.


title: A Novel Multi-Stage Training Approach for Human Activity Recognition from Multimodal Wearable Sensor Data Using Deep Neural Network

abstract: Deep neural network is an effective choice to automatically recognize human actions utilizing data from various wearable sensors. These networks automate the process of feature extraction relying completely on data. However, various noises in time series data with complex inter-modal relationships among sensors make this process more complicated. In this paper, we have proposed a novel multi-stage training approach that increases diversity in this feature extraction process to make accurate recognition of actions by combining varieties of features extracted from diverse perspectives. Initially, instead of using single type of transformation, numerous transformations are employed on time series data to obtain variegated representations of the features encoded in raw data. An efficient deep CNN architecture is proposed that can be individually trained to extract features from different transformed spaces. Later, these CNN feature extractors are merged into an optimal architecture finely tuned for optimizing diversified extracted features through a combined training stage or multiple sequential training stages. This approach offers the opportunity to explore the encoded features in raw sensor data utilizing multifarious observation windows with immense scope for efficient selection of features for final convergence. Extensive experimentations have been carried out in three publicly available datasets that provide outstanding performance consistently with average five-fold cross-validation accuracy of 99.29% on UCI HAR database, 99.02% on USC HAR database, and 97.21% on SKODA database outperforming other state-of-the-art approaches.


title: Automatic Defect Detection of Print Fabric Using Convolutional Neural Network

abstract: Automatic defect detection is a challenging task because of the variability in texture and type of fabric defects. An effective defect detection system enables manufacturers to improve the quality of processes and products. Automation across the textile manufacturing systems would reduce fabric wastage and increase profitability by saving cost and resources. There are different contemporary research on automatic defect detection systems using image processing and machine learning techniques. These techniques differ from each other based on the manufacturing processes and defect types. Researchers have also been able to establish real-time defect detection system during weaving. Although, there has been research on patterned fabric defect detection, these defects are related to weaving faults such as holes, and warp and weft defects. But, there has not been any research that is designed to detect defects that arise during such as spot and print mismatch. This research has fulfilled this gap by developing a print fabric database and implementing deep convolutional neural network (CNN).


title: Particle conservation in the single-particle Green's function

abstract: We argue that the exact single-particle Green's function ($G$) in quantum many-body theory does not conserve particle number because the single-particle basis is incomplete. We conclude that the exact $G$ is not a probability amplitude and is not $\Phi$-derivable in the Kadanoff-Baym sense. This sets up a number of inconsistencies involving normalization, the definition of $G$, interpretation of the spectral function, and $\Phi$-derivability. Our result suggests that, in the most general case and in the most literal sense, $G$ is not suitable for computing particle addition/removal spectra.


title: Self-similarity in an exchangeable site-dynamics model

abstract: We consider a model for which every site of $\mathbb{N}$ is assigned a fitness in $[0,1]$. At every discrete time all the sites are updated and each site samples a uniform on $[0,1]$, independently of everything else. At every discrete time and independently of the past the environment is good with probability $p$ or bad with probability $1-p$. The fitness of each site is then updated to the maximum or the minimum between its present fitness and the sampled uniform, according to whether the environment is good or bad. Assuming the initial fitness distribution is exchangeable over the site indexing, the empirical fitness distribution is a probability-valued Markov process. We show that this Markov process converges to an explicitly-identified stationary distribution exhibiting a self-similar structure.


title: Smart Black Box 2.0: Efficient High-bandwidth Driving Data Collection based on Video Anomalies

abstract: Autonomous vehicles require fleet-wide data collection for continuous algorithm development and validation. The Smart Black Box (SBB) intelligent event data recorder has been proposed as a system for prioritized high-bandwidth data capture. This paper extends the SBB by applying anomaly detection and action detection methods for generalized event-of-interest (EOI) detection. An updated SBB pipeline is proposed for the real-time capture of driving video data. A video dataset is constructed to evaluate the SBB on real-world data for the first time. SBB performance is assessed by comparing the compression of normal and anomalous data and by comparing our prioritized data recording with a FIFO strategy. Results show that SBB data compression can increase the anomalous-to-normal memory ratio by ~25%, while the prioritized recording strategy increases the anomalous-to-normal count ratio when compared to a FIFO strategy. We compare the real-world dataset SBB results to a baseline SBB given ground-truth anomaly labels and conclude that improved general EOI detection methods will greatly improve SBB performance.


title: Multipoint correlation functions: spectral representation and numerical evaluation

abstract: The many-body problem is usually approached from one of two perspectives: the first originates from an action and is based on Feynman diagrams, the second is centered around a Hamiltonian and deals with quantum states and operators. The connection between results obtained in either way is made through spectral (or Lehmann) representations, well known for two-point correlation functions. Here, we complete this picture by deriving generalized spectral representations for multipoint correlation functions that apply in all of the commonly used many-body frameworks: the imaginary-frequency Matsubara and the real-frequency zero-temperature and Keldysh formalisms. Our approach separates spectral from time-ordering properties and thereby elucidates the relation between the three formalisms. The spectral representations of multipoint correlation functions consist of partial spectral functions and convolution kernels. The former are formalism independent but system specific; the latter are system independent but formalism specific. Using a numerical renormalization group (NRG) method described in the accompanying paper, we present numerical results for selected quantum impurity models. We focus on the four-point vertex (effective interaction) obtained for the single-impurity Anderson model and for the dynamical mean-field theory (DMFT) solution of the one-band Hubbard model. In the Matsubara formalism, we analyze the evolution of the vertex down to very low temperatures and describe the crossover from strongly interacting particles to weakly interacting quasiparticles. In the Keldysh formalism, we first benchmark our results at weak and infinitely strong interaction and then reveal the rich real-frequency structure of the DMFT vertex in the coexistence regime of a metallic and insulating solution.


title: Computing local multipoint correlators using the numerical renormalization group

abstract: Local three- and four-point correlators yield important insight into strongly correlated systems and have many applications. However, the nonperturbative, accurate computation of multipoint correlators is challenging, particularly in the real-frequency domain for systems at low temperatures. In the accompanying paper, we introduce generalized spectral representations for multipoint correlators. Here, we develop a numerical renormalization group (NRG) approach, capable of efficiently evaluating these spectral representations, to compute local three- and four-point correlators of quantum impurity models. The key objects in our scheme are partial spectral functions, encoding the system's dynamical information. Their computation via NRG allows us to simultaneously resolve various multiparticle excitations down to the lowest energies. By subsequently convolving the partial spectral functions with appropriate kernels, we obtain multipoint correlators in the imaginary-frequency Matsubara, the real-frequency zero-temperature, and the real-frequency Keldysh formalisms. We present exemplary results for the connected four-point correlators of the Anderson impurity model, and for resonant inelastic x-ray scattering (RIXS) spectra of related impurity models. Our method can treat temperatures and frequencies -- imaginary or real -- of all magnitudes, from large to arbitrarily small ones.


title: 3D Fluorescent Mapping of Invisible Molecular Damage after Cavi-tation in Hydrogen Exposed Elastomers

abstract: Elastomers saturated with gas at high pressure suffer from cavity nucleation, inflation, and deflation upon rapid or explosive de-compression. Although this process often results in undetectable changes in appearance, it causes internal damage, hampers func-tionality (e.g., permeability), and shortens lifetime. Here, we tag a model poly(ethyl acrylate) elastomer with {\pi}-extended anthracene-maleimide adducts that fluoresce upon polymer chain scission, and map in 3D the internal damage present after a cycle of gas satu-ration and rapid decompression. Interestingly, we observe that each cavity observable during the decompression results in a dam-aged region, the shape of which reveals a fracture locus of randomly oriented penny-shape cracks (i.e., with a flower-like morpholo-gy) that contain crack arrest lines. Thus, cavity growth likely proceeds discontinuously (i.e., non-steadily) through the stable and unstable fracture of numerous 2D crack planes. This non-destructive methodology to visualize in 3D molecular damage in polymer networks is novel and serves to understand how fracture occurs under complex 3D loads, predict mechanical aging of pristine look-ing elastomers, and holds potential to optimize cavitation-resistant materials.


title: On Excesses and Duality in Woven Frames

abstract: Weaving frames in separable Hilbert spaces have been recently introduced by Bemrose et al. to deal with some problems in distributed signal processing and wireless sensor networks. In this paper, we study the notion of excess for woven frames and prove that any two frames in a separable Hilbert space that are woven have the same excess. We also show that every frame with a large class of duals is woven provided that its redundant elements have small enough norm. Also, we try to transfer the woven property from frames to their duals and vise versa. Finally, we look at which perturbations of dual frames preserve the woven property, moreover it is shown that under some conditions the canonical Pareseval frame of two woven frames are also woven.


title: Synchronization Strings and Codes for Insertions and Deletions -- a Survey

abstract: Already in the 1960s, Levenshtein and others studied error-correcting codes that protect against synchronization errors, such as symbol insertions and deletions. However, despite significant efforts, progress on designing such codes has been lagging until recently, particularly compared to the detailed understanding of error-correcting codes for symbol substitution or erasure errors. This paper surveys the recent progress in designing efficient error-correcting codes over finite alphabets that can correct a constant fraction of worst-case insertions and deletions. Most state-of-the-art results for such codes rely on synchronization strings, simple yet powerful pseudo-random objects that have proven to be very effective solutions for coping with synchronization errors in various settings. This survey also includes an overview of what is known about synchronization strings and discusses communication settings related to error-correcting codes in which synchronization strings have been applied.


title: The Relativistic Transactional Interpretation and The Quantum Direct-Action Theory

abstract: This paper presents key aspects of the quantum relativistic direct-action theory that underlies the Relativistic Transactional Interpretation. It notes some crucial ways in which traditional interpretations of the direct-action theory have impeded progress in developing its quantum counterpart. Specifically, (1) the so-called 'light tight box' condition is re-examined and it is shown that the quantum version of this condition is much less restrictive than has long been assumed; and (2) the notion of a 'real photon' is disambiguated and revised to take into account that real (on-shell) photons are indeed both emitted and absorbed and therefore have finite lifetimes. Also discussed is the manner in which real, physical non-unitarity naturally arises in the quantum direct-action theory of fields, such that the measurement transition can be clearly defined from within the theory, without reference to external observers and without any need to modify quantum theory itself. It is shown that field quantization arises from the non-unitary interaction.


title: About the number of oriented Hamiltonian paths and cycles in tournaments

abstract: We prove that a tournament and its complement contain the same number of oriented Hamiltonian paths (resp. cycles) of any given type, as a generalization of Rosenfeld's result proved for antidirected paths.


title: First searches for gravitational waves from r-modes of the Crab pulsar

abstract: We present the first searches for gravitational waves from r-modes of the Crab pulsar, coherently and separately integrating data from three stretches of the first two observing runs of Advanced LIGO using the F-statistic. The second run was divided in two by a glitch of the pulsar roughly halfway through. The frequencies and derivatives searched were based on radio measurements of the pulsar's spin-down parameters as described in Caride et al., Phys. Rev. D 100, 064013 (2019). We did not find any evidence of gravitational waves. Our best 90% confidence upper limits on gravitational wave intrinsic strain were 1.5e-25 for the first run, 1.3e-25 for the first stretch of the second run, and 1.1e-25 for the second stretch of the second run. These are the first upper limits on gravitational waves from r-modes of a known pulsar to beat its spin-down limit, and they do so by more than an order of magnitude in amplitude or two orders of magnitude in luminosity.


title: Norm hypergraphs

abstract: We introduce a high uniformity generalization of the so-called (projective) norm graphs of Alon, Koll\'ar, R\'onyai, and Szab\'o, and use it to show that $$\operatorname{ex}_{d}(n,K_{s_{1},\ldots,s_{d}}^{(d)}) = \Theta\left(n^{d - \frac{1}{s_{1}\ldots s_{d-1}}}\right)$$ holds for all integers $s_{1},\ldots,s_{d} \geq 2$ such that $s_{d} \geq \left((d-1)(s_{1}\ldots s_{d-1}-1)\right)!+1$. This improves upon a recent result of Ma, Yuan and Zhang, and thus settles (many) new cases of a conjecture of Mubayi.


title: Nash Equilibria in Finite-Horizon Multiagent Concurrent Games

abstract: The problem of finding pure strategy Nash equilibria in multiagent concurrent games with finite-horizon temporal goals has received some recent attention. Earlier work solved this problem through the use of Rabin automata. In this work, we take advantage of the finite-horizon nature of the agents' goals and show that checking for and finding pure strategy Nash equilibria can be done using a combination of safety games and lasso testing in B\"uchi automata. To separate strategic reasoning from temporal reasoning, we model agents' goals by deterministic finite-word automata (DFAs), since finite-horizon logics such as LTL\textsubscript{f} and LDL\textsubscript{f} are reasoned about through conversion to equivalent DFAs. This allow us characterize the complexity of the problem as PSPACE complete.


title: Algorithmic Complexities in Backpropagation and Tropical Neural Networks

abstract: In this note, we propose a novel technique to reduce the algorithmic complexity of neural network training by using matrices of tropical real numbers instead of matrices of real numbers. Since the tropical arithmetics replaces multiplication with addition, and addition with max, we theoretically achieve several order of magnitude better constant factors in time complexities in the training phase. The fact that we replace the field of real numbers with the tropical semiring of real numbers and yet achieve the same classification results via neural networks come from deep results in topology and analysis, which we verify in our note. We then explore artificial neural networks in terms of tropical arithmetics and tropical algebraic geometry, and introduce the multi-layered tropical neural networks as universal approximators. After giving a tropical reformulation of the backpropagation algorithm, we verify the algorithmic complexity is substantially lower than the usual backpropagation as the tropical arithmetic is free of the complexity of usual multiplication.


title: Text Searching Allowing for Non-Overlapping Adjacent Unbalanced Translocations

abstract: In this paper we investigate the \emph{approximate string matching problem} when the allowed edit operations are \emph{non-overlapping unbalanced translocations of adjacent factors}. Such kind of edit operations take place when two adjacent sub-strings of the text swap, resulting in a modified string. The two involved substrings are allowed to be of different lengths. Such large-scale modifications on strings have various applications. They are among the most frequent chromosomal alterations, accounted for 30\% of all losses of heterozygosity, a major genetic event causing inactivation of cancer suppressor genes. In addition, among other applications, they are frequent modifications accounted in musical or in natural language information retrieval. However, despite of their central role in so many fields of text processing, little attention has been devoted to the problem of matching strings allowing for this kind of edit operation. In this paper we present three algorithms for solving the problem, all of them with a $\bigO(nm^3)$ worst-case and a $\bigO(m^2)$-space complexity, where $m$ and $n$ are the length of the pattern and of the text, respectively. % In particular, our first algorithm is based on the dynamic-programming approach. Our second solution improves the previous one by making use of the Directed Acyclic Word Graph of the pattern. Finally our third algorithm is based on an alignment procedure. We also show that under the assumptions of equiprobability and independence of characters, our second algorithm has a $\bigO(n\log^2_{\sigma} m)$ average time complexity, for an alphabet of size $\sigma \geq 4$.


title: Bankruptcy prediction using disclosure text features

abstract: A public firm's bankruptcy prediction is an important financial research problem because of the security price downside risks. Traditional methods rely on accounting metrics that suffer from shortcomings like window dressing and retrospective focus. While disclosure text-based metrics overcome some of these issues, current methods excessively focus on disclosure tone and sentiment. There is a requirement to relate meaningful signals in the disclosure text to financial outcomes and quantify the disclosure text data. This work proposes a new distress dictionary based on the sentences used by managers in explaining financial status. It demonstrates the significant differences in linguistic features between bankrupt and non-bankrupt firms. Further, using a large sample of 500 bankrupt firms, it builds predictive models and compares the performance against two dictionaries used in financial text analysis. This research shows that the proposed stress dictionary captures unique information from disclosures and the predictive models based on its features have the highest accuracy.


title: Quantitative Analysis of Shock Wave Dynamics in a Fluid of Light

abstract: We report on the formation of a dispersive shock wave in a nonlinear optical medium. We monitor the evolution of the shock by tuning the incoming beam power. The experimental observations for the position and intensity of the solitonic edge of the shock, as well as the location of the nonlinear oscillations are well described by recent developments of Whitham modulation theory. Our work constitutes a detailed and accurate benchmark for this approach. It opens exciting possibilities to engineer specific configurations of optical shock wave for studying wave-mean flow interaction.


title: Higher-Order Spin-Hole Correlations around a Localized Charge Impurity

abstract: Analysis of higher-order correlation functions has become a powerful tool for investigating interacting many-body systems in quantum simulators, such as quantum gas microscopes. Experimental measurements of mixed spin-charge correlation functions in the 2D Hubbard have been used to study equilibrium properties of magnetic polarons and to identify coherent and incoherent regimes of their dynamics. In this paper we consider theoretically an extension of this technique to systems which use a pinning potential to reduce the mobility of a single dopant in the Mott insulating regime of the 2D Hubbard model. We find that localization of the dopant has a dramatic effect on its magnetic dressing. The connected third-order spin correlations are weakened in the case of a mobile hole but strengthened near an immobile hole. In the case of the fifth-order correlation function, we find that its bare value has opposite signs in cases of the mobile and of fully pinned dopant, whereas the connected part is similar for both cases. We study suppression of higher-order correlators by thermal fluctuations and demonstrate that they can be observed up to temperatures comparable to the spin-exchange energy $J$. We discuss implications of our results for understanding the interplay of spin and charge in doped Mott insulators.


title: Dissipation measures in weakly-collisional plasmas

abstract: The physical foundations of the dissipation of energy and the associated heating in weakly collisional plasmas are poorly understood. Here, we compare and contrast several measures that have been used to characterize energy dissipation and kinetic-scale conversion in plasmas by means of a suite of kinetic numerical simulations describing both magnetic reconnection and decaying plasma turbulence. We adopt three different numerical codes that can also include interparticle collisions: the fully kinetic particle-in-cell VPIC, the fully kinetic continuum Gkeyll, and the Eulerian Hybrid Vlasov-Maxwell (HVM) code. We differentiate between (i) four energy-based parameters, whose definition is related to energy transfer in a fluid description of a plasma, and (ii) four distribution function-based parameters, requiring knowledge of the particle velocity distribution function. There is an overall agreement between the dissipation measures obtained in the PIC and continuum reconnection simulations, with slight differences due to the presence/absence of secondary islands in the two simulations. There are also many qualitative similarities between the signatures in the reconnection simulations and the self-consistent current sheets that form in turbulence, although the latter exhibits significant variations compared to the reconnection results. All the parameters confirm that dissipation occurs close to regions of intense magnetic stresses, thus exhibiting local correlation. The distribution function-based measures show a broader width compared to energy-based proxies, suggesting that energy transfer is co-localized at coherent structures, but can affect the particle distribution function in wider regions. The effect of interparticle collisions on these parameters is finally discussed.


title: Importance of meson-meson and of diquark-antidiquark creation operators for a $\bar{b} \bar{b} u d$ tetraquark

abstract: In recent years, the existence of a hadronically stable $\bar{b} \bar{b} u d$ tetraquark with quantum numbers $I(J^P) = 0(1^+)$ was confirmed by first principles lattice QCD computations. In this work we use lattice QCD to compare two frequently discussed competing structures for this tetraquark by considering meson-meson as well as diquark-antidiquark creation operators. We use the static-light approximation, where the two $\bar{b}$ quarks are assumed to be infinitely heavy with frozen positions, while the light $u$ and $d$ quarks are fully relativistic. By minimizing effective energies and by solving generalized eigenvalue problems we determine the importance of the meson-meson and the diquark-antidiquark creation operators with respect to the ground state. It turns out, that the diquark-antidiquark structure dominates for $\bar{b} \bar{b}$ separations $r < 0.25 \, \text{fm}$, whereas it becomes increasingly more irrelevant for larger separations, where the $I(J^P) = 0(1^+)$ tetraquark is mostly a meson-meson state. We also estimate the meson-meson to diquark-antidiquark ratio of this tetraquark and find around $60\% / 40\%$.


title: The relation between AGN type and host galaxy properties

abstract: We use 3,213 Active Galactic Nuclei (AGNs) from the $\it{XMM}$-XXL northern field to investigate the relation of AGN type with host galaxy properties. Applying a Bayesian method, we derive the hardness ratios (HRs) and through these the hydrogen column density ($\rm N_H$) for each source. We consider as absorbed sources (type-2) those with $\rm N_H > 10^{21.5}\, \rm{cm^{-2}}$. We examine the star formation rate (SFR) as well the stellar mass (M$_*$) distributions for both absorbed and unabsorbed sources. Our work indicates that there is no significant link between the AGN type and these host galaxy properties. Next, we investigate whether the AGN power, as represented by its X-ray luminosity, $\rm L_X$, correlates with any deviation of the host galaxy's place from the so-called Main Sequence of galaxies, and we examine this separately for the obscured and the unobscured AGN populations. To take into account the effect of M$_*$ and redshift on SFR, we use the normalised SFR (SFR$_{norm}$). We find that the correlation between $\rm L_X$ and SFR$_{norm}$, follows approximately the same trend for both absorbed and unabsorbed sources, a result that favours the standard AGN unification models. Finally, we explore the connection between the obscuration, $\rm N_H$, and the SFR. We find that there is no relation between these, suggesting that the obscuration is not related to the large scale SFR in the galaxy.


title: a posteriori stabilized sixth-order finite volume scheme with adaptive stencil construction -- Basics for the 1D steady-state hyperbolic equations

abstract: We propose an adaptive stencil construction for high order accurate finite volume schemes aposteriori stabilized devoted to solve one-dimensional steady-state hyperbolic equations. High-accuracy (up to the sixth-order presently) is achieved thanks to polynomial reconstructions while stability is provided with an aposteriori MOOD method which controls the cell polynomial degree for eliminating non-physical oscillations in the vicinity of discontinuities. We supplemented this scheme with a stencil construction allowing to reduce even further the numerical dissipation. The stencil is shifted away from troubles (shocks, discontinuities, etc.) leading to less oscillating polynomial reconstructions. Experimented on linear, B\"urgers', and Euler equations, we demonstrate that the adaptive stencil technique manages to retrieve smooth solutions with optimal order of accuracy but also irregular ones without spurious oscillations. Moreover we numerically show that the approach allows to reduce the dissipation still maintaining the essentially non-oscillatory behavior.


title: Distributionally robust halfspace depth

abstract: Tukey's halfspace depth can be seen as a stochastic program and as such it is not guarded against optimizer's curse, so that a limited training sample may easily result in a poor out-of-sample performance. We propose a generalized halfspace depth concept relying on the recent advances in distributionally robust optimization, where every halfspace is examined using the respective worst-case distribution in the Wasserstein ball of radius $\delta\geq 0$ centered at the empirical law. This new depth can be seen as a smoothed and regularized classical halfspace depth which is retrieved as $\delta\downarrow 0$. It inherits most of the main properties of the latter and, additionally, enjoys various new attractive features such as continuity and strict positivity beyond the convex hull of the support. We provide numerical illustrations of the new depth and its advantages, and develop some fundamental theory. In particular, we study the upper level sets and the median region including their breakdown properties.


title: IGM Transmission Bias for $z$ $\geq$ 2.9 Lyman Continuum Detected Galaxies

abstract: Understanding the relationship between the underlying escape fraction of Lyman continuum (LyC) photons ($f_{\rm esc}$) emitted by galaxies and measuring the distribution of observed $f_{\rm esc}$ values at high redshift is fundamental to the interpretation of the reionization process. In this paper we perform a statistical exploration of the attenuation of LyC photons by neutral hydrogen in the intergalactic medium using ensembles of simulated transmission functions. We show that LyC detected galaxies are more likely to be found in sightlines with higher-than-average transmission of LyC photons. This means that adopting a mean transmission at a given redshift leads to an overestimate of the true $f_{\rm esc}$ for LyC detected galaxies. We note, however, that mean values are appropriate for $f_{\rm esc}$ estimates of larger parent samples that include LyC non-detected galaxies. We quantify this IGM transmission bias for LyC detections in photometric and spectroscopic surveys in the literature and show that the bias is stronger for both shallower observations and for fainter parent samples (i.e. Lyman $\alpha$ emitters versus Lyman break galaxies). We also explore the effects of varying the underlying probability distribution function (PDF) of $f_{\rm esc}$ on recovered values, showing that the underlying $f_{\rm esc}$ PDF may depend on sample selection by comparing with observational surveys. This work represents a first step in improved interpretation of LyC detections in the context of understanding $f_{\rm esc}$ from high redshift galaxies.


title: Synthetic Embedding-based Data Generation Methods for Student Performance

abstract: Given the inherent class imbalance issue within student performance datasets, samples belonging to the edges of the target class distribution pose a challenge for predictive machine learning algorithms to learn. In this paper, we introduce a general framework for synthetic embedding-based data generation (SEDG), a search-based approach to generate new synthetic samples using embeddings to correct the detriment effects of class imbalances optimally. We compare the SEDG framework to past synthetic data generation methods, including deep generative models, and traditional sampling methods. In our results, we find SEDG to outperform the traditional re-sampling methods for deep neural networks and perform competitively for common machine learning classifiers on the student performance task in several standard performance metrics.


title: Meta-Learning Conjugate Priors for Few-Shot Bayesian Optimization

abstract: Bayesian Optimization is methodology used in statistical modelling that utilizes a Gaussian process prior distribution to iteratively update a posterior distribution towards the true distribution of the data. Finding unbiased informative priors to sample from is challenging and can greatly influence the outcome on the posterior distribution if only few data are available. In this paper we propose a novel approach to utilize meta-learning to automate the estimation of informative conjugate prior distributions given a distribution class. From this process we generate priors that require only few data to estimate the shape parameters of the original distribution of the data.


title: Law of Iterated Logarithms and Fractal Properties of the KPZ Equation

abstract: We consider the Cole-Hopf solution of the (1+1)-dimensional KPZ equation started from the narrow wedge initial condition. In this article, we ask how the peaks and valleys of the KPZ height function (centered by time/24) at any spatial point grow as time increases. Our first main result is about the law of iterated logarithms for the KPZ equation. As time variable $t$ goes to $\infty$, we show that the limsup of the KPZ height function with the scaling by $t^{1/3}(\log\log t)^{2/3}$ is almost surely equal to $(\frac{3}{4\sqrt{2}})^{2/3}$ whereas the liminf of the height function with the scaling by $t^{1/3}(\log\log t)^{1/3}$ is almost surely equal to $-6^{1/3}$. Our second main result concerns with the macroscopic fractal properties of the KPZ equation. Under exponential transformation of the time variable, we show that the peaks of KPZ height function mutate from being monofractal to multifractal, a property reminiscent of a similar phenomenon in Brownian motion [Khoshnevisan-Kim-Xiao 17, Theorem 1.4]. The proofs of our main results hinge on the following three key tools: (1) a multi-point composition law of the KPZ equation which can be regarded as a generalization of the two point composition law from [Corwin-Ghosal-Hammond 19, Proposition 2.9], (2) the Gibbsian line ensemble techniques from [Corwin-Hammond 14, Corwin-Hammond 16, Corwin-Ghosal-Hammond 19] and, (3) the tail probabilities of the KPZ height function in short time and its spatio-temporal modulus of continuity. We advocate this last tool as one of our new and important contributions which might garner independent interest.


title: Towards Network Traffic Monitoring Using Deep Transfer Learning

abstract: Network traffic is growing at an outpaced speed globally. The modern network infrastructure makes classic network intrusion detection methods inefficient to classify an inflow of vast network traffic. This paper aims to present a modern approach towards building a network intrusion detection system (NIDS) by using various deep learning methods. To further improve our proposed scheme and make it effective in real-world settings, we use deep transfer learning techniques where we transfer the knowledge learned by our model in a source domain with plentiful computational and data resources to a target domain with sparse availability of both the resources. Our proposed method achieved 98.30% classification accuracy score in the source domain and an improved 98.43% classification accuracy score in the target domain with a boost in the classification speed using UNSW-15 dataset. This study demonstrates that deep transfer learning techniques make it possible to construct large deep learning models to perform network classification, which can be deployed in the real world target domains where they can maintain their classification performance and improve their classification speed despite the limited accessibility of resources.


title: Generalized Latency Performance Estimation for Once-For-All Neural Architecture Search

abstract: Neural Architecture Search (NAS) has enabled the possibility of automated machine learning by streamlining the manual development of deep neural network architectures defining a search space, search strategy, and performance estimation strategy. To solve the need for multi-platform deployment of Convolutional Neural Network (CNN) models, Once-For-All (OFA) proposed to decouple Training and Search to deliver a one-shot model of sub-networks that are constrained to various accuracy-latency tradeoffs. We find that the performance estimation strategy for OFA's search severely lacks generalizability of different hardware deployment platforms due to single hardware latency lookup tables that require significant amount of time and manual effort to build beforehand. In this work, we demonstrate the framework for building latency predictors for neural network architectures to address the need for heterogeneous hardware support and reduce the overhead of lookup tables altogether. We introduce two generalizability strategies which include fine-tuning using a base model trained on a specific hardware and NAS search space, and GPU-generalization which trains a model on GPU hardware parameters such as Number of Cores, RAM Size, and Memory Bandwidth. With this, we provide a family of latency prediction models that achieve over 50% lower RMSE loss as compared to with ProxylessNAS. We also show that the use of these latency predictors match the NAS performance of the lookup table baseline approach if not exceeding it in certain cases.


title: Occlusion-robust Deformable Object Tracking without Physics Simulation

abstract: Estimating the state of a deformable object is crucial for robotic manipulation, yet accurate tracking is challenging when the object is partially-occluded. To address this problem, we propose an occlusion-robust RGBD sequence tracking framework based on Coherent Point Drift (CPD). To mitigate the effects of occlusion, our method 1) Uses a combination of locally linear embedding and constrained optimization to regularize the output of CPD, thus enforcing topological consistency when occlusions create disconnected pieces of the object; 2) Reasons about the free-space visible by an RGBD sensor to better estimate the prior on point location and to detect tracking failures during occlusion; and 3) Uses shape descriptors to find the most relevant previous state of the object to use for tracking after a severe occlusion. Our method does not rely on physics simulation or a physical model of the object, which can be difficult to obtain in unstructured environments. Despite having no physical model, our experiments demonstrate that our method achieves improved accuracy in the presence of occlusion as compared to a physics-based CPD method while maintaining adequate run-time.


title: Factor Analysis, Probabilistic Principal Component Analysis, Variational Inference, and Variational Autoencoder: Tutorial and Survey

abstract: This is a tutorial and survey paper on factor analysis, probabilistic Principal Component Analysis (PCA), variational inference, and Variational Autoencoder (VAE). These methods, which are tightly related, are dimensionality reduction and generative models. They assume that every data point is generated from or caused by a low-dimensional latent factor. By learning the parameters of distribution of latent space, the corresponding low-dimensional factors are found for the sake of dimensionality reduction. For their stochastic and generative behaviour, these models can also be used for generation of new data points in the data space. In this paper, we first start with variational inference where we derive the Evidence Lower Bound (ELBO) and Expectation Maximization (EM) for learning the parameters. Then, we introduce factor analysis, derive its joint and marginal distributions, and work out its EM steps. Probabilistic PCA is then explained, as a special case of factor analysis, and its closed-form solutions are derived. Finally, VAE is explained where the encoder, decoder and sampling from the latent space are introduced. Training VAE using both EM and backpropagation are explained.


title: Strongly nonlocal unextendible product bases do exist

abstract: A set of multipartite orthogonal product states is locally irreducible, if it is not possible to eliminate one or more states from the set by orthogonality-preserving local measurements. An effective way to prove that a set is locally irreducible is to show that only trivial orthogonality-preserving local measurement can be performed to this set. In general, it is difficult to show that such an orthogonality-preserving local measurement must be trivial. In this work, we develop two basic techniques to deal with this problem. Using these techniques, we successfully show the existence of unextendible product bases (UPBs) that are locally irreducible in every bipartition in $d\otimes d\otimes d$ for any $d\geq 3$, and $3\otimes3\otimes 3$ achieves the minimum dimension for the existence of such UPBs. These UPBs exhibit the phenomenon of strong quantum nonlocality without entanglement. Our result solves an open question given by Halder \emph{et al.} [Phys. Rev. Lett. \textbf{122}, 040403 (2019)] and Yuan \emph{et al.} [Phys. Rev. A \textbf{102}, 042228 (2020)]. It also sheds new light on the connections between UPBs and strong quantum nonlocality.


title: Modeling RIS Empowered Outdoor-to-Indoor Communication in mmWave Cellular Networks

abstract: With the increasing adoption of millimeter-waves (mmWave) over cellular networks, outdoor-to-indoor (O2I) communication has been one of the challenging research problems due to high penetration loss of buildings. To address this, we investigate the practicability of utilizing reconfigurable intelligent surfaces (RISs) for assisting such O2I communication. We propose a new notion of prefabricated RIS-empowered wall consisting of a large number of chipless radio frequency identification (RFID) sensors. Each sensor maintains its own bank of delay lines. These sensors which are built within the building walls can potentially be controlled by a main integrated circuit (IC) to regulate the phase of impinging signals. To evaluate our idea, we develop a thorough performance analysis of the RIS-based O2I communication in the mmWave network using stochastic-geometry tools for blockage models. Our analysis facilitates two closed-form approximations of the downlink signal-to-noise ratio (SNR) coverage probability for RIS-based O2I communication. We perform extensive simulations to evaluate the accuracy of the derived expressions, thus providing new observations and findings.


title: Coreference Resolution: Are the eliminated spans totally worthless?

abstract: Various neural-based methods have been proposed so far for joint mention detection and coreference resolution. However, existing works on coreference resolution are mainly dependent on filtered mention representation, while other spans are largely neglected. In this paper, we aim at increasing the utilization rate of data and investigating whether those eliminated spans are totally useless, or to what extent they can improve the performance of coreference resolution. To achieve this, we propose a mention representation refining strategy where spans highly related to mentions are well leveraged using a pointer network for representation enhancing. Notably, we utilize an additional loss term in this work to encourage the diversity between entity clusters. Experimental results on the document-level CoNLL-2012 Shared Task English dataset show that eliminated spans are indeed much effective and our approach can achieve competitive results when compared with previous state-of-the-art in coreference resolution.


title: A novel policy for pre-trained Deep Reinforcement Learning for Speech Emotion Recognition

abstract: Reinforcement Learning (RL) is a semi-supervised learning paradigm which an agent learns by interacting with an environment. Deep learning in combination with RL provides an efficient method to learn how to interact with the environment is called Deep Reinforcement Learning (deep RL). Deep RL has gained tremendous success in gaming - such as AlphaGo, but its potential have rarely being explored for challenging tasks like Speech Emotion Recognition (SER). The deep RL being used for SER can potentially improve the performance of an automated call centre agent by dynamically learning emotional-aware response to customer queries. While the policy employed by the RL agent plays a major role in action selection, there is no current RL policy tailored for SER. In addition, extended learning period is a general challenge for deep RL which can impact the speed of learning for SER. Therefore, in this paper, we introduce a novel policy - "Zeta policy" which is tailored for SER and apply Pre-training in deep RL to achieve faster learning rate. Pre-training with cross dataset was also studied to discover the feasibility of pre-training the RL Agent with a similar dataset in a scenario of where no real environmental data is not available. IEMOCAP and SAVEE datasets were used for the evaluation with the problem being to recognize four emotions happy, sad, angry and neutral in the utterances provided. Experimental results show that the proposed "Zeta policy" performs better than existing policies. The results also support that pre-training can reduce the training time upon reducing the warm-up period and is robust to cross-corpus scenario.


title: LSM-DFN Modeling for Seismic Responses in Complex Fractured Media: Comparison of Static and Dynamic Elastic Moduli

abstract: Crack microgeometries pose a paramount influence on effective elastic characteristics and sonic responses. Geophysical exploration based on seismic methods are widely used to assess and understand the presence of fractures. Numerical simulation as a promising way for this issue, still faces some challenges. With the rapid development of computers and computational techniques, discrete-based numerical approaches with desirable properties have been increasingly developed, but have not yet extensively applied to seismic response simulation for complex fractured media. For this purpose, we apply the coupled LSM-DFN model (Liu and Fu, 2020b) to examining the validity in emulating elastic wave propagation and scattering in naturally-fractured media. By comparing to the theoretical values, the implement of the schema is validated with input parameters optimization. Moreover, dynamic elastic moduli from seismic responses are calculated and compared with static ones from quasi-static loading of uniaxial compression tests. Numerical results are consistent with the tendency of theoretical predictions and available experimental data. It shows the potential for reproducing the seismic responses in complex fractured media and quantitatively investigating the correlations and differences between static and dynamic elastic moduli.


title: Exact Coverage Analysis of Intelligent Reflecting Surfaces with Nakagami-{m} Channels

abstract: Intelligent Reflecting Surfaces (IRS) are a promising solution to enhance the coverage of future wireless networks by tuning low-cost passive reflecting elements (referred to as {metasurfaces}), thereby constructing a favorable wireless propagation environment. Different from prior works, which assume Rayleigh fading channels and do not consider the direct link between a base station and a user, this article develops a framework based on moment generation functions (MGF) to characterize the coverage probability of a user in an IRS-aided wireless systems with generic Nakagami-m fading channels in the presence of direct links. In addition, we demonstrate that the proposed framework is tractable for both finite and asymptotically large values of the metasurfaces. Furthermore, we derive the channel hardening factor as a function of the shape factor of Nakagami-m fading channel and the number of IRS elements. Finally, we derive a closed-form expression to calculate the maximum coverage range of the IRS for given network parameters. Numerical results obtained from Monte-Carlo simulations validate the derived analytical results.


title: SmartArm: Suturing Feasibility of a Surgical Robotic System on a Neonatal Chest Model

abstract: Commercially available surgical-robot technology currently addresses many surgical scenarios for adult patients. This same technology cannot be used to the benefit of neonate patients given the considerably smaller workspace. Medically relevant procedures regarding neonate patients include minimally invasive surgery to repair congenital esophagus disorders, which entail the suturing of the fragile esophagus within the narrow neonate cavity. In this work, we explore the use of the SmartArm robotic system in a feasibility study using a neonate chest and esophagus model. We show that a medically inexperienced operator can perform two-throw knots inside the neonate chest model using the robotic system.


title: Guaranteed $\epsilon$-optimal solutions with the linear optimizer ART3+O

abstract: The linear optimization algorithm ART3+O introduced by Chen et al. (2010) can efficiently solve large scale inverse planning problems encountered in radiation therapy by iterative projection. Its major weakness is that it cannot guarantee ${\epsilon}$-optimality of the final solution due to an arbitrary stopping criterion. We propose an improvement to ART3+O where the stopping criterion is based on Farkas' lemma. The same theory can be used to detect inconsistency in other projection methods as well. The proposed algorithm guarantees to find an ${\epsilon}$-optimal solution in finite time. The algorithm is demonstrated on numerical examples in radiation therapy.


title: Comment on `Linear energy transfer incorporated intensity modulated proton therapy optimization'

abstract: Cao et al (2018) published an article on inverse planning based on dose-averaged linear energy transfer (LET). Their claim that the problem can be cast as a linear optimization model relies on an incorrect application of the Charnes-Cooper transformation. In this comment we show that their linear model is simlar to one where dose-averaged LET is multiplied with dose, explaining why their model was nonetheless able to improve the LET distribution.


title: Learning to Optimize Under Constraints with Unsupervised Deep Neural Networks

abstract: In this paper, we propose a machine learning (ML) method to learn how to solve a generic constrained continuous optimization problem. To the best of our knowledge, the generic methods that learn to optimize, focus on unconstrained optimization problems and those dealing with constrained problems are not easy-to-generalize. This approach is quite useful in optimization tasks where the problem's parameters constantly change and require resolving the optimization task per parameter update. In such problems, the computational complexity of optimization algorithms such as gradient descent or interior point method preclude near-optimal designs in real-time applications. In this paper, we propose an unsupervised deep learning (DL) solution for solving constrained optimization problems in real-time by relegating the main computation load to offline training phase. This paper's main contribution is proposing a method for enforcing the equality and inequality constraints to the DL-generated solutions for generic optimization tasks.


title: DSXplore: Optimizing Convolutional Neural Networks via Sliding-Channel Convolutions

abstract: As the key advancement of the convolutional neural networks (CNNs), depthwise separable convolutions (DSCs) are becoming one of the most popular techniques to reduce the computations and parameters size of CNNs meanwhile maintaining the model accuracy. It also brings profound impact to improve the applicability of the compute- and memory-intensive CNNs to a broad range of applications, such as mobile devices, which are generally short of computation power and memory. However, previous research in DSCs are largely focusing on compositing the limited existing DSC designs, thus, missing the opportunities to explore more potential designs that can achieve better accuracy and higher computation/parameter reduction. Besides, the off-the-shelf convolution implementations offer limited computing schemes, therefore, lacking support for DSCs with different convolution patterns. To this end, we introduce, DSXplore, the first optimized design for exploring DSCs on CNNs. Specifically, at the algorithm level, DSXplore incorporates a novel factorized kernel -- sliding-channel convolution (SCC), featured with input-channel overlapping to balance the accuracy performance and the reduction of computation and memory cost. SCC also offers enormous space for design exploration by introducing adjustable kernel parameters. Further, at the implementation level, we carry out an optimized GPU-implementation tailored for SCC by leveraging several key techniques, such as the input-centric backward design and the channel-cyclic optimization. Intensive experiments on different datasets across mainstream CNNs show the advantages of DSXplore in balancing accuracy and computation/parameter reduction over the standard convolution and the existing DSCs.